-- Logs begin at Thu 2022-08-11 09:07:21 UTC, end at Thu 2022-08-11 10:14:10 UTC. -- Aug 11 09:39:32.052149 dv-cinder-815660-9-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 11 09:39:32.059601 dv-cinder-815660-9-smb devstack@keystone.service[98465]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 11 09:39:32.061585 dv-cinder-815660-9-smb devstack@keystone.service[98465]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 11 09:39:32 2022] *** Aug 11 09:39:32.061585 dv-cinder-815660-9-smb devstack@keystone.service[98465]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 11 09:39:32.061585 dv-cinder-815660-9-smb devstack@keystone.service[98465]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 11 09:39:32.061585 dv-cinder-815660-9-smb devstack@keystone.service[98465]: nodename: dv-cinder-815660-9-smb Aug 11 09:39:32.061585 dv-cinder-815660-9-smb devstack@keystone.service[98465]: machine: x86_64 Aug 11 09:39:32.061585 dv-cinder-815660-9-smb devstack@keystone.service[98465]: clock source: unix Aug 11 09:39:32.061982 dv-cinder-815660-9-smb devstack@keystone.service[98465]: pcre jit disabled Aug 11 09:39:32.061982 dv-cinder-815660-9-smb devstack@keystone.service[98465]: detected number of CPU cores: 4 Aug 11 09:39:32.061982 dv-cinder-815660-9-smb devstack@keystone.service[98465]: current working directory: / Aug 11 09:39:32.061982 dv-cinder-815660-9-smb devstack@keystone.service[98465]: detected binary path: /usr/bin/uwsgi-core Aug 11 09:39:32.061982 dv-cinder-815660-9-smb devstack@keystone.service[98465]: your processes number limit is 47680 Aug 11 09:39:32.061982 dv-cinder-815660-9-smb devstack@keystone.service[98465]: your memory page size is 4096 bytes Aug 11 09:39:32.061982 dv-cinder-815660-9-smb devstack@keystone.service[98465]: detected max file descriptor number: 2048 Aug 11 09:39:32.061982 dv-cinder-815660-9-smb devstack@keystone.service[98465]: lock engine: pthread robust mutexes Aug 11 09:39:32.061982 dv-cinder-815660-9-smb devstack@keystone.service[98465]: thunder lock: enabled Aug 11 09:39:32.061982 dv-cinder-815660-9-smb devstack@keystone.service[98465]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 11 09:39:32.062787 dv-cinder-815660-9-smb devstack@keystone.service[98465]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 11 09:39:32.102967 dv-cinder-815660-9-smb devstack@keystone.service[98465]: Python main interpreter initialized at 0x55699d8a49c0 Aug 11 09:39:32.102967 dv-cinder-815660-9-smb devstack@keystone.service[98465]: python threads support enabled Aug 11 09:39:32.102967 dv-cinder-815660-9-smb devstack@keystone.service[98465]: your server socket listen backlog is limited to 100 connections Aug 11 09:39:32.102967 dv-cinder-815660-9-smb devstack@keystone.service[98465]: your mercy for graceful operations on workers is 90 seconds Aug 11 09:39:32.103328 dv-cinder-815660-9-smb devstack@keystone.service[98465]: mapped 403077 bytes (393 KB) for 2 cores Aug 11 09:39:32.103432 dv-cinder-815660-9-smb devstack@keystone.service[98465]: *** Operational MODE: preforking *** Aug 11 09:39:32.103721 dv-cinder-815660-9-smb devstack@keystone.service[98465]: *** uWSGI is running in multiple interpreter mode *** Aug 11 09:39:32.103721 dv-cinder-815660-9-smb devstack@keystone.service[98465]: spawned uWSGI master process (pid: 98465) Aug 11 09:39:32.103926 dv-cinder-815660-9-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 11 09:39:32.105814 dv-cinder-815660-9-smb devstack@keystone.service[98465]: spawned uWSGI worker 1 (pid: 98478, cores: 1) Aug 11 09:39:32.105814 dv-cinder-815660-9-smb devstack@keystone.service[98465]: spawned uWSGI worker 2 (pid: 98479, cores: 1) Aug 11 09:39:32.105814 dv-cinder-815660-9-smb devstack@keystone.service[98465]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 11 09:39:37.570960 dv-cinder-815660-9-smb devstack@keystone.service[98479]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 09:39:37.570960 dv-cinder-815660-9-smb devstack@keystone.service[98479]: from cryptography.utils import int_from_bytes Aug 11 09:39:37.571781 dv-cinder-815660-9-smb devstack@keystone.service[98479]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 09:39:37.571781 dv-cinder-815660-9-smb devstack@keystone.service[98479]: from cryptography.utils import int_from_bytes Aug 11 09:39:37.571923 dv-cinder-815660-9-smb devstack@keystone.service[98478]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 09:39:37.571923 dv-cinder-815660-9-smb devstack@keystone.service[98478]: from cryptography.utils import int_from_bytes Aug 11 09:39:37.571923 dv-cinder-815660-9-smb devstack@keystone.service[98478]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 09:39:37.571923 dv-cinder-815660-9-smb devstack@keystone.service[98478]: from cryptography.utils import int_from_bytes Aug 11 09:39:37.620496 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 11 09:39:37.620691 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 11 09:39:37.625459 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] command line args: [] {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 11 09:39:37.625559 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 11 09:39:37.625632 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 11 09:39:37.625698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 11 09:39:37.625762 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ================================================================================ {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 11 09:39:37.625830 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] command line args: [] {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 11 09:39:37.625894 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] admin_token = **** {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.625953 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 11 09:39:37.626014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] config_dir = [] {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.626099 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ================================================================================ {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 11 09:39:37.626165 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.626235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] admin_token = **** {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.626300 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] config_source = [] {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.626300 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] debug = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.626414 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] config_dir = [] {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.626477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.626750 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.626750 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] config_source = [] {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.626750 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] debug = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.626908 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.626908 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] insecure_debug = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.627026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.627107 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.627166 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.627166 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] insecure_debug = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.627277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.627345 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.627414 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] list_limit = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.627414 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] log_config_append = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.627520 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.627578 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.627635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] list_limit = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.627696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] log_dir = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.627763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] log_config_append = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.627825 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] log_file = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.627887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.627945 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.628007 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] log_dir = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.628007 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] log_file = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.628120 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.628194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.628251 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.628251 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.628353 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.628420 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.628420 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.628535 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.628592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.628648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.628648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.628766 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.628831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.628888 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.628950 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.629012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.629076 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.629134 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.629194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.629256 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.629318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.629379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.629452 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.629510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] notification_format = cadf {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.629570 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.629627 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.629684 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.629684 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] notification_format = cadf {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.629796 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.629855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.629912 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] publish_errors = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.629912 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.629912 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.630435 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.631066 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.631156 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] publish_errors = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.631284 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.631363 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.631478 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.631553 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.631553 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.631705 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] standard_threads = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.631705 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] strict_password_check = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.631831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.631900 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.631973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.632048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] use_eventlog = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.632125 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] standard_threads = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.632201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] use_journal = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.632275 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] strict_password_check = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.632344 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] use_json = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.632344 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] use_stderr = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.632468 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.632544 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] use_syslog = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.632619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] use_eventlog = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.632694 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] watch_log_file = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.632764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] use_journal = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.632764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] use_json = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.632905 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.633035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] use_stderr = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.633152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.633264 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] use_syslog = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.633406 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.633513 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] watch_log_file = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 09:39:37.633607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.633781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.633880 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.633988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.634107 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.634220 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.634220 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.634417 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.634417 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.634599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.634599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.634785 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.634887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.634988 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.635088 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.635088 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.635268 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.635362 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.635463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.635557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.635668 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.635803 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.635904 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.635998 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.635998 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.636237 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.636362 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.636477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.636589 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.636707 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.636829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.636943 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.637055 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.637055 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.637283 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.637404 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.637524 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.637637 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.637748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.637866 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.637866 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.638164 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.638299 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.638421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.638535 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.638646 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.638764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.638764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.639060 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.639176 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.639293 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.639416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.639497 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.639573 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.639573 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.639714 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.639784 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.639853 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.639922 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.640137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.640225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.640958 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.641110 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.641260 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.641406 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.641498 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.641700 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.641777 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.641954 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.642029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.642213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.642304 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.642447 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.642552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.642678 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.642781 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.642910 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.643022 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.643139 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.643241 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.643375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.643502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.643648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.643781 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.643896 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.644014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.644128 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.644240 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.644359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.644480 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.644590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.644733 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.644838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.644972 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.645094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.645210 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.645321 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.645435 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.645556 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.645678 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.645792 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.645904 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.646025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.646223 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.646339 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.646452 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.646571 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.646686 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.646807 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.646928 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.647048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.647168 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.647288 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.647402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.647523 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.647644 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.647750 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.647868 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.647990 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.648105 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.648223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.648345 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.648460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.648571 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.648689 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.648941 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.649077 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.649192 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.649304 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.649418 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.649644 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.649769 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.649926 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.650052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.650284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.650446 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.650564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.650757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.650884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.651051 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.enabled = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.651221 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.651339 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.651518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.651685 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.651804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.651994 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.652111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.652231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.652441 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.652558 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.652677 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.652869 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.653111 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.653198 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.653366 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.653466 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.653628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.653724 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.653872 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.653953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.enabled = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.654111 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.654198 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.654328 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.654480 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.654579 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.654789 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.654883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.655035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.655137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.655290 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.655385 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.655516 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.655596 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.655721 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.655834 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.655993 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.656226 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.656311 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.656496 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.656579 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.657245 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.657336 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.657336 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.657474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.657548 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.657625 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.657697 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.657777 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.657850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.657921 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.657998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.658071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.658169 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.658255 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] auth.external = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.658329 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.658401 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] auth.mapped = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.658558 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.658709 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.658845 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.658976 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.659096 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.659221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] auth.password = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.659339 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.659460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] auth.token = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.659575 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.659700 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.659816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.659929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] catalog.caching = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.660050 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.660164 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.660314 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.660441 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.660557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.660679 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.660801 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.660916 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.661059 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.661177 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.661290 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] auth.external = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.661414 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] credential.caching = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.661530 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] auth.mapped = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.661651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] credential.driver = sql {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.661767 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.661882 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.662010 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.662150 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.662267 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] auth.password = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.662391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.662517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] auth.token = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.662662 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.662789 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.662910 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.663026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] catalog.caching = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.663140 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.663262 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.663378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.663501 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.663617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.663731 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.663845 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.663959 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.664072 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.664195 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.664311 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.664424 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] credential.caching = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.664424 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] credential.driver = sql {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.664644 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.664760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.664882 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.664998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.665118 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.665233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.665338 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] federation.caching = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.665450 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.665572 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.665688 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.665802 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] federation.driver = sql {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.665915 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.666029 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.666029 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.666360 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.666360 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.666579 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.666579 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.666796 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.666909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.667031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.667147 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.667269 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.667385 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.667499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.667613 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.667737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.667852 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.667967 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.668081 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] identity.caching = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.668194 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] federation.caching = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.668307 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.668429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.668545 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.668660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] federation.driver = sql {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.668774 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.668888 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.669002 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.669124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.669239 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] identity.driver = sql {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.669353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.669468 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.669581 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.669695 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.669818 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.669934 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.670048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.670214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.670331 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.670446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.670568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.670684 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.670797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.670912 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.671026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] identity.caching = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.671139 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.671261 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.671377 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.671526 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.671647 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.671761 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.671888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.672005 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.672119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.672233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] identity.driver = sql {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.672233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.672445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.672566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.672682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.672795 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.672910 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.673023 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.673137 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.673259 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.673374 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.673488 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.673602 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.673715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.673828 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.673949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.674066 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.674206 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.674322 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.674436 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.674549 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.674671 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.674787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.674901 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.675016 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.675137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.675253 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.675375 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.675491 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.675605 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.675718 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.675832 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.675952 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.676076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.676193 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.676306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.676421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.676534 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.676648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.password = **** {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.676770 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.676886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.677000 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.677115 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.677229 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.677343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.677465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.677581 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.677694 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.677808 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.677922 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.678036 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.678204 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.678321 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.678435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.678549 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.678662 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.678776 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.678898 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.679013 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.679127 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.679242 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.679355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.password = **** {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.679469 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.679591 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.679707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.679821 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.679934 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.680076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.680192 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.user = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.680316 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.680431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.680545 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.680659 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.680773 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.680886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.681008 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.681124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.681237 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.681352 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.681465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.681579 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.681701 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.681820 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.681935 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.682049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.682179 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.682294 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.682424 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.682540 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.682654 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.683023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.683138 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.user = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.683251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.683378 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.683496 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.683610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.683724 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.683837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.683959 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.684074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.684187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.684301 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.684415 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.684529 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.684650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.684766 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.684879 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.684993 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.685106 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.685219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.685340 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.685455 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.685570 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.685683 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.685796 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.685910 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.686031 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.686177 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.686292 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.686405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.686519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.686632 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.686632 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.686860 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] policy.driver = sql {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.686860 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.687073 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.687073 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.687918 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.688044 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.688161 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.688300 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.688423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] receipt.caching = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.688537 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.688653 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.688776 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.688891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.689005 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.689118 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.689232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.689232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.689527 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.689644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.689759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.689873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] policy.driver = sql {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.689873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.690138 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] resource.caching = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.690268 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.690268 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.690482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.690595 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] receipt.caching = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.690707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] resource.driver = sql {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.690820 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.690820 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.691040 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.691153 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.691266 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.691378 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.691491 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.691612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.691726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] revoke.caching = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.691847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] resource.caching = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.691960 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.692073 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.692185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.692309 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] resource.driver = sql {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.692429 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] role.cache_time = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.692543 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.692656 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] role.caching = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.692769 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.692882 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] role.driver = sql {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.693003 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.693117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] role.list_limit = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.693230 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] revoke.caching = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.693343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.693455 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.693568 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.693689 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.693803 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.693917 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] role.cache_time = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.694029 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.694196 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] role.caching = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.694309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.694438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] role.driver = sql {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.694553 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.694666 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] role.list_limit = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.694786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.694901 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.695015 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.695136 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.695250 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.695363 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.695476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.695589 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.695701 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.695822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.695937 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.696052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.696165 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.696278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.696278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.696500 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.696612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.696725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.696845 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.696990 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.697116 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.697116 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.697331 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.697445 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.697559 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.697559 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.697779 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.697895 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.698009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.698137 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.698253 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.698367 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.698493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.698610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.698610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.698822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.698936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.699050 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.699173 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.699289 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.699403 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.699517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.699631 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.699745 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.699866 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.699982 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.699982 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.700197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.700310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.700424 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.700546 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.700662 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] token.cache_time = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.700776 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.700890 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] token.caching = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.700890 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.701102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.701225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] token.provider = fernet {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.701341 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.701341 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.701554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.701666 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.701788 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.701903 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] token.cache_time = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.702044 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.702211 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] token.caching = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.702331 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.702445 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.702570 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.702686 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] token.provider = fernet {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.702829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.703458 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.703574 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] trust.driver = sql {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.703688 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.703811 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.703811 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.704027 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.704140 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.704254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.704369 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.704490 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.704606 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.704720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.704834 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.704947 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] trust.driver = sql {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.705061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.705182 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.705182 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.705397 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.705511 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.705624 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] database.connection = **** {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.705746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.705870 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.705985 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.706127 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.706246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.706360 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.706475 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.706588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.706701 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.706823 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.706938 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] database.connection = **** {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.707060 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.707183 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.707299 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.707412 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.707527 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.707649 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.707764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.707877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.707991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.708104 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.708217 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.708405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.708524 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.708639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.708752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.708866 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.708979 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.709104 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.709220 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.709334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.709447 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.709560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.709675 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.709797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.709912 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.709912 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 11 09:39:37.710151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.710151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.710151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.710151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.710578 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.710578 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 09:39:37.710791 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 11 09:39:37.738362 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.738587 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.738808 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.738930 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.739158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.739380 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.748475 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.748917 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.777517 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.777658 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.777800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.777885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.830460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.830769 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.880045 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.880273 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.880890 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.881124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.944699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.944921 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.945140 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.945261 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.945343 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.945492 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.945575 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.945713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.945795 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.945930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.946173 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.946388 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.969324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.969544 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.969629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.969765 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.969847 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.969982 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.970064 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.970219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.970312 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.970430 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.970512 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.970637 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.970719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.970877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.981897 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.982262 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.994388 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.994607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.994821 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.994918 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.995033 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.995115 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.995240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.995322 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.995446 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.995587 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.995674 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98479) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.995824 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.996039 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:37.996253 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 09:39:38.012343 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.012548 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 11 09:39:38.012881 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.013073 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.013155 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 11 09:39:38.013284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 11 09:39:38.013367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.013577 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.013658 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.013807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 11 09:39:38.013887 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.014065 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.014167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.014361 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.014619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.014875 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.025772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.026046 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.026339 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.026614 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.026807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.027084 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.027354 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.027635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.033987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=98479) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.035165 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=98478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.037045 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=98479) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.037327 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.037614 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.037893 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.038204 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.038286 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=98478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.038476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.038558 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.038740 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.038822 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.039009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.039098 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.039272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.039354 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.039556 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.039636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.039819 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.039907 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.040097 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.040378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.040658 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.040933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.063051 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.064234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.064523 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=98479) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.064817 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.065730 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=98478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.066014 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.069373 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=98479) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.069652 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.069925 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.070608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=98478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.070895 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.071177 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.076444 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=98479) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.076725 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.077690 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=98478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.078534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.081305 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=98479) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.081552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.081831 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.082140 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.082591 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.082683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=98478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.082907 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.083072 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.083189 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.084313 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.084413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.084499 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.084565 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.084628 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.084628 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.084628 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.099887 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.100161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.100601 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.100883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.104125 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=98479) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.104815 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=98478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.107288 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.107580 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.107973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.108274 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.112458 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=98479) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.113182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=98478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.115627 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=98479) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.116373 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=98478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.118783 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.119079 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.119369 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.119567 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.119652 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.119867 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.119950 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.120153 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.120236 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.120437 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.120712 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.120996 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.136568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=98479) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.136849 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.137111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.137369 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.137463 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=98478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.137715 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.137989 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.138280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.144354 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.145204 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.145897 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.146198 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.146780 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.147061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.148974 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=98479) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.149260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.149548 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.149834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.149919 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=98478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.150128 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.150230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.150445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.150735 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.151013 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.161455 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=98479) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.161735 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.162012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.162312 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.162397 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=98478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.162592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.162674 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.162864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.162953 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.163133 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.163216 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.163462 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.163737 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.164011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.180019 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=98479) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.181019 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=98478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.183230 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=98479) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.184255 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=98478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.186167 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.187754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.188324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.189322 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.189794 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=98479) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.190094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.190379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.190839 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=98478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.191128 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.191409 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.196714 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.197801 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.198347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=98479) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.199449 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=98478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.201235 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.201522 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.201809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.202100 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.202391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.202681 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.202986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.203260 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.210343 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=98479) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.210631 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.210909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.211345 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=98478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.211634 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.211913 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.217876 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=98479) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.218185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.218490 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.218765 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.218845 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=98478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 09:39:38.219033 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.219114 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.219308 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.219401 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.219575 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.219658 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.219841 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.219923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.220113 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.220219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.220396 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.220499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.220663 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.220754 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.221017 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.221100 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.221291 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.221374 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.221559 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=98479) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.221649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.221823 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.222124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.222390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=98478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 09:39:38.255657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55699d8a49c0 pid: 98479 (default app) Aug 11 09:39:38.256486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55699d8a49c0 pid: 98478 (default app) Aug 11 09:39:38.258872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8645a0-659f-4763-aa3e-d7e84e4aac78 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:38.259156 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8645a0-659f-4763-aa3e-d7e84e4aac78 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:38.259423 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8645a0-659f-4763-aa3e-d7e84e4aac78 None None] PATH_INFO: `/v3` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:38.263673 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Thu Aug 11 09:39:38 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:39:46.631882 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5baff-d83d-412e-b902-7a5429c5c051 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:46.632398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5baff-d83d-412e-b902-7a5429c5c051 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:46.632398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5baff-d83d-412e-b902-7a5429c5c051 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:46.636795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:39:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:39:46.642938 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fcfda-a216-4713-8846-6567be149031 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:46.643345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fcfda-a216-4713-8846-6567be149031 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:46.643477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fcfda-a216-4713-8846-6567be149031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:46.718664 dv-cinder-815660-9-smb devstack@keystone.service[98479]: INFO dbcounter [None req-629fcfda-a216-4713-8846-6567be149031 None None] Registered counter for database keystone Aug 11 09:39:46.738005 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG oslo_db.sqlalchemy.engines [None req-629fcfda-a216-4713-8846-6567be149031 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 09:39:46.744091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writer thread running {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 09:39:46.924000 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG passlib.handlers.bcrypt [None req-629fcfda-a216-4713-8846-6567be149031 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=98479) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 11 09:39:46.924343 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG passlib.handlers.bcrypt [None req-629fcfda-a216-4713-8846-6567be149031 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=98479) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 11 09:39:46.978484 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-629fcfda-a216-4713-8846-6567be149031 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:39:46.980073 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-629fcfda-a216-4713-8846-6567be149031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:39:47.108464 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:39:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 11 09:39:47.248997 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5baff-d83d-412e-b902-7a5429c5c051 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:47.319279 dv-cinder-815660-9-smb devstack@keystone.service[98478]: INFO dbcounter [None req-baa5baff-d83d-412e-b902-7a5429c5c051 None None] Registered counter for database keystone Aug 11 09:39:47.339993 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG oslo_db.sqlalchemy.engines [None req-baa5baff-d83d-412e-b902-7a5429c5c051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 09:39:47.346883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writer thread running {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 09:39:47.464484 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5baff-d83d-412e-b902-7a5429c5c051 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:47.468808 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a650aa3-8ab6-4d8d-b7d7-5fe7504b6b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:47.469413 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a650aa3-8ab6-4d8d-b7d7-5fe7504b6b05 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:47.469687 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a650aa3-8ab6-4d8d-b7d7-5fe7504b6b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:47.469955 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a650aa3-8ab6-4d8d-b7d7-5fe7504b6b05 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:47.477778 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a650aa3-8ab6-4d8d-b7d7-5fe7504b6b05 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:47.529288 dv-cinder-815660-9-smb devstack@keystone.service[98478]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0a650aa3-8ab6-4d8d-b7d7-5fe7504b6b05 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 11 09:39:47.529623 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a650aa3-8ab6-4d8d-b7d7-5fe7504b6b05 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:47.538884 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Thu Aug 11 09:39:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 11 09:39:47.544845 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fcfda-a216-4713-8846-6567be149031 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:47.559078 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fcfda-a216-4713-8846-6567be149031 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:47.563969 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52de5f-81dd-4502-8247-676441b83a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:47.565074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52de5f-81dd-4502-8247-676441b83a20 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:47.565346 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52de5f-81dd-4502-8247-676441b83a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:47.565608 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52de5f-81dd-4502-8247-676441b83a20 admin admin] PATH_INFO: `/v3/projects/ba0bc4e750d24ff2b5db7519dfabe004` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:47.567045 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52de5f-81dd-4502-8247-676441b83a20 admin admin] RBAC: Authorizing `identity:get_project(project_id=ba0bc4e750d24ff2b5db7519dfabe004)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:47.616895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5f52de5f-81dd-4502-8247-676441b83a20 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 11 09:39:47.617232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52de5f-81dd-4502-8247-676441b83a20 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:47.621747 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Thu Aug 11 09:39:47 2022] GET /identity/v3/projects/ba0bc4e750d24ff2b5db7519dfabe004 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:39:49.568095 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3e45a-e1e9-4444-a2b6-f22648e3b5e4 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:49.568711 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3e45a-e1e9-4444-a2b6-f22648e3b5e4 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:49.568711 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3e45a-e1e9-4444-a2b6-f22648e3b5e4 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:49.572797 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:39:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:39:49.578784 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff486ea-99ee-46b3-abbb-ed76a5d76251 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:49.579222 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff486ea-99ee-46b3-abbb-ed76a5d76251 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:49.579323 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff486ea-99ee-46b3-abbb-ed76a5d76251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:49.600002 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-8ff486ea-99ee-46b3-abbb-ed76a5d76251 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:39:49.601484 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-8ff486ea-99ee-46b3-abbb-ed76a5d76251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:39:49.609121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:39:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 11 09:39:49.630789 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3e45a-e1e9-4444-a2b6-f22648e3b5e4 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:49.643411 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3e45a-e1e9-4444-a2b6-f22648e3b5e4 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:49.647686 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a251b-899c-4bd7-9f8d-662adc622a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:49.648277 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a251b-899c-4bd7-9f8d-662adc622a22 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:49.648558 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a251b-899c-4bd7-9f8d-662adc622a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:49.648836 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a251b-899c-4bd7-9f8d-662adc622a22 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:49.656751 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a251b-899c-4bd7-9f8d-662adc622a22 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:49.658201 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a251b-899c-4bd7-9f8d-662adc622a22 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:49.677386 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Thu Aug 11 09:39:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 09:39:49.677494 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff486ea-99ee-46b3-abbb-ed76a5d76251 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:49.681209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff486ea-99ee-46b3-abbb-ed76a5d76251 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:49.685814 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231e9e2-09e4-43ad-8e03-a359ed3c28f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:49.686456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231e9e2-09e4-43ad-8e03-a359ed3c28f3 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:49.687266 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231e9e2-09e4-43ad-8e03-a359ed3c28f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:49.687535 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231e9e2-09e4-43ad-8e03-a359ed3c28f3 admin admin] PATH_INFO: `/v3/users/07db6516e8ce4759bb6e5167b3fb5367` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:49.688831 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231e9e2-09e4-43ad-8e03-a359ed3c28f3 admin admin] RBAC: Authorizing `identity:get_user(user_id=07db6516e8ce4759bb6e5167b3fb5367)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:49.690661 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231e9e2-09e4-43ad-8e03-a359ed3c28f3 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:49.692134 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Thu Aug 11 09:39:49 2022] GET /identity/v3/users/07db6516e8ce4759bb6e5167b3fb5367 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:39:51.757107 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4eb32-c099-4db7-81c4-3eabc359c9d5 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:51.757707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4eb32-c099-4db7-81c4-3eabc359c9d5 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:51.757707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4eb32-c099-4db7-81c4-3eabc359c9d5 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:51.759071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:39:51.759309 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252c254-fd7e-44c4-a690-86cdb61bd2eb None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:51.759719 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252c254-fd7e-44c4-a690-86cdb61bd2eb None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:51.759879 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252c254-fd7e-44c4-a690-86cdb61bd2eb None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:51.761260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 6/11] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:39:51.763884 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9200f-dbd4-454a-b0ba-d2def6f24f7d None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:51.764164 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9200f-dbd4-454a-b0ba-d2def6f24f7d None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:51.764434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9200f-dbd4-454a-b0ba-d2def6f24f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:51.766165 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b106c4-df65-4cff-867d-60ea8a4c4eb6 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:51.766444 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b106c4-df65-4cff-867d-60ea8a4c4eb6 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:51.766717 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b106c4-df65-4cff-867d-60ea8a4c4eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:51.784015 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-15b106c4-df65-4cff-867d-60ea8a4c4eb6 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:39:51.785186 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-15b106c4-df65-4cff-867d-60ea8a4c4eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:39:51.809516 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG passlib.handlers.bcrypt [None req-6ec9200f-dbd4-454a-b0ba-d2def6f24f7d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=98478) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 11 09:39:51.809936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG passlib.handlers.bcrypt [None req-6ec9200f-dbd4-454a-b0ba-d2def6f24f7d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=98478) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 11 09:39:51.855740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-6ec9200f-dbd4-454a-b0ba-d2def6f24f7d None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:39:51.857338 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-6ec9200f-dbd4-454a-b0ba-d2def6f24f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:39:51.864704 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 7/12] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 09:39:51.885692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b106c4-df65-4cff-867d-60ea8a4c4eb6 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:51.909447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:39:51.956731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 6/13] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:39:51.979657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9200f-dbd4-454a-b0ba-d2def6f24f7d None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:51.986216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b106c4-df65-4cff-867d-60ea8a4c4eb6 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:52.019059 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936e0bc-36bf-4232-8f9f-5141e14e17ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:52.019660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936e0bc-36bf-4232-8f9f-5141e14e17ac None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:52.019930 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936e0bc-36bf-4232-8f9f-5141e14e17ac None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:52.020194 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936e0bc-36bf-4232-8f9f-5141e14e17ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:52.076621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9200f-dbd4-454a-b0ba-d2def6f24f7d None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:52.078900 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:39:52.085680 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936e0bc-36bf-4232-8f9f-5141e14e17ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:52.087179 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936e0bc-36bf-4232-8f9f-5141e14e17ac None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:52.110416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:39:52.114645 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309a6d7-cf4d-4211-9c2d-a4fe25917b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:52.115729 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309a6d7-cf4d-4211-9c2d-a4fe25917b86 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:52.116006 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309a6d7-cf4d-4211-9c2d-a4fe25917b86 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:52.116272 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309a6d7-cf4d-4211-9c2d-a4fe25917b86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:52.128203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309a6d7-cf4d-4211-9c2d-a4fe25917b86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:39:52.136781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-c309a6d7-cf4d-4211-9c2d-a4fe25917b86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:39:52.136781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:39:52.136781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:39:52.136781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:39:52.136781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:39:52.136781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:39:52.136781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:39:52.136781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:39:52.136781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:39:52.136781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:39:52.136781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:39:52.136781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:39:52.136781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:39:52.136781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:39:52.136781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:39:52.136781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:39:52.137707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:39:52.137707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:39:52.137707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:39:52.137707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:39:52.137707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:39:52.137707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:39:52.137707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:39:52.137707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:39:52.137707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:39:52.137707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:39:52.137707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:39:52.137707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:39:52.137707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:39:52.137707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:39:52.137707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:39:52.137707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:39:52.138566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:39:52.138566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:39:52.138566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:39:52.138566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:39:52.138566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:39:52.138566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:39:52.138566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:39:52.138566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:39:52.138566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:39:52.138566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:39:52.138566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:39:52.138566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:39:52.138566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 7/14] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:39:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:39:52.144029 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309a6d7-cf4d-4211-9c2d-a4fe25917b86 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:52.184940 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 8/15] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:39:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 09:39:52.190437 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936e0bc-36bf-4232-8f9f-5141e14e17ac None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:52.242788 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309a6d7-cf4d-4211-9c2d-a4fe25917b86 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:52.275150 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de064e39-0023-4c6a-bd9d-4d31a7b23b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:52.275749 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de064e39-0023-4c6a-bd9d-4d31a7b23b47 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:52.276026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de064e39-0023-4c6a-bd9d-4d31a7b23b47 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:52.276296 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de064e39-0023-4c6a-bd9d-4d31a7b23b47 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:52.276952 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de064e39-0023-4c6a-bd9d-4d31a7b23b47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:39:52.277248 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de064e39-0023-4c6a-bd9d-4d31a7b23b47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:52.278710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de064e39-0023-4c6a-bd9d-4d31a7b23b47 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:52.288938 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936e0bc-36bf-4232-8f9f-5141e14e17ac None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:52.292691 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 8/16] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:39:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:39:52.298251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de064e39-0023-4c6a-bd9d-4d31a7b23b47 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:52.312248 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:39:52.323855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961c226-713a-4e3d-9520-570d71b25fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:52.324167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:39:52.324480 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961c226-713a-4e3d-9520-570d71b25fd4 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:52.324756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961c226-713a-4e3d-9520-570d71b25fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:52.325025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961c226-713a-4e3d-9520-570d71b25fd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:52.336723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961c226-713a-4e3d-9520-570d71b25fd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:52.338216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961c226-713a-4e3d-9520-570d71b25fd4 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:52.356391 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-d961c226-713a-4e3d-9520-570d71b25fd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:39:52.356391 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:39:52.356391 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:39:52.356391 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:39:52.356391 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:39:52.356391 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:39:52.356391 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:39:52.356391 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:39:52.356391 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:39:52.356391 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:39:52.356391 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:39:52.356391 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:39:52.356391 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:39:52.356391 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:39:52.356391 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:39:52.356391 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:39:52.357465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:39:52.357465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:39:52.357465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:39:52.357465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:39:52.357465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:39:52.357465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:39:52.357465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:39:52.357465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:39:52.357465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:39:52.357465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:39:52.357465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:39:52.357465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:39:52.357465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:39:52.357465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:39:52.357465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:39:52.357465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:39:52.357465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:39:52.358447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:39:52.358447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:39:52.358447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:39:52.358447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 9/17] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:39:52.363451 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961c226-713a-4e3d-9520-570d71b25fd4 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:52.399347 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de064e39-0023-4c6a-bd9d-4d31a7b23b47 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:52.437044 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d44b8a-bd18-4ad3-b876-47dda2d7b529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:52.437596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d44b8a-bd18-4ad3-b876-47dda2d7b529 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:52.437871 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d44b8a-bd18-4ad3-b876-47dda2d7b529 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:52.438170 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d44b8a-bd18-4ad3-b876-47dda2d7b529 None admin] PATH_INFO: `/v3/users/07db6516e8ce4759bb6e5167b3fb5367` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:52.439728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d44b8a-bd18-4ad3-b876-47dda2d7b529 None admin] RBAC: Authorizing `identity:get_user(user_id=07db6516e8ce4759bb6e5167b3fb5367)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:52.441197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d44b8a-bd18-4ad3-b876-47dda2d7b529 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:52.443038 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 9/18] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:39:52 2022] GET /identity/v3/users/07db6516e8ce4759bb6e5167b3fb5367 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:39:52.448687 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d44b8a-bd18-4ad3-b876-47dda2d7b529 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:52.544041 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:39:52.550876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d44b8a-bd18-4ad3-b876-47dda2d7b529 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:52.567229 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961c226-713a-4e3d-9520-570d71b25fd4 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:52.585244 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d9689-d437-4ada-9778-6565e2f3a8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:52.585867 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d9689-d437-4ada-9778-6565e2f3a8d8 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:52.586176 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d9689-d437-4ada-9778-6565e2f3a8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:52.586448 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d9689-d437-4ada-9778-6565e2f3a8d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:52.587967 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d9689-d437-4ada-9778-6565e2f3a8d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:52.589419 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d9689-d437-4ada-9778-6565e2f3a8d8 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:52.590977 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 10/19] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:39:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:39:52.596694 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d9689-d437-4ada-9778-6565e2f3a8d8 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:52.600673 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4651744-a04d-4446-af16-e1f14b83c1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:52.601274 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4651744-a04d-4446-af16-e1f14b83c1c5 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:52.601551 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4651744-a04d-4446-af16-e1f14b83c1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:52.601820 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4651744-a04d-4446-af16-e1f14b83c1c5 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:52.602493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4651744-a04d-4446-af16-e1f14b83c1c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:39:52.602799 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4651744-a04d-4446-af16-e1f14b83c1c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:52.604179 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4651744-a04d-4446-af16-e1f14b83c1c5 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:52.620724 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 10/20] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:39:52.710364 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d9689-d437-4ada-9778-6565e2f3a8d8 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:52.746754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8266f4-3a1a-4511-8dcc-04038b3ab6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:52.747370 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8266f4-3a1a-4511-8dcc-04038b3ab6c8 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:52.747640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8266f4-3a1a-4511-8dcc-04038b3ab6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:52.747902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8266f4-3a1a-4511-8dcc-04038b3ab6c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:52.748637 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8266f4-3a1a-4511-8dcc-04038b3ab6c8 None admin] RBAC: Adding query filter params (role.id=6aae1c66f3f04cec80ed72c20d7e033b, scope.domain.id=default, user.id=07db6516e8ce4759bb6e5167b3fb5367) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:39:52.749452 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8266f4-3a1a-4511-8dcc-04038b3ab6c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:52.750942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8266f4-3a1a-4511-8dcc-04038b3ab6c8 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:52.759602 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 11/21] 10.222.0.13 () {56 vars in 1322 bytes} [Thu Aug 11 09:39:52 2022] GET /identity/v3/role_assignments?user.id=07db6516e8ce4759bb6e5167b3fb5367&scope.domain.id=default&role.id=6aae1c66f3f04cec80ed72c20d7e033b => generated 233 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:39:54.910880 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206b235-0156-4fcf-a87d-d69fa611e1fd None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:54.911372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206b235-0156-4fcf-a87d-d69fa611e1fd None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:54.911372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206b235-0156-4fcf-a87d-d69fa611e1fd None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:54.912927 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 11/22] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:39:54.918228 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d35260-3dd7-4151-ab13-b5f455d64649 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:54.918615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d35260-3dd7-4151-ab13-b5f455d64649 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:54.918783 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d35260-3dd7-4151-ab13-b5f455d64649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:54.947180 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-e9d35260-3dd7-4151-ab13-b5f455d64649 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:39:54.948386 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-e9d35260-3dd7-4151-ab13-b5f455d64649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:39:54.973597 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:39:55.043609 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcb36e-3d36-4984-93bd-b7de2ad9c14b None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:55.043886 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcb36e-3d36-4984-93bd-b7de2ad9c14b None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:55.044162 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcb36e-3d36-4984-93bd-b7de2ad9c14b None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:55.046336 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 12/23] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:39:55.048432 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 12/24] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:39:55.067569 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5ee31-e374-4b94-a6c1-dfb30df86936 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:55.067856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5ee31-e374-4b94-a6c1-dfb30df86936 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:55.068107 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5ee31-e374-4b94-a6c1-dfb30df86936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:55.092267 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d35260-3dd7-4151-ab13-b5f455d64649 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:55.100864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-8dc5ee31-e374-4b94-a6c1-dfb30df86936 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:39:55.102114 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-8dc5ee31-e374-4b94-a6c1-dfb30df86936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:39:55.162520 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:39:55.249086 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 13/25] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 09:39:55.314532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5ee31-e374-4b94-a6c1-dfb30df86936 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:55.320243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d35260-3dd7-4151-ab13-b5f455d64649 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:55.411350 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1c100-c95c-4c86-88c1-84afe2e5273b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:55.411996 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1c100-c95c-4c86-88c1-84afe2e5273b None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:55.412427 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1c100-c95c-4c86-88c1-84afe2e5273b None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:55.412889 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1c100-c95c-4c86-88c1-84afe2e5273b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:55.438024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1c100-c95c-4c86-88c1-84afe2e5273b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:39:55.443821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-dad1c100-c95c-4c86-88c1-84afe2e5273b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:39:55.443821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:39:55.443821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:39:55.443821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:39:55.443821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:39:55.443821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:39:55.443821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:39:55.443821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:39:55.443821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:39:55.443821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:39:55.443821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:39:55.443821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:39:55.443821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:39:55.443821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:39:55.443821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:39:55.443821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:39:55.444648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:39:55.444648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:39:55.444648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:39:55.444648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:39:55.444648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:39:55.444648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:39:55.444648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:39:55.444648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:39:55.444648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:39:55.444648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:39:55.444648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:39:55.444648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:39:55.444648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:39:55.444648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:39:55.444648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:39:55.444648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:39:55.445398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:39:55.445398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:39:55.445398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:39:55.445398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:39:55.445398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:39:55.445398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:39:55.445398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:39:55.445398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:39:55.445398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:39:55.445398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:39:55.445398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:39:55.445398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:39:55.445398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 13/26] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:39:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:39:55.448101 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66022af-4ed3-4a32-87e4-2ed099752310 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:55.449013 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66022af-4ed3-4a32-87e4-2ed099752310 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:55.449459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66022af-4ed3-4a32-87e4-2ed099752310 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:55.456130 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 14/27] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:39:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:39:55.457604 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66022af-4ed3-4a32-87e4-2ed099752310 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:55.478173 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:39:55.558329 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5ee31-e374-4b94-a6c1-dfb30df86936 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:55.612235 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc97ea-042a-457d-ab58-208f171e302e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:55.613585 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc97ea-042a-457d-ab58-208f171e302e None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:55.614112 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc97ea-042a-457d-ab58-208f171e302e None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:55.614517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc97ea-042a-457d-ab58-208f171e302e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:55.628334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc97ea-042a-457d-ab58-208f171e302e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:55.630170 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc97ea-042a-457d-ab58-208f171e302e None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:55.661599 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-66dc97ea-042a-457d-ab58-208f171e302e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:39:55.661599 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:39:55.661599 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:39:55.661599 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:39:55.661599 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:39:55.661599 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:39:55.661599 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:39:55.661599 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:39:55.661599 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:39:55.661599 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:39:55.661599 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:39:55.661599 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:39:55.661599 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:39:55.661599 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:39:55.661599 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:39:55.661599 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:39:55.662500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:39:55.662500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:39:55.662500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:39:55.662500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:39:55.662500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:39:55.662500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:39:55.662500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:39:55.662500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:39:55.662500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:39:55.662500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:39:55.662500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:39:55.662500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:39:55.662500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:39:55.662500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:39:55.662500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:39:55.662500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:39:55.662500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:39:55.663370 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:39:55.663370 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:39:55.663370 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:39:55.663370 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 14/28] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:39:55.665452 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277a473-9eea-4891-abf6-dbf47b9d60d8 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:55.666004 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277a473-9eea-4891-abf6-dbf47b9d60d8 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:55.666522 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277a473-9eea-4891-abf6-dbf47b9d60d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:55.689569 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-1277a473-9eea-4891-abf6-dbf47b9d60d8 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:39:55.690829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-1277a473-9eea-4891-abf6-dbf47b9d60d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:39:55.704122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:39:55.756910 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66022af-4ed3-4a32-87e4-2ed099752310 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:55.762940 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 15/29] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:39:55.763974 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eabc2d-748f-43ce-b83f-eb95ed542b5c None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:55.764281 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eabc2d-748f-43ce-b83f-eb95ed542b5c None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:55.765108 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eabc2d-748f-43ce-b83f-eb95ed542b5c None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:55.766536 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 16/30] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:39:55.767042 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eabc2d-748f-43ce-b83f-eb95ed542b5c None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:55.802354 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74874b-f69a-40d7-aef5-503c6a007325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:55.803857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74874b-f69a-40d7-aef5-503c6a007325 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:55.804358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74874b-f69a-40d7-aef5-503c6a007325 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:55.804919 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74874b-f69a-40d7-aef5-503c6a007325 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:55.806006 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74874b-f69a-40d7-aef5-503c6a007325 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:39:55.806534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74874b-f69a-40d7-aef5-503c6a007325 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:55.809323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74874b-f69a-40d7-aef5-503c6a007325 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:55.820178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 15/31] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:39:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:39:55.821762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f5bb4-541d-4de5-ab1d-b139dd23a2ad None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:55.822621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f5bb4-541d-4de5-ab1d-b139dd23a2ad None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:55.823246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f5bb4-541d-4de5-ab1d-b139dd23a2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:55.845228 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-965f5bb4-541d-4de5-ab1d-b139dd23a2ad None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:39:55.847015 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-965f5bb4-541d-4de5-ab1d-b139dd23a2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:39:55.880573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eabc2d-748f-43ce-b83f-eb95ed542b5c None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:55.926583 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2d1cb-f305-4b13-930f-ea209745e1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:55.928571 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2d1cb-f305-4b13-930f-ea209745e1dd None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:55.929072 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2d1cb-f305-4b13-930f-ea209745e1dd None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:55.929809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2d1cb-f305-4b13-930f-ea209745e1dd None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:55.931049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2d1cb-f305-4b13-930f-ea209745e1dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:39:55.931852 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2d1cb-f305-4b13-930f-ea209745e1dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:55.933938 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2d1cb-f305-4b13-930f-ea209745e1dd None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:55.935578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 16/32] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:39:55.942390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f5bb4-541d-4de5-ab1d-b139dd23a2ad None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:55.950835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 17/33] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:39:55.951934 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2d1cb-f305-4b13-930f-ea209745e1dd None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:55.961196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:39:55.964090 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:39:56.071028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f5bb4-541d-4de5-ab1d-b139dd23a2ad None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:56.083207 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2d1cb-f305-4b13-930f-ea209745e1dd None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:56.117525 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c2b89-5c5d-4429-b7d8-5efd656af50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:56.118565 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c2b89-5c5d-4429-b7d8-5efd656af50d None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:56.119034 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c2b89-5c5d-4429-b7d8-5efd656af50d None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:56.119135 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d5086-fc7f-48eb-8d62-2914bf922c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:56.119616 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c2b89-5c5d-4429-b7d8-5efd656af50d None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:56.119870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d5086-fc7f-48eb-8d62-2914bf922c10 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:56.120247 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d5086-fc7f-48eb-8d62-2914bf922c10 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:56.120605 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d5086-fc7f-48eb-8d62-2914bf922c10 None admin] PATH_INFO: `/v3/users/07db6516e8ce4759bb6e5167b3fb5367` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:56.121018 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c2b89-5c5d-4429-b7d8-5efd656af50d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:56.121900 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d5086-fc7f-48eb-8d62-2914bf922c10 None admin] RBAC: Authorizing `identity:get_user(user_id=07db6516e8ce4759bb6e5167b3fb5367)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:56.122837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c2b89-5c5d-4429-b7d8-5efd656af50d None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:56.123501 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d5086-fc7f-48eb-8d62-2914bf922c10 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:56.126148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 18/34] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:39:55 2022] GET /identity/v3/users/07db6516e8ce4759bb6e5167b3fb5367 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:39:56.126973 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d5086-fc7f-48eb-8d62-2914bf922c10 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:56.206719 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:39:56.244184 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d5086-fc7f-48eb-8d62-2914bf922c10 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:56.281314 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d720e-57ae-48a4-ac73-628f92e9d71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:56.281925 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d720e-57ae-48a4-ac73-628f92e9d71b None admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:56.282236 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d720e-57ae-48a4-ac73-628f92e9d71b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:56.282509 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d720e-57ae-48a4-ac73-628f92e9d71b None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:56.283199 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d720e-57ae-48a4-ac73-628f92e9d71b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:56.284686 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d720e-57ae-48a4-ac73-628f92e9d71b None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:56.348018 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 17/35] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Aug 11 09:39:55 2022] POST /identity/v3/roles => generated 219 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:39:56.349317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c2b89-5c5d-4429-b7d8-5efd656af50d None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:56.430507 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:39:56.471427 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c2b89-5c5d-4429-b7d8-5efd656af50d None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:56.508429 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a62ec-8be3-4ee4-8b12-77051e857ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:56.509431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a62ec-8be3-4ee4-8b12-77051e857ad0 None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:56.509907 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a62ec-8be3-4ee4-8b12-77051e857ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:56.510618 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a62ec-8be3-4ee4-8b12-77051e857ad0 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:56.511505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a62ec-8be3-4ee4-8b12-77051e857ad0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:56.513589 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a62ec-8be3-4ee4-8b12-77051e857ad0 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:56.540446 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 19/36] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Aug 11 09:39:56 2022] POST /identity/v3/projects => generated 301 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:39:56.541551 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d720e-57ae-48a4-ac73-628f92e9d71b None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:56.567826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Aug 11 09:39:56 2022] POST /identity/v3/roles => generated 225 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:39:56.573240 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b09eb7-cae3-4909-80fa-7f94f8ec6622 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:56.573871 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b09eb7-cae3-4909-80fa-7f94f8ec6622 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:56.574444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b09eb7-cae3-4909-80fa-7f94f8ec6622 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:56.576389 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 19/38] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:39:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:39:56.583101 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99005ac4-e5d1-4ee9-9016-0e44d2c86592 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:56.583809 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99005ac4-e5d1-4ee9-9016-0e44d2c86592 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:56.584343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99005ac4-e5d1-4ee9-9016-0e44d2c86592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:56.606786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-99005ac4-e5d1-4ee9-9016-0e44d2c86592 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:39:56.608944 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-99005ac4-e5d1-4ee9-9016-0e44d2c86592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:39:56.688730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d720e-57ae-48a4-ac73-628f92e9d71b None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:56.700021 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 20/39] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 09:39:56.718708 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:39:56.728498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2dcb5-2c04-479a-8b54-21f3fdc68c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:56.729083 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2dcb5-2c04-479a-8b54-21f3fdc68c8a None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:56.729367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2dcb5-2c04-479a-8b54-21f3fdc68c8a None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:56.729635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2dcb5-2c04-479a-8b54-21f3fdc68c8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:56.731413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2dcb5-2c04-479a-8b54-21f3fdc68c8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:56.733659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2dcb5-2c04-479a-8b54-21f3fdc68c8a None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:56.735539 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 20/40] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:39:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:39:56.736041 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99005ac4-e5d1-4ee9-9016-0e44d2c86592 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:56.741660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2dcb5-2c04-479a-8b54-21f3fdc68c8a None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:56.821428 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:39:56.859474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2dcb5-2c04-479a-8b54-21f3fdc68c8a None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:56.880507 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99005ac4-e5d1-4ee9-9016-0e44d2c86592 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:56.904344 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e6847-bc28-4cc3-b1e6-5302c94320dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:56.905050 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e6847-bc28-4cc3-b1e6-5302c94320dd None admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:56.905326 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e6847-bc28-4cc3-b1e6-5302c94320dd None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:56.905600 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e6847-bc28-4cc3-b1e6-5302c94320dd None admin] PATH_INFO: `/v3/domains/default/users/07db6516e8ce4759bb6e5167b3fb5367/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:56.907707 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e6847-bc28-4cc3-b1e6-5302c94320dd None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=07db6516e8ce4759bb6e5167b3fb5367, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:56.909171 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e6847-bc28-4cc3-b1e6-5302c94320dd None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:56.922407 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d94df6-b7ab-461d-a308-0cf36c2a1b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:56.923044 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d94df6-b7ab-461d-a308-0cf36c2a1b8f None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:56.923320 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d94df6-b7ab-461d-a308-0cf36c2a1b8f None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:56.923589 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d94df6-b7ab-461d-a308-0cf36c2a1b8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:56.924682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d94df6-b7ab-461d-a308-0cf36c2a1b8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:56.926213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d94df6-b7ab-461d-a308-0cf36c2a1b8f None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:56.927772 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 21/41] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:39:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:39:56.928867 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b857eb-3b19-4ea7-a682-760555c69a85 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:56.929146 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b857eb-3b19-4ea7-a682-760555c69a85 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:56.934545 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b857eb-3b19-4ea7-a682-760555c69a85 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:56.934545 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 22/42] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:39:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:39:56.934545 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b857eb-3b19-4ea7-a682-760555c69a85 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:57.011477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 21/43] 10.222.0.13 () {58 vars in 1361 bytes} [Thu Aug 11 09:39:56 2022] PUT /identity/v3/domains/default/users/07db6516e8ce4759bb6e5167b3fb5367/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:39:57.012713 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c54ba-ad3b-45bd-8ad6-e8c2ac536786 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:57.013001 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c54ba-ad3b-45bd-8ad6-e8c2ac536786 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:57.013270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c54ba-ad3b-45bd-8ad6-e8c2ac536786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:57.033010 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-e01c54ba-ad3b-45bd-8ad6-e8c2ac536786 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:39:57.034648 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-e01c54ba-ad3b-45bd-8ad6-e8c2ac536786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:39:57.043155 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b857eb-3b19-4ea7-a682-760555c69a85 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:57.072658 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:39:57.082795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f35d4-8aed-4042-8d3a-94e66db73e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:57.083728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f35d4-8aed-4042-8d3a-94e66db73e70 None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:57.087612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f35d4-8aed-4042-8d3a-94e66db73e70 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:57.087612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f35d4-8aed-4042-8d3a-94e66db73e70 None admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:57.087612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f35d4-8aed-4042-8d3a-94e66db73e70 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:57.087612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f35d4-8aed-4042-8d3a-94e66db73e70 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:57.093411 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:39:57.116405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 22/44] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:39:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:39:57.139044 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c54ba-ad3b-45bd-8ad6-e8c2ac536786 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:57.238466 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c54ba-ad3b-45bd-8ad6-e8c2ac536786 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:57.241151 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 23/45] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Aug 11 09:39:56 2022] POST /identity/v3/projects => generated 312 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 09:39:57.278591 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d613cfb-4f03-4714-860b-363383f45340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:57.279455 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d613cfb-4f03-4714-860b-363383f45340 None admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:57.279791 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d613cfb-4f03-4714-860b-363383f45340 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:57.280131 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d613cfb-4f03-4714-860b-363383f45340 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:57.280862 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d613cfb-4f03-4714-860b-363383f45340 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:57.282483 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d613cfb-4f03-4714-860b-363383f45340 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:57.391282 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 23/46] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Aug 11 09:39:57 2022] POST /identity/v3/roles => generated 223 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 09:39:59.015730 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a2d3d-c79b-4787-bde8-50303172467a None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:59.016226 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a2d3d-c79b-4787-bde8-50303172467a None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:59.016226 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a2d3d-c79b-4787-bde8-50303172467a None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:59.017501 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 24/47] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:39:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:39:59.022833 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02c20d-781c-45c3-add8-f9ba25b8d77d None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:59.023270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02c20d-781c-45c3-add8-f9ba25b8d77d None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:59.023372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02c20d-781c-45c3-add8-f9ba25b8d77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:59.041604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-de02c20d-781c-45c3-add8-f9ba25b8d77d None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:39:59.042822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-de02c20d-781c-45c3-add8-f9ba25b8d77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:39:59.081861 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:39:59.108109 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 24/48] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:39:59.130253 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a2d3d-c79b-4787-bde8-50303172467a None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:59.230649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a2d3d-c79b-4787-bde8-50303172467a None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:59.262903 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f595c-440b-4383-b40b-a85132d24151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:59.263534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f595c-440b-4383-b40b-a85132d24151 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:59.263809 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f595c-440b-4383-b40b-a85132d24151 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:59.264590 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f595c-440b-4383-b40b-a85132d24151 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:59.268887 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe990dd2-c837-4774-8bf5-622fe46397e0 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:59.269184 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe990dd2-c837-4774-8bf5-622fe46397e0 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:59.269526 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe990dd2-c837-4774-8bf5-622fe46397e0 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:59.271033 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 25/49] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:39:59.274813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f595c-440b-4383-b40b-a85132d24151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:39:59.275753 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e673be-c17a-4887-92fb-c13d0cc5d0b3 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:59.276030 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e673be-c17a-4887-92fb-c13d0cc5d0b3 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:59.276299 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e673be-c17a-4887-92fb-c13d0cc5d0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:59.279486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-463f595c-440b-4383-b40b-a85132d24151 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:39:59.279486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:39:59.279486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:39:59.279486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:39:59.279486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:39:59.279486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:39:59.279486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:39:59.279486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:39:59.279486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:39:59.279486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:39:59.279486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:39:59.279486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:39:59.279486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:39:59.279486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:39:59.279486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:39:59.279486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:39:59.280929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:39:59.280929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:39:59.280929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:39:59.280929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:39:59.280929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:39:59.280929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:39:59.280929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:39:59.280929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:39:59.280929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:39:59.280929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:39:59.280929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:39:59.280929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:39:59.280929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:39:59.280929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:39:59.280929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:39:59.280929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:39:59.281909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:39:59.281909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:39:59.281909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:39:59.281909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:39:59.281909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:39:59.281909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:39:59.281909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:39:59.281909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:39:59.281909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:39:59.281909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:39:59.281909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:39:59.281909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:39:59.281909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 25/50] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:39:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:39:59.286862 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f595c-440b-4383-b40b-a85132d24151 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:59.294743 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-17e673be-c17a-4887-92fb-c13d0cc5d0b3 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:39:59.295960 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-17e673be-c17a-4887-92fb-c13d0cc5d0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:39:59.326121 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:39:59.360174 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 26/51] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 09:39:59.382876 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e673be-c17a-4887-92fb-c13d0cc5d0b3 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:59.388260 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f595c-440b-4383-b40b-a85132d24151 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:59.422595 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d56a1-785f-42a5-886c-56c8329c24fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:59.423197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d56a1-785f-42a5-886c-56c8329c24fc None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:59.423477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d56a1-785f-42a5-886c-56c8329c24fc None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:59.424100 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d56a1-785f-42a5-886c-56c8329c24fc None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:59.424756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d56a1-785f-42a5-886c-56c8329c24fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:39:59.425066 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d56a1-785f-42a5-886c-56c8329c24fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:59.426469 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d56a1-785f-42a5-886c-56c8329c24fc None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:59.434549 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 26/52] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:39:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:39:59.440621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d56a1-785f-42a5-886c-56c8329c24fc None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:59.485117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e673be-c17a-4887-92fb-c13d0cc5d0b3 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:59.487606 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:39:59.523908 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173c636-bc4d-4948-a3fb-fe3d5a09bd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:59.524465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173c636-bc4d-4948-a3fb-fe3d5a09bd69 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:59.524738 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173c636-bc4d-4948-a3fb-fe3d5a09bd69 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:59.524999 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173c636-bc4d-4948-a3fb-fe3d5a09bd69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:59.526136 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173c636-bc4d-4948-a3fb-fe3d5a09bd69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:59.527601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173c636-bc4d-4948-a3fb-fe3d5a09bd69 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:59.529135 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 27/53] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:39:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:39:59.534727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173c636-bc4d-4948-a3fb-fe3d5a09bd69 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:59.540395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:39:59.543307 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d56a1-785f-42a5-886c-56c8329c24fc None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:59.577388 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d8d14-3ec8-43c0-9bbb-f2073b31b9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:59.578333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d8d14-3ec8-43c0-9bbb-f2073b31b9b7 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:59.578611 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d8d14-3ec8-43c0-9bbb-f2073b31b9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:59.579050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d8d14-3ec8-43c0-9bbb-f2073b31b9b7 None admin] PATH_INFO: `/v3/users/07db6516e8ce4759bb6e5167b3fb5367` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:59.580534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d8d14-3ec8-43c0-9bbb-f2073b31b9b7 None admin] RBAC: Authorizing `identity:get_user(user_id=07db6516e8ce4759bb6e5167b3fb5367)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:59.582168 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d8d14-3ec8-43c0-9bbb-f2073b31b9b7 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:59.583737 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 27/54] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:39:59 2022] GET /identity/v3/users/07db6516e8ce4759bb6e5167b3fb5367 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:39:59.589059 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d8d14-3ec8-43c0-9bbb-f2073b31b9b7 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:59.630629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173c636-bc4d-4948-a3fb-fe3d5a09bd69 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:59.665343 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38dffb2-603a-46fb-841b-998ae0ec0e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:59.665945 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dffb2-603a-46fb-841b-998ae0ec0e61 None admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:59.666254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dffb2-603a-46fb-841b-998ae0ec0e61 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:59.666522 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dffb2-603a-46fb-841b-998ae0ec0e61 None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:59.667148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38dffb2-603a-46fb-841b-998ae0ec0e61 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:59.668574 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38dffb2-603a-46fb-841b-998ae0ec0e61 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:59.688039 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d8d14-3ec8-43c0-9bbb-f2073b31b9b7 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:59.720366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3eaee-ba9d-45c9-b923-1b76b8cbf822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:59.720984 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3eaee-ba9d-45c9-b923-1b76b8cbf822 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:59.721257 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3eaee-ba9d-45c9-b923-1b76b8cbf822 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:59.721525 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3eaee-ba9d-45c9-b923-1b76b8cbf822 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:59.722653 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3eaee-ba9d-45c9-b923-1b76b8cbf822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:59.724086 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3eaee-ba9d-45c9-b923-1b76b8cbf822 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:59.725670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 28/55] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:39:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:39:59.731309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3eaee-ba9d-45c9-b923-1b76b8cbf822 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:39:59.755333 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 28/56] 10.222.0.13 () {60 vars in 1140 bytes} [Thu Aug 11 09:39:59 2022] POST /identity/v3/projects => generated 298 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 09:39:59.765926 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:39:59.836018 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3eaee-ba9d-45c9-b923-1b76b8cbf822 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:39:59.872037 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4d3b7-9e9b-4213-b30f-f1602bb6fc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:39:59.872859 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4d3b7-9e9b-4213-b30f-f1602bb6fc0e None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:39:59.873090 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4d3b7-9e9b-4213-b30f-f1602bb6fc0e None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:39:59.873360 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4d3b7-9e9b-4213-b30f-f1602bb6fc0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:39:59.874736 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4d3b7-9e9b-4213-b30f-f1602bb6fc0e None admin] RBAC: Adding query filter params (role.id=6aae1c66f3f04cec80ed72c20d7e033b, scope.domain.id=default, user.id=07db6516e8ce4759bb6e5167b3fb5367) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:39:59.875040 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4d3b7-9e9b-4213-b30f-f1602bb6fc0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:39:59.876545 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4d3b7-9e9b-4213-b30f-f1602bb6fc0e None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:39:59.883075 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 29/57] 10.222.0.13 () {56 vars in 1322 bytes} [Thu Aug 11 09:39:59 2022] GET /identity/v3/role_assignments?user.id=07db6516e8ce4759bb6e5167b3fb5367&scope.domain.id=default&role.id=6aae1c66f3f04cec80ed72c20d7e033b => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:01.798327 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ab340-a02c-4b9a-8b0a-96e7450811b2 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:01.798810 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ab340-a02c-4b9a-8b0a-96e7450811b2 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:01.798892 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ab340-a02c-4b9a-8b0a-96e7450811b2 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:01.800185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 29/58] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:01.805275 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b12ba4-10e6-4d4d-91a2-aaf8782dfce6 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:01.805659 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b12ba4-10e6-4d4d-91a2-aaf8782dfce6 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:01.805821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b12ba4-10e6-4d4d-91a2-aaf8782dfce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:01.824468 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-d1b12ba4-10e6-4d4d-91a2-aaf8782dfce6 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:01.825632 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-d1b12ba4-10e6-4d4d-91a2-aaf8782dfce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:01.889777 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 30/59] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:01.912857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ab340-a02c-4b9a-8b0a-96e7450811b2 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:01.938717 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:02.013012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ab340-a02c-4b9a-8b0a-96e7450811b2 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:02.044766 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc144d-102a-475d-aa29-a74bbd7ab575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:02.045913 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc144d-102a-475d-aa29-a74bbd7ab575 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:02.046219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc144d-102a-475d-aa29-a74bbd7ab575 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:02.046490 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc144d-102a-475d-aa29-a74bbd7ab575 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:02.047608 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc144d-102a-475d-aa29-a74bbd7ab575 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:02.049043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc144d-102a-475d-aa29-a74bbd7ab575 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:02.050618 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 30/60] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:40:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:02.056331 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b12ba4-10e6-4d4d-91a2-aaf8782dfce6 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:02.085419 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:02.150857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b12ba4-10e6-4d4d-91a2-aaf8782dfce6 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:02.183269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65cb65-6d37-48b4-bc5f-a5baa6868004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:02.183802 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65cb65-6d37-48b4-bc5f-a5baa6868004 None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:02.184079 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65cb65-6d37-48b4-bc5f-a5baa6868004 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:02.184349 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65cb65-6d37-48b4-bc5f-a5baa6868004 None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:02.184988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65cb65-6d37-48b4-bc5f-a5baa6868004 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:02.187017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65cb65-6d37-48b4-bc5f-a5baa6868004 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:02.272767 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 31/61] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Aug 11 09:40:02 2022] POST /identity/v3/users => generated 275 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:40:05.368895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c3691-7386-425b-8ea2-5c4cf3a87e57 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:05.369945 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c3691-7386-425b-8ea2-5c4cf3a87e57 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:05.370451 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c3691-7386-425b-8ea2-5c4cf3a87e57 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:05.372010 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 31/62] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:05.377262 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9ee9f-2527-4852-9cc9-b24da32e53e1 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:05.378062 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9ee9f-2527-4852-9cc9-b24da32e53e1 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:05.378564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9ee9f-2527-4852-9cc9-b24da32e53e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:05.402682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-9dd9ee9f-2527-4852-9cc9-b24da32e53e1 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:05.404240 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-9dd9ee9f-2527-4852-9cc9-b24da32e53e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:05.450698 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27380f5e-e94d-4678-9912-922771cccccc None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:05.451357 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27380f5e-e94d-4678-9912-922771cccccc None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:05.451860 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27380f5e-e94d-4678-9912-922771cccccc None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:05.453400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 32/63] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:05.458296 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc1b81-d8e7-474c-8823-3da1bb7dc424 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:05.458810 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc1b81-d8e7-474c-8823-3da1bb7dc424 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:05.459282 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc1b81-d8e7-474c-8823-3da1bb7dc424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:05.488404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-c6cc1b81-d8e7-474c-8823-3da1bb7dc424 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:05.491668 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-c6cc1b81-d8e7-474c-8823-3da1bb7dc424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:05.535730 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 32/64] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:05.558998 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9ee9f-2527-4852-9cc9-b24da32e53e1 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:05.583241 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:05.610985 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 33/65] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 09:40:05.612459 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29337b6c-0c1d-41d0-b324-90a33a10f579 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:05.612887 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29337b6c-0c1d-41d0-b324-90a33a10f579 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:05.613328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29337b6c-0c1d-41d0-b324-90a33a10f579 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:05.614721 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 34/66] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:05.627406 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd894df-168a-406e-b2c1-8ca12173a8e1 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:05.627865 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd894df-168a-406e-b2c1-8ca12173a8e1 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:05.628392 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd894df-168a-406e-b2c1-8ca12173a8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:05.650177 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-3cd894df-168a-406e-b2c1-8ca12173a8e1 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:05.651693 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-3cd894df-168a-406e-b2c1-8ca12173a8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:05.676389 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:05.691613 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9ee9f-2527-4852-9cc9-b24da32e53e1 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:05.734575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead1783-0b55-4418-933c-792fb37ab2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:05.735782 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead1783-0b55-4418-933c-792fb37ab2aa None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:05.736319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead1783-0b55-4418-933c-792fb37ab2aa None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:05.736792 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead1783-0b55-4418-933c-792fb37ab2aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:05.737491 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 35/67] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:05.738735 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd894df-168a-406e-b2c1-8ca12173a8e1 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:05.748973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead1783-0b55-4418-933c-792fb37ab2aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:05.754049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-bead1783-0b55-4418-933c-792fb37ab2aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:05.754049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:05.754049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:05.754049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:05.754049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:05.754049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:05.754049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:05.754049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:05.754049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:05.754049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:05.754049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:05.754049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:05.754049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:05.754049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:05.754049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:05.754049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:05.754909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:05.754909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:05.754909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:05.754909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:05.754909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:05.754909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:05.754909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:05.754909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:05.754909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:05.754909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:05.754909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:05.754909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:05.754909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:05.754909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:05.754909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:05.754909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:05.755696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:05.755696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:05.755696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:05.755696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:05.755696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:05.755696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:05.755696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:05.755696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:05.755696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:05.755696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:05.755696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:05.755696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:40:05.757902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 33/68] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:40:05.764753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead1783-0b55-4418-933c-792fb37ab2aa None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:05.853478 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd894df-168a-406e-b2c1-8ca12173a8e1 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:05.861137 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:05.884578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead1783-0b55-4418-933c-792fb37ab2aa None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:05.888320 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d1655-0644-450c-acaa-268aa5876d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:05.889612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d1655-0644-450c-acaa-268aa5876d03 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:05.889889 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d1655-0644-450c-acaa-268aa5876d03 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:05.890187 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d1655-0644-450c-acaa-268aa5876d03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:05.901477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d1655-0644-450c-acaa-268aa5876d03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:05.908224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-bf5d1655-0644-450c-acaa-268aa5876d03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:05.908224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:05.908224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:05.908224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:05.908224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:05.908224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:05.908224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:05.908224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:05.908224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:05.908224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:05.908224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:05.908224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:05.908224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:05.908224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:05.908224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:05.908224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:05.909233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:05.909233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:05.909233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:05.909233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:05.909233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:05.909233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:05.909233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:05.909233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:05.909233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:05.909233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:05.909233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:05.909233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:05.909233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:05.909233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:05.909233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:05.909233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:05.910043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:05.910043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:05.910043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:05.910043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:05.910043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:05.910043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:05.910043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:05.910043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:05.910043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:05.910043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:05.910043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:05.910043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:05.910043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 36/69] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Aug 11 09:40:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:05.910805 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d1655-0644-450c-acaa-268aa5876d03 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:05.924549 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c731b-e673-4aed-b35e-75572dac88ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:05.925157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c731b-e673-4aed-b35e-75572dac88ac None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:05.925434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c731b-e673-4aed-b35e-75572dac88ac None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:05.925714 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c731b-e673-4aed-b35e-75572dac88ac None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:05.926415 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c731b-e673-4aed-b35e-75572dac88ac None admin] RBAC: Adding query filter params (name=member) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:05.926718 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c731b-e673-4aed-b35e-75572dac88ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:05.928115 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c731b-e673-4aed-b35e-75572dac88ac None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:05.928673 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:05.941704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 34/70] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:05.941704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace987cc-b7e2-4a18-b91e-edd1e18420cb None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:05.941704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace987cc-b7e2-4a18-b91e-edd1e18420cb None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:05.941704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace987cc-b7e2-4a18-b91e-edd1e18420cb None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:05.941704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 35/71] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:05.941704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace987cc-b7e2-4a18-b91e-edd1e18420cb None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:06.022466 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d1655-0644-450c-acaa-268aa5876d03 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:06.049219 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace987cc-b7e2-4a18-b91e-edd1e18420cb None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:06.057490 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822ea23-a6fa-4b20-8686-1866a15bb519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:06.058153 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822ea23-a6fa-4b20-8686-1866a15bb519 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:06.058436 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822ea23-a6fa-4b20-8686-1866a15bb519 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:06.058706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822ea23-a6fa-4b20-8686-1866a15bb519 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:06.069705 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822ea23-a6fa-4b20-8686-1866a15bb519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:06.074870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-8822ea23-a6fa-4b20-8686-1866a15bb519 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:40:06.074870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:06.074870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:06.074870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:06.074870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:06.074870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:06.074870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:06.074870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:06.074870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:06.074870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:06.074870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:06.074870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:06.074870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:06.074870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:06.074870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:06.074870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:06.075707 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:06.075707 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:06.075707 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:06.075707 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:06.075707 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:06.075707 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:06.075707 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:06.075707 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:06.075707 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:06.075707 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:06.075707 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:06.075707 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:06.075707 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:06.075707 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:06.075707 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:06.075707 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:06.077062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:06.077062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:06.077062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:06.077062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:06.077062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:06.077062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:06.077062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:06.077062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:06.077062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:06.077062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:06.077062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:40:06.077062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:06.077062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 37/72] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:40:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:06.078547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822ea23-a6fa-4b20-8686-1866a15bb519 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:06.092321 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716e1bf-a213-4bbb-aabf-065cb98a8a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:06.092938 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716e1bf-a213-4bbb-aabf-065cb98a8a12 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:06.093220 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716e1bf-a213-4bbb-aabf-065cb98a8a12 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:06.093494 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716e1bf-a213-4bbb-aabf-065cb98a8a12 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:06.094183 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716e1bf-a213-4bbb-aabf-065cb98a8a12 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:06.094491 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716e1bf-a213-4bbb-aabf-065cb98a8a12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:06.095940 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716e1bf-a213-4bbb-aabf-065cb98a8a12 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:06.101012 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:06.109178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 36/73] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:40:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:06.109178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22f018-9e90-4b86-8c73-44b62ffd40bd None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:06.109178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22f018-9e90-4b86-8c73-44b62ffd40bd None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:06.109178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22f018-9e90-4b86-8c73-44b62ffd40bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:06.124925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-1c22f018-9e90-4b86-8c73-44b62ffd40bd None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:06.126155 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-1c22f018-9e90-4b86-8c73-44b62ffd40bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:06.161204 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:06.192240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822ea23-a6fa-4b20-8686-1866a15bb519 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:06.197723 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 37/74] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:06.198493 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22f018-9e90-4b86-8c73-44b62ffd40bd None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:06.238330 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e9ca6-8ffc-48cb-a51a-8eab3e2664ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:06.238971 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e9ca6-8ffc-48cb-a51a-8eab3e2664ff None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:06.239249 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e9ca6-8ffc-48cb-a51a-8eab3e2664ff None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:06.239521 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e9ca6-8ffc-48cb-a51a-8eab3e2664ff None admin] PATH_INFO: `/v3/users/df154087f69f4bfab45c05e2ee8526a3` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:06.253756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e9ca6-8ffc-48cb-a51a-8eab3e2664ff None admin] RBAC: Authorizing `identity:get_user(user_id=df154087f69f4bfab45c05e2ee8526a3)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:06.255263 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e9ca6-8ffc-48cb-a51a-8eab3e2664ff None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:06.256882 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 38/75] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:06 2022] GET /identity/v3/users/df154087f69f4bfab45c05e2ee8526a3 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:06.257640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e9ca6-8ffc-48cb-a51a-8eab3e2664ff None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:06.302733 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22f018-9e90-4b86-8c73-44b62ffd40bd None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:06.333218 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:06.338820 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e0751-9b22-437c-a4ec-0ff3d179d260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:06.339418 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e0751-9b22-437c-a4ec-0ff3d179d260 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:06.343040 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e0751-9b22-437c-a4ec-0ff3d179d260 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:06.343040 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e0751-9b22-437c-a4ec-0ff3d179d260 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:06.343040 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e0751-9b22-437c-a4ec-0ff3d179d260 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:06.343040 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e0751-9b22-437c-a4ec-0ff3d179d260 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:06.343040 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e0751-9b22-437c-a4ec-0ff3d179d260 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:06.350202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 38/76] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:06.350871 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e0751-9b22-437c-a4ec-0ff3d179d260 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:06.356121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e9ca6-8ffc-48cb-a51a-8eab3e2664ff None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:06.384174 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:06.390395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd87a7-6d59-4c67-8689-7fbecf6eaec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:06.391030 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd87a7-6d59-4c67-8689-7fbecf6eaec6 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:06.394006 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd87a7-6d59-4c67-8689-7fbecf6eaec6 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:06.394006 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd87a7-6d59-4c67-8689-7fbecf6eaec6 None admin] PATH_INFO: `/v3/users/df154087f69f4bfab45c05e2ee8526a3` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:06.394006 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd87a7-6d59-4c67-8689-7fbecf6eaec6 None admin] RBAC: Authorizing `identity:get_user(user_id=df154087f69f4bfab45c05e2ee8526a3)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:06.394420 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd87a7-6d59-4c67-8689-7fbecf6eaec6 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:06.395761 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 39/77] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:06 2022] GET /identity/v3/users/df154087f69f4bfab45c05e2ee8526a3 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:06.396936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86028ae3-baf0-4002-89e4-0ecbd54e8365 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:06.397225 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86028ae3-baf0-4002-89e4-0ecbd54e8365 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:06.397498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86028ae3-baf0-4002-89e4-0ecbd54e8365 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:06.398878 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 40/78] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:06.399469 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86028ae3-baf0-4002-89e4-0ecbd54e8365 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:06.461865 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e0751-9b22-437c-a4ec-0ff3d179d260 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:06.494551 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c008a-68f5-4c82-ac81-5db33c2477ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:06.495182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c008a-68f5-4c82-ac81-5db33c2477ef None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:06.495467 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c008a-68f5-4c82-ac81-5db33c2477ef None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:06.495735 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c008a-68f5-4c82-ac81-5db33c2477ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:06.503892 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86028ae3-baf0-4002-89e4-0ecbd54e8365 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:06.506304 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c008a-68f5-4c82-ac81-5db33c2477ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:06.511269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-254c008a-68f5-4c82-ac81-5db33c2477ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:06.511269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:06.511269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:06.511269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:06.511269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:06.511269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:06.511269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:06.511269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:06.511269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:06.511269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:06.511269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:06.511269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:06.511269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:06.511269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:06.511269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:06.511269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:06.512196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:06.512196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:06.512196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:06.512196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:06.512196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:06.512196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:06.512196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:06.512196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:06.512196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:06.512196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:06.512196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:06.512196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:06.512196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:06.512196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:06.512196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:06.512196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:06.512942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:06.512942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:06.512942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:06.512942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:06.512942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:06.512942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:06.512942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:06.512942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:06.512942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:06.512942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:06.512942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:06.512942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:40:06.512942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 39/79] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:06.513589 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c008a-68f5-4c82-ac81-5db33c2477ef None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:06.540772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278a5c9-acd3-4b27-8744-5c458084b38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:06.541376 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278a5c9-acd3-4b27-8744-5c458084b38b None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:06.541657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278a5c9-acd3-4b27-8744-5c458084b38b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:06.541926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278a5c9-acd3-4b27-8744-5c458084b38b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:06.565839 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:06.605296 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:06.609456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278a5c9-acd3-4b27-8744-5c458084b38b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:06.610969 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278a5c9-acd3-4b27-8744-5c458084b38b None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:06.611817 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c008a-68f5-4c82-ac81-5db33c2477ef None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:06.644446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de6c15-c205-4685-8a65-4bfe9961ce0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:06.645075 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de6c15-c205-4685-8a65-4bfe9961ce0f None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:06.645351 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de6c15-c205-4685-8a65-4bfe9961ce0f None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:06.645627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de6c15-c205-4685-8a65-4bfe9961ce0f None admin] PATH_INFO: `/v3/users/07db6516e8ce4759bb6e5167b3fb5367` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:06.646734 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de6c15-c205-4685-8a65-4bfe9961ce0f None admin] RBAC: Authorizing `identity:get_user(user_id=07db6516e8ce4759bb6e5167b3fb5367)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:06.648165 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de6c15-c205-4685-8a65-4bfe9961ce0f None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:06.649724 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 40/80] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:06 2022] GET /identity/v3/users/07db6516e8ce4759bb6e5167b3fb5367 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:06.650503 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de6c15-c205-4685-8a65-4bfe9961ce0f None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:06.714975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 41/81] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:40:06.716211 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb2b65-6d34-4994-8e07-90492c8c02f6 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:06.716490 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb2b65-6d34-4994-8e07-90492c8c02f6 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:06.716769 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb2b65-6d34-4994-8e07-90492c8c02f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:06.733981 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-ddcb2b65-6d34-4994-8e07-90492c8c02f6 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:06.735195 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-ddcb2b65-6d34-4994-8e07-90492c8c02f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:06.754971 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de6c15-c205-4685-8a65-4bfe9961ce0f None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:06.774531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:06.788691 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c3fcc-aaaf-4f22-a831-e97a400f5d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:06.789447 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c3fcc-aaaf-4f22-a831-e97a400f5d97 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:06.789833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c3fcc-aaaf-4f22-a831-e97a400f5d97 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:06.790322 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c3fcc-aaaf-4f22-a831-e97a400f5d97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:06.801091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 42/82] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:06.801953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb2b65-6d34-4994-8e07-90492c8c02f6 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:06.834613 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:06.865767 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c3fcc-aaaf-4f22-a831-e97a400f5d97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:06.867281 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c3fcc-aaaf-4f22-a831-e97a400f5d97 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:06.905797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb2b65-6d34-4994-8e07-90492c8c02f6 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:06.939392 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d758f-6c54-43e2-a9de-93fb2b3d4ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:06.939994 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d758f-6c54-43e2-a9de-93fb2b3d4ba9 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:06.940268 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d758f-6c54-43e2-a9de-93fb2b3d4ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:06.940534 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d758f-6c54-43e2-a9de-93fb2b3d4ba9 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:06.941173 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d758f-6c54-43e2-a9de-93fb2b3d4ba9 None admin] RBAC: Adding query filter params (name=member) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:06.941473 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d758f-6c54-43e2-a9de-93fb2b3d4ba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:06.942857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d758f-6c54-43e2-a9de-93fb2b3d4ba9 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:06.954001 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 43/83] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:06.954812 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d758f-6c54-43e2-a9de-93fb2b3d4ba9 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:06.969035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 41/84] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:40:06.970172 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c3fcc-aaaf-4f22-a831-e97a400f5d97 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:06.991514 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:07.045901 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:07.055245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d758f-6c54-43e2-a9de-93fb2b3d4ba9 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:07.067387 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c3fcc-aaaf-4f22-a831-e97a400f5d97 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:07.088571 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04577cb-37be-4529-a15f-42d8da4b8e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:07.089162 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04577cb-37be-4529-a15f-42d8da4b8e0e None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:07.089438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04577cb-37be-4529-a15f-42d8da4b8e0e None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:07.089701 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04577cb-37be-4529-a15f-42d8da4b8e0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:07.101754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3dde48-3250-439f-a599-8e70a9886caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:07.102409 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dde48-3250-439f-a599-8e70a9886caf None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:07.102690 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dde48-3250-439f-a599-8e70a9886caf None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:07.102963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dde48-3250-439f-a599-8e70a9886caf None admin] PATH_INFO: `/v3/projects/efa1046add794b2eb629463dd092363b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:07.104084 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3dde48-3250-439f-a599-8e70a9886caf None admin] RBAC: Authorizing `identity:get_project(project_id=efa1046add794b2eb629463dd092363b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:07.105521 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3dde48-3250-439f-a599-8e70a9886caf None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:07.107176 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 42/85] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:06 2022] GET /identity/v3/projects/efa1046add794b2eb629463dd092363b => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:07.108531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3dde48-3250-439f-a599-8e70a9886caf None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:07.155613 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04577cb-37be-4529-a15f-42d8da4b8e0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:07.157101 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04577cb-37be-4529-a15f-42d8da4b8e0e None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:07.197397 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:07.209465 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3dde48-3250-439f-a599-8e70a9886caf None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:07.242488 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054c753-c12a-43d4-bda4-28e91d80b6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:07.243045 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054c753-c12a-43d4-bda4-28e91d80b6b6 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:07.243322 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054c753-c12a-43d4-bda4-28e91d80b6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:07.243594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054c753-c12a-43d4-bda4-28e91d80b6b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:07.244111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:07.244694 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054c753-c12a-43d4-bda4-28e91d80b6b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:07.246162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054c753-c12a-43d4-bda4-28e91d80b6b6 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:07.247694 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 43/86] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:40:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:07.248495 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054c753-c12a-43d4-bda4-28e91d80b6b6 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:07.259441 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 44/87] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:40:07.259441 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04577cb-37be-4529-a15f-42d8da4b8e0e None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:07.345891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054c753-c12a-43d4-bda4-28e91d80b6b6 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:07.353085 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04577cb-37be-4529-a15f-42d8da4b8e0e None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:07.378244 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41572990-17d9-4603-ba47-6b367cf457be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:07.378869 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41572990-17d9-4603-ba47-6b367cf457be None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:07.379151 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41572990-17d9-4603-ba47-6b367cf457be None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:07.379425 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41572990-17d9-4603-ba47-6b367cf457be None admin] PATH_INFO: `/v3/users/df154087f69f4bfab45c05e2ee8526a3` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:07.380539 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41572990-17d9-4603-ba47-6b367cf457be None admin] RBAC: Authorizing `identity:get_user(user_id=df154087f69f4bfab45c05e2ee8526a3)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:07.381980 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41572990-17d9-4603-ba47-6b367cf457be None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:07.383556 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 44/88] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:07 2022] GET /identity/v3/users/df154087f69f4bfab45c05e2ee8526a3 => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:07.385639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fba11f-a163-40c4-b4e2-ccec28135cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:07.386284 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fba11f-a163-40c4-b4e2-ccec28135cfd None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:07.386557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fba11f-a163-40c4-b4e2-ccec28135cfd None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:07.386827 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fba11f-a163-40c4-b4e2-ccec28135cfd None admin] PATH_INFO: `/v3/projects/efa1046add794b2eb629463dd092363b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:07.387930 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fba11f-a163-40c4-b4e2-ccec28135cfd None admin] RBAC: Authorizing `identity:get_project(project_id=efa1046add794b2eb629463dd092363b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:07.389257 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41572990-17d9-4603-ba47-6b367cf457be None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:07.389905 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fba11f-a163-40c4-b4e2-ccec28135cfd None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:07.396145 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 45/89] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:07 2022] GET /identity/v3/projects/efa1046add794b2eb629463dd092363b => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:07.396145 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fba11f-a163-40c4-b4e2-ccec28135cfd None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:07.416034 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:07.450305 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:07.487940 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41572990-17d9-4603-ba47-6b367cf457be None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:07.490046 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fba11f-a163-40c4-b4e2-ccec28135cfd None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:07.521660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95291ff0-7f3b-4555-bf55-cc5e50c61fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:07.522288 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95291ff0-7f3b-4555-bf55-cc5e50c61fb8 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:07.522569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95291ff0-7f3b-4555-bf55-cc5e50c61fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:07.522841 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95291ff0-7f3b-4555-bf55-cc5e50c61fb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:07.523129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5c40e-3b03-4390-b9b7-8f6fa3176ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:07.523550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95291ff0-7f3b-4555-bf55-cc5e50c61fb8 None admin] RBAC: Adding query filter params (role.id=9b9c9f22f65c459bacd757d5de4d5b8e, scope.project.id=efa1046add794b2eb629463dd092363b, user.id=df154087f69f4bfab45c05e2ee8526a3) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:07.523732 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5c40e-3b03-4390-b9b7-8f6fa3176ea4 None admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:07.523861 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95291ff0-7f3b-4555-bf55-cc5e50c61fb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:07.524013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5c40e-3b03-4390-b9b7-8f6fa3176ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:07.524286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5c40e-3b03-4390-b9b7-8f6fa3176ea4 None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:07.524923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5c40e-3b03-4390-b9b7-8f6fa3176ea4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:07.525294 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95291ff0-7f3b-4555-bf55-cc5e50c61fb8 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:07.526381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5c40e-3b03-4390-b9b7-8f6fa3176ea4 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:07.531117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 45/90] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:40:07 2022] GET /identity/v3/role_assignments?user.id=df154087f69f4bfab45c05e2ee8526a3&scope.project.id=efa1046add794b2eb629463dd092363b&role.id=9b9c9f22f65c459bacd757d5de4d5b8e => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:07.531883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95291ff0-7f3b-4555-bf55-cc5e50c61fb8 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:07.612426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 46/91] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Aug 11 09:40:07 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:40:07.613611 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5c40e-3b03-4390-b9b7-8f6fa3176ea4 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:07.633751 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:07.653090 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95291ff0-7f3b-4555-bf55-cc5e50c61fb8 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:07.710063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05fea7-4935-4bf1-b938-0777fb764dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:07.710833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05fea7-4935-4bf1-b938-0777fb764dbf None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:07.711116 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05fea7-4935-4bf1-b938-0777fb764dbf None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:07.711392 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05fea7-4935-4bf1-b938-0777fb764dbf None admin] PATH_INFO: `/v3/projects/efa1046add794b2eb629463dd092363b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:07.712666 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05fea7-4935-4bf1-b938-0777fb764dbf None admin] RBAC: Authorizing `identity:get_project(project_id=efa1046add794b2eb629463dd092363b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:07.714670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05fea7-4935-4bf1-b938-0777fb764dbf None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:07.716164 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 46/92] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:07 2022] GET /identity/v3/projects/efa1046add794b2eb629463dd092363b => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:07.721970 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05fea7-4935-4bf1-b938-0777fb764dbf None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:07.769248 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5c40e-3b03-4390-b9b7-8f6fa3176ea4 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:07.788748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:07.811195 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cced7b-8c6e-4e0e-a044-cf1045655b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:07.812173 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cced7b-8c6e-4e0e-a044-cf1045655b0b None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:07.812582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cced7b-8c6e-4e0e-a044-cf1045655b0b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:07.812991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cced7b-8c6e-4e0e-a044-cf1045655b0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:07.838791 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05fea7-4935-4bf1-b938-0777fb764dbf None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:07.883097 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38504153-fac8-4625-b6ed-b7bf5e47187c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:07.883738 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38504153-fac8-4625-b6ed-b7bf5e47187c None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:07.884020 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38504153-fac8-4625-b6ed-b7bf5e47187c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:07.884295 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38504153-fac8-4625-b6ed-b7bf5e47187c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:07.885024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38504153-fac8-4625-b6ed-b7bf5e47187c None admin] RBAC: Adding query filter params (role.id=da3ceb6dfa1746f19dbaf26e2c3ef7ab, scope.project.id=efa1046add794b2eb629463dd092363b, user.id=df154087f69f4bfab45c05e2ee8526a3) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:07.885341 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38504153-fac8-4625-b6ed-b7bf5e47187c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:07.886826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38504153-fac8-4625-b6ed-b7bf5e47187c None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:07.893187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 47/93] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:40:07 2022] GET /identity/v3/role_assignments?user.id=df154087f69f4bfab45c05e2ee8526a3&scope.project.id=efa1046add794b2eb629463dd092363b&role.id=da3ceb6dfa1746f19dbaf26e2c3ef7ab => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:07.894133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38504153-fac8-4625-b6ed-b7bf5e47187c None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:07.899199 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cced7b-8c6e-4e0e-a044-cf1045655b0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:07.901017 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cced7b-8c6e-4e0e-a044-cf1045655b0b None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:07.923838 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:08.043397 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38504153-fac8-4625-b6ed-b7bf5e47187c None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:08.063198 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 47/94] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:40:08.066367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cced7b-8c6e-4e0e-a044-cf1045655b0b None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:08.084999 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:08.097857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01fcf4-d2bb-46f8-8bd7-8aaf9fc990b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:08.100620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01fcf4-d2bb-46f8-8bd7-8aaf9fc990b9 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:08.100620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01fcf4-d2bb-46f8-8bd7-8aaf9fc990b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:08.100620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01fcf4-d2bb-46f8-8bd7-8aaf9fc990b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:08.100620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01fcf4-d2bb-46f8-8bd7-8aaf9fc990b9 None admin] RBAC: Adding query filter params (role.id=6aae1c66f3f04cec80ed72c20d7e033b, scope.project.id=efa1046add794b2eb629463dd092363b, user.id=07db6516e8ce4759bb6e5167b3fb5367) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:08.100620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01fcf4-d2bb-46f8-8bd7-8aaf9fc990b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:08.101720 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01fcf4-d2bb-46f8-8bd7-8aaf9fc990b9 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:08.110834 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 48/95] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:40:07 2022] GET /identity/v3/role_assignments?user.id=07db6516e8ce4759bb6e5167b3fb5367&scope.project.id=efa1046add794b2eb629463dd092363b&role.id=6aae1c66f3f04cec80ed72c20d7e033b => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:08.186570 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cced7b-8c6e-4e0e-a044-cf1045655b0b None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:08.224412 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130773a-461e-4feb-8dd1-05a1c4f1beff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:08.225111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130773a-461e-4feb-8dd1-05a1c4f1beff None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:08.225389 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130773a-461e-4feb-8dd1-05a1c4f1beff None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:08.225660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130773a-461e-4feb-8dd1-05a1c4f1beff None admin] PATH_INFO: `/v3/projects/2961a9b68da5434bb181754edb1daae4` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:08.226860 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130773a-461e-4feb-8dd1-05a1c4f1beff None admin] RBAC: Authorizing `identity:get_project(project_id=2961a9b68da5434bb181754edb1daae4)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:08.228449 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130773a-461e-4feb-8dd1-05a1c4f1beff None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:08.230110 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 48/96] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:08 2022] GET /identity/v3/projects/2961a9b68da5434bb181754edb1daae4 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:08.236171 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01fcf4-d2bb-46f8-8bd7-8aaf9fc990b9 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:08.330535 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:08.347277 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01fcf4-d2bb-46f8-8bd7-8aaf9fc990b9 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:08.383588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c45312-b4f9-46dc-b905-7bbec7daa5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:08.384204 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c45312-b4f9-46dc-b905-7bbec7daa5aa None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:08.384482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c45312-b4f9-46dc-b905-7bbec7daa5aa None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:08.384751 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c45312-b4f9-46dc-b905-7bbec7daa5aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:08.385476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c45312-b4f9-46dc-b905-7bbec7daa5aa None admin] RBAC: Adding query filter params (role.id=9b9c9f22f65c459bacd757d5de4d5b8e, scope.project.id=2961a9b68da5434bb181754edb1daae4, user.id=df154087f69f4bfab45c05e2ee8526a3) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:08.385848 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c45312-b4f9-46dc-b905-7bbec7daa5aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:08.387323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c45312-b4f9-46dc-b905-7bbec7daa5aa None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:08.394317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 49/97] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:40:08 2022] GET /identity/v3/role_assignments?user.id=df154087f69f4bfab45c05e2ee8526a3&scope.project.id=2961a9b68da5434bb181754edb1daae4&role.id=9b9c9f22f65c459bacd757d5de4d5b8e => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:10.052175 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b70cd0-d8fe-46ed-8842-abba05cbf3c8 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:10.053191 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b70cd0-d8fe-46ed-8842-abba05cbf3c8 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:10.053681 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b70cd0-d8fe-46ed-8842-abba05cbf3c8 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:10.055708 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 49/98] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:10.061876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea88ed-891a-4c2a-b3a1-4f38788339e2 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:10.062816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea88ed-891a-4c2a-b3a1-4f38788339e2 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:10.063286 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea88ed-891a-4c2a-b3a1-4f38788339e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:10.091097 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-6dea88ed-891a-4c2a-b3a1-4f38788339e2 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:10.092657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-6dea88ed-891a-4c2a-b3a1-4f38788339e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:10.167743 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 50/99] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:10.198882 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b70cd0-d8fe-46ed-8842-abba05cbf3c8 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:10.301459 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:10.324563 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b70cd0-d8fe-46ed-8842-abba05cbf3c8 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:10.376922 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a6fe1-f195-4962-9ace-191886313e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:10.377928 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a6fe1-f195-4962-9ace-191886313e5c None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:10.378423 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a6fe1-f195-4962-9ace-191886313e5c None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:10.378887 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a6fe1-f195-4962-9ace-191886313e5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:10.393839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a6fe1-f195-4962-9ace-191886313e5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:10.399838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-ae1a6fe1-f195-4962-9ace-191886313e5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:10.399838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:10.399838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:10.399838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:10.399838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:10.399838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:10.399838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:10.399838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:10.399838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:10.399838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:10.399838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:10.399838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:10.399838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:10.399838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:10.399838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:10.399838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:10.400721 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:10.400721 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:10.400721 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:10.400721 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:10.400721 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:10.400721 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:10.400721 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:10.400721 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:10.400721 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:10.400721 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:10.400721 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:10.400721 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:10.400721 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:10.400721 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:10.400721 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:10.400721 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:10.401468 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:10.401468 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:10.401468 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:10.401468 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:10.401468 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:10.401468 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:10.401468 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:10.401468 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:10.401468 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:10.401468 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:10.401468 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:10.401468 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:10.404089 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 50/100] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:10.411409 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea88ed-891a-4c2a-b3a1-4f38788339e2 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:10.503021 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:10.519849 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea88ed-891a-4c2a-b3a1-4f38788339e2 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:10.555486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355f19f-7b84-4d9b-a58a-6189d83634c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:10.556465 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355f19f-7b84-4d9b-a58a-6189d83634c6 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:10.556941 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355f19f-7b84-4d9b-a58a-6189d83634c6 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:10.557680 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355f19f-7b84-4d9b-a58a-6189d83634c6 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:10.558570 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355f19f-7b84-4d9b-a58a-6189d83634c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:10.559067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355f19f-7b84-4d9b-a58a-6189d83634c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:10.561165 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355f19f-7b84-4d9b-a58a-6189d83634c6 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:10.569725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 51/101] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:10.575950 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a6fe1-f195-4962-9ace-191886313e5c None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:10.705483 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a6fe1-f195-4962-9ace-191886313e5c None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:10.714948 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc6b70-4598-4d7d-b6c1-d2c3cf48aee1 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:10.715515 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc6b70-4598-4d7d-b6c1-d2c3cf48aee1 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:10.715979 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc6b70-4598-4d7d-b6c1-d2c3cf48aee1 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:10.717789 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 52/102] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:10.722929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edff4f-3219-45b7-b73e-b7e8b69d5daf None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:10.723397 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edff4f-3219-45b7-b73e-b7e8b69d5daf None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:10.723862 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edff4f-3219-45b7-b73e-b7e8b69d5daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:10.783137 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-05edff4f-3219-45b7-b73e-b7e8b69d5daf None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:10.784353 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-05edff4f-3219-45b7-b73e-b7e8b69d5daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:10.827692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf93bf1-e455-4f47-b0f0-9f0ff572ac9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:10.828557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf93bf1-e455-4f47-b0f0-9f0ff572ac9d None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:10.828983 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf93bf1-e455-4f47-b0f0-9f0ff572ac9d None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:10.829400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf93bf1-e455-4f47-b0f0-9f0ff572ac9d None admin] PATH_INFO: `/v3/users/df154087f69f4bfab45c05e2ee8526a3` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:10.833432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf93bf1-e455-4f47-b0f0-9f0ff572ac9d None admin] RBAC: Authorizing `identity:get_user(user_id=df154087f69f4bfab45c05e2ee8526a3)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:10.835222 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf93bf1-e455-4f47-b0f0-9f0ff572ac9d None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:10.838116 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 51/103] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:10 2022] GET /identity/v3/users/df154087f69f4bfab45c05e2ee8526a3 => generated 275 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:10.843646 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf93bf1-e455-4f47-b0f0-9f0ff572ac9d None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:10.861591 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:10.940414 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 53/104] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 09:40:10.978236 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05edff4f-3219-45b7-b73e-b7e8b69d5daf None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:11.024927 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf93bf1-e455-4f47-b0f0-9f0ff572ac9d None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:11.093776 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4ff64-6132-4887-abdf-9e4455e37136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:11.094417 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4ff64-6132-4887-abdf-9e4455e37136 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:11.095435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4ff64-6132-4887-abdf-9e4455e37136 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:11.095435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4ff64-6132-4887-abdf-9e4455e37136 None admin] PATH_INFO: `/v3/projects/efa1046add794b2eb629463dd092363b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:11.097097 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4ff64-6132-4887-abdf-9e4455e37136 None admin] RBAC: Authorizing `identity:get_project(project_id=efa1046add794b2eb629463dd092363b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:11.097470 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4ff64-6132-4887-abdf-9e4455e37136 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:11.099685 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 52/105] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:10 2022] GET /identity/v3/projects/efa1046add794b2eb629463dd092363b => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:11.100302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e871142-569b-4fc8-a131-5b31460a4ce5 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:11.100582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e871142-569b-4fc8-a131-5b31460a4ce5 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:11.100862 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e871142-569b-4fc8-a131-5b31460a4ce5 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:11.102232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 53/106] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:11.114111 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:11.115698 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e871142-569b-4fc8-a131-5b31460a4ce5 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:11.168369 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05edff4f-3219-45b7-b73e-b7e8b69d5daf None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:11.225945 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7529559-bcd2-46e2-84a7-dbfa0633d18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:11.226713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7529559-bcd2-46e2-84a7-dbfa0633d18a None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:11.226997 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7529559-bcd2-46e2-84a7-dbfa0633d18a None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:11.227391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7529559-bcd2-46e2-84a7-dbfa0633d18a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:11.239177 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7529559-bcd2-46e2-84a7-dbfa0633d18a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:11.240314 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:11.245214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-b7529559-bcd2-46e2-84a7-dbfa0633d18a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:11.245214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:11.245214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:11.245214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:11.245214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:11.245214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:11.245214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:11.245214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:11.245214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:11.245214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:11.245214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:11.245214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:11.245214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:11.245214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:11.245214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:11.245214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:11.246112 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:11.246112 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:11.246112 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:11.246112 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:11.246112 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:11.246112 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:11.246112 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:11.246112 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:11.246112 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:11.246112 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:11.246112 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:11.246112 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:11.246112 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:11.246112 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:11.246112 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:11.246112 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:11.246886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:11.246886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:11.246886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:11.246886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:11.246886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:11.246886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:11.246886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:11.246886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:11.246886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:11.246886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:11.246886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:11.246886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:40:11.249651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 54/107] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Aug 11 09:40:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:40:11.251130 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbf44d-b41c-47e1-8b53-f4868140b4d0 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:11.251579 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbf44d-b41c-47e1-8b53-f4868140b4d0 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:11.253694 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbf44d-b41c-47e1-8b53-f4868140b4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:11.271295 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-f4bbf44d-b41c-47e1-8b53-f4868140b4d0 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:11.272769 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-f4bbf44d-b41c-47e1-8b53-f4868140b4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:11.286934 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e871142-569b-4fc8-a131-5b31460a4ce5 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:11.336103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60157e01-d38e-4626-b5d2-98442fe3cf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:11.337625 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60157e01-d38e-4626-b5d2-98442fe3cf48 None admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:11.339152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60157e01-d38e-4626-b5d2-98442fe3cf48 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:11.339667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60157e01-d38e-4626-b5d2-98442fe3cf48 None admin] PATH_INFO: `/v3/projects/efa1046add794b2eb629463dd092363b/users/df154087f69f4bfab45c05e2ee8526a3/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:11.345640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60157e01-d38e-4626-b5d2-98442fe3cf48 None admin] RBAC: Authorizing `identity:create_grant(project_id=efa1046add794b2eb629463dd092363b, user_id=df154087f69f4bfab45c05e2ee8526a3, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:11.349975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60157e01-d38e-4626-b5d2-98442fe3cf48 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:11.379073 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 55/108] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:11.386117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbf44d-b41c-47e1-8b53-f4868140b4d0 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:11.416194 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 54/109] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Aug 11 09:40:11 2022] PUT /identity/v3/projects/efa1046add794b2eb629463dd092363b/users/df154087f69f4bfab45c05e2ee8526a3/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:40:11.418515 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63724d18-0977-47ed-87b2-4b88edb3f4f5 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:11.419283 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63724d18-0977-47ed-87b2-4b88edb3f4f5 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:11.420357 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63724d18-0977-47ed-87b2-4b88edb3f4f5 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:11.422791 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 55/110] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:11.423814 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63724d18-0977-47ed-87b2-4b88edb3f4f5 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:11.466333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:11.512556 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbf44d-b41c-47e1-8b53-f4868140b4d0 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:11.552035 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63724d18-0977-47ed-87b2-4b88edb3f4f5 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:11.555799 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819732ca-35ee-449a-8167-b0394acd0959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:11.556491 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819732ca-35ee-449a-8167-b0394acd0959 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:11.556840 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819732ca-35ee-449a-8167-b0394acd0959 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:11.557442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819732ca-35ee-449a-8167-b0394acd0959 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:11.558221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819732ca-35ee-449a-8167-b0394acd0959 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:11.558595 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819732ca-35ee-449a-8167-b0394acd0959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:11.560076 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819732ca-35ee-449a-8167-b0394acd0959 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:11.569581 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 56/111] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:40:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:11.571206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f66440-c11a-4ebf-9c17-f7633fb9fe9f None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:11.571206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f66440-c11a-4ebf-9c17-f7633fb9fe9f None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:11.571374 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f66440-c11a-4ebf-9c17-f7633fb9fe9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:11.590389 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-f2f66440-c11a-4ebf-9c17-f7633fb9fe9f None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:11.592351 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-f2f66440-c11a-4ebf-9c17-f7633fb9fe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:11.595258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc49a3-e0e7-4047-b174-aefbd19d2785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:11.596274 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc49a3-e0e7-4047-b174-aefbd19d2785 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:11.596760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc49a3-e0e7-4047-b174-aefbd19d2785 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:11.597250 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc49a3-e0e7-4047-b174-aefbd19d2785 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:11.610557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:11.611752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc49a3-e0e7-4047-b174-aefbd19d2785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:11.617103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-aedc49a3-e0e7-4047-b174-aefbd19d2785 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:40:11.617103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:11.617103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:11.617103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:11.617103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:11.617103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:11.617103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:11.617103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:11.617103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:11.617103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:11.617103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:11.617103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:11.617103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:11.617103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:11.617103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:11.617103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:11.617975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:11.617975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:11.617975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:11.617975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:11.617975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:11.617975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:11.617975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:11.617975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:11.617975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:11.617975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:11.617975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:11.617975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:11.617975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:11.617975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:11.617975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:11.617975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:11.626532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:11.626532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:11.626532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:11.626532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:11.626532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:11.626532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:11.626532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:11.626532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:11.626532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:11.626532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:11.626532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:40:11.626532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:11.626532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 56/112] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:40:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:11.626532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f3c87-ea11-4bfc-a81f-6116b5405d3a None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:11.627225 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f3c87-ea11-4bfc-a81f-6116b5405d3a None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:11.627225 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f3c87-ea11-4bfc-a81f-6116b5405d3a None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:11.627225 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 57/113] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:11.627225 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f3c87-ea11-4bfc-a81f-6116b5405d3a None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:11.676884 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 57/114] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:11.677976 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3a44f-309f-4256-9eb7-815217006ce0 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:11.678331 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3a44f-309f-4256-9eb7-815217006ce0 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:11.678565 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3a44f-309f-4256-9eb7-815217006ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:11.696994 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-faf3a44f-309f-4256-9eb7-815217006ce0 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:11.698375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-faf3a44f-309f-4256-9eb7-815217006ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:11.743511 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f3c87-ea11-4bfc-a81f-6116b5405d3a None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:11.749454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:11.770065 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 58/115] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:11.771249 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3a44f-309f-4256-9eb7-815217006ce0 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:11.787091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8432ba5-3cd2-4285-a5bb-184c78e82841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:11.788650 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8432ba5-3cd2-4285-a5bb-184c78e82841 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:11.789355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8432ba5-3cd2-4285-a5bb-184c78e82841 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:11.789809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8432ba5-3cd2-4285-a5bb-184c78e82841 None admin] PATH_INFO: `/v3/users/df154087f69f4bfab45c05e2ee8526a3` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:11.791810 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8432ba5-3cd2-4285-a5bb-184c78e82841 None admin] RBAC: Authorizing `identity:get_user(user_id=df154087f69f4bfab45c05e2ee8526a3)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:11.793452 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8432ba5-3cd2-4285-a5bb-184c78e82841 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:11.795709 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 58/116] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:11 2022] GET /identity/v3/users/df154087f69f4bfab45c05e2ee8526a3 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:11.797172 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f374f5e-348d-4bd3-8896-229b0487c357 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:11.797464 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f374f5e-348d-4bd3-8896-229b0487c357 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:11.798070 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f374f5e-348d-4bd3-8896-229b0487c357 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:11.799980 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 59/117] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:11.801017 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f374f5e-348d-4bd3-8896-229b0487c357 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:11.879355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:11.883547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3a44f-309f-4256-9eb7-815217006ce0 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:11.916834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f374f5e-348d-4bd3-8896-229b0487c357 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:11.918414 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe25d3-19cb-42e6-8bd1-0437bd80879d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:11.919037 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe25d3-19cb-42e6-8bd1-0437bd80879d None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:11.919373 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe25d3-19cb-42e6-8bd1-0437bd80879d None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:11.919725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe25d3-19cb-42e6-8bd1-0437bd80879d None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:11.920420 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe25d3-19cb-42e6-8bd1-0437bd80879d None admin] RBAC: Adding query filter params (name=admin) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:11.920731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe25d3-19cb-42e6-8bd1-0437bd80879d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:11.922119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe25d3-19cb-42e6-8bd1-0437bd80879d None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:11.937252 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 59/118] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:11.937252 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe25d3-19cb-42e6-8bd1-0437bd80879d None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:11.959932 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee1476-bd19-43c1-8050-4fc0b7de20de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:11.960681 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee1476-bd19-43c1-8050-4fc0b7de20de None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:11.960962 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee1476-bd19-43c1-8050-4fc0b7de20de None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:11.961236 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee1476-bd19-43c1-8050-4fc0b7de20de None admin] PATH_INFO: `/v3/roles/member` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:11.972661 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee1476-bd19-43c1-8050-4fc0b7de20de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:11.977644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-f1ee1476-bd19-43c1-8050-4fc0b7de20de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:11.977644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:11.977644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:11.977644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:11.977644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:11.977644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:11.977644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:11.977644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:11.977644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:11.977644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:11.977644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:11.977644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:11.977644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:11.977644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:11.977644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:11.977644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:11.978547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:11.978547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:11.978547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:11.978547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:11.978547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:11.978547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:11.978547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:11.978547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:11.978547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:11.978547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:11.978547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:11.978547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:11.978547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:11.978547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:11.978547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:11.978547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:11.979295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:11.979295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:11.979295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:11.979295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:11.979295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:11.979295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:11.979295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:11.979295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:11.979295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:11.979295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:11.979295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:11.979295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:11.979295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 60/119] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:11.979931 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee1476-bd19-43c1-8050-4fc0b7de20de None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:11.986253 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:12.050380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe25d3-19cb-42e6-8bd1-0437bd80879d None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:12.084623 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5feb5f-ad65-4356-bc08-c2bf657dbab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:12.085576 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5feb5f-ad65-4356-bc08-c2bf657dbab7 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:12.086008 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5feb5f-ad65-4356-bc08-c2bf657dbab7 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:12.086326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5feb5f-ad65-4356-bc08-c2bf657dbab7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:12.094035 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee1476-bd19-43c1-8050-4fc0b7de20de None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:12.097217 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5feb5f-ad65-4356-bc08-c2bf657dbab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:12.102366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-bb5feb5f-ad65-4356-bc08-c2bf657dbab7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 09:40:12.102366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:12.102366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:12.102366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:12.102366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:12.102366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:12.102366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:12.102366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:12.102366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:12.102366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:12.102366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:12.102366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:12.102366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:12.102366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:12.102366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:12.102366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:12.103246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:12.103246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:12.103246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:12.103246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:12.103246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:12.103246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:12.103246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:12.103246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:12.103246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:12.103246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:12.103246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:12.103246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:12.103246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:12.103246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:12.103246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:12.103246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:12.104024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:12.104024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:12.104024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:12.104024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:12.104024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:12.104024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:12.104024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:12.104024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:12.104024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:12.104024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:12.104024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 09:40:12.104024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:40:12.104024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 60/120] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:12.105430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9da24-ef94-4def-9a12-d72799fef9c9 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:12.105430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9da24-ef94-4def-9a12-d72799fef9c9 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:12.105430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9da24-ef94-4def-9a12-d72799fef9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:12.123563 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-e5d9da24-ef94-4def-9a12-d72799fef9c9 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:12.124158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:12.124761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-e5d9da24-ef94-4def-9a12-d72799fef9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:12.132440 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cca8ed-81b1-4772-8a45-1bd2b9126cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:12.133005 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cca8ed-81b1-4772-8a45-1bd2b9126cd4 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:12.133284 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cca8ed-81b1-4772-8a45-1bd2b9126cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:12.133553 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cca8ed-81b1-4772-8a45-1bd2b9126cd4 None admin] PATH_INFO: `/v3/projects/efa1046add794b2eb629463dd092363b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:12.134694 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cca8ed-81b1-4772-8a45-1bd2b9126cd4 None admin] RBAC: Authorizing `identity:get_project(project_id=efa1046add794b2eb629463dd092363b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:12.136134 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cca8ed-81b1-4772-8a45-1bd2b9126cd4 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:12.137753 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 61/121] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:11 2022] GET /identity/v3/projects/efa1046add794b2eb629463dd092363b => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:12.139217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cca8ed-81b1-4772-8a45-1bd2b9126cd4 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:12.226426 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 61/122] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:12.227773 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9da24-ef94-4def-9a12-d72799fef9c9 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:12.249629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cca8ed-81b1-4772-8a45-1bd2b9126cd4 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:12.269080 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:12.286523 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b20a0b-f16f-418d-95c5-6e9f7f33f2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:12.287159 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b20a0b-f16f-418d-95c5-6e9f7f33f2b7 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:12.287449 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b20a0b-f16f-418d-95c5-6e9f7f33f2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:12.287749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b20a0b-f16f-418d-95c5-6e9f7f33f2b7 None admin] PATH_INFO: `/v3/users/07db6516e8ce4759bb6e5167b3fb5367` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:12.288963 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b20a0b-f16f-418d-95c5-6e9f7f33f2b7 None admin] RBAC: Authorizing `identity:get_user(user_id=07db6516e8ce4759bb6e5167b3fb5367)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:12.290506 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b20a0b-f16f-418d-95c5-6e9f7f33f2b7 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:12.296588 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 62/123] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:12 2022] GET /identity/v3/users/07db6516e8ce4759bb6e5167b3fb5367 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:12.296588 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b20a0b-f16f-418d-95c5-6e9f7f33f2b7 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:12.344559 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9da24-ef94-4def-9a12-d72799fef9c9 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:12.360158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:12.380484 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75421b0-9ae2-49ad-90ea-2836cdf080da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:12.381202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75421b0-9ae2-49ad-90ea-2836cdf080da None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:12.381479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75421b0-9ae2-49ad-90ea-2836cdf080da None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:12.381982 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75421b0-9ae2-49ad-90ea-2836cdf080da None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:12.382496 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75421b0-9ae2-49ad-90ea-2836cdf080da None admin] RBAC: Adding query filter params (name=member) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:12.382793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75421b0-9ae2-49ad-90ea-2836cdf080da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:12.384279 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75421b0-9ae2-49ad-90ea-2836cdf080da None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:12.398022 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 62/124] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:12.398022 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75421b0-9ae2-49ad-90ea-2836cdf080da None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:12.405485 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b20a0b-f16f-418d-95c5-6e9f7f33f2b7 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:12.442179 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07b717-c7fd-43d6-923e-a703ad926cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:12.442834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07b717-c7fd-43d6-923e-a703ad926cc2 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:12.443122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07b717-c7fd-43d6-923e-a703ad926cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:12.443389 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07b717-c7fd-43d6-923e-a703ad926cc2 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:12.444046 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07b717-c7fd-43d6-923e-a703ad926cc2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:12.444366 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07b717-c7fd-43d6-923e-a703ad926cc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:12.445749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07b717-c7fd-43d6-923e-a703ad926cc2 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:12.454337 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 63/125] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:12.454988 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07b717-c7fd-43d6-923e-a703ad926cc2 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:12.515786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:12.523787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75421b0-9ae2-49ad-90ea-2836cdf080da None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:12.559660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ff2f0-473f-4809-a83c-53484bcd3faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:12.560875 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ff2f0-473f-4809-a83c-53484bcd3faf None admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:12.561158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ff2f0-473f-4809-a83c-53484bcd3faf None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:12.561433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ff2f0-473f-4809-a83c-53484bcd3faf None admin] PATH_INFO: `/v3/projects/efa1046add794b2eb629463dd092363b/users/df154087f69f4bfab45c05e2ee8526a3/roles/da3ceb6dfa1746f19dbaf26e2c3ef7ab` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:12.563654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ff2f0-473f-4809-a83c-53484bcd3faf None admin] RBAC: Authorizing `identity:create_grant(project_id=efa1046add794b2eb629463dd092363b, user_id=df154087f69f4bfab45c05e2ee8526a3, role_id=da3ceb6dfa1746f19dbaf26e2c3ef7ab)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:12.565113 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ff2f0-473f-4809-a83c-53484bcd3faf None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:12.568224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07b717-c7fd-43d6-923e-a703ad926cc2 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:12.592154 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:12.603359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0ed29-d3d7-4e6d-8c81-7bd37b759714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:12.604009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0ed29-d3d7-4e6d-8c81-7bd37b759714 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:12.604308 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0ed29-d3d7-4e6d-8c81-7bd37b759714 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:12.604564 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0ed29-d3d7-4e6d-8c81-7bd37b759714 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:12.605729 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0ed29-d3d7-4e6d-8c81-7bd37b759714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:12.607814 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0ed29-d3d7-4e6d-8c81-7bd37b759714 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:12.609406 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 64/126] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:40:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:12.614678 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0ed29-d3d7-4e6d-8c81-7bd37b759714 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:12.670327 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 63/127] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Aug 11 09:40:12 2022] PUT /identity/v3/projects/efa1046add794b2eb629463dd092363b/users/df154087f69f4bfab45c05e2ee8526a3/roles/da3ceb6dfa1746f19dbaf26e2c3ef7ab => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:40:12.670327 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ff2f0-473f-4809-a83c-53484bcd3faf None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:12.752276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0ed29-d3d7-4e6d-8c81-7bd37b759714 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:12.781551 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ff2f0-473f-4809-a83c-53484bcd3faf None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:12.802593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604baa9-b48b-4290-a04d-c377b15881a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:12.803318 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604baa9-b48b-4290-a04d-c377b15881a1 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:12.803848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604baa9-b48b-4290-a04d-c377b15881a1 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:12.804122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604baa9-b48b-4290-a04d-c377b15881a1 None admin] PATH_INFO: `/v3/projects/efa1046add794b2eb629463dd092363b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:12.806021 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604baa9-b48b-4290-a04d-c377b15881a1 None admin] RBAC: Authorizing `identity:get_project(project_id=efa1046add794b2eb629463dd092363b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:12.807874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604baa9-b48b-4290-a04d-c377b15881a1 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:12.811096 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 65/128] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:12 2022] GET /identity/v3/projects/efa1046add794b2eb629463dd092363b => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:12.812049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604baa9-b48b-4290-a04d-c377b15881a1 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:12.835600 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48868f5e-3491-443c-b21d-585d8dd6cec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:12.836244 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48868f5e-3491-443c-b21d-585d8dd6cec5 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:12.836791 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48868f5e-3491-443c-b21d-585d8dd6cec5 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:12.837069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48868f5e-3491-443c-b21d-585d8dd6cec5 None admin] PATH_INFO: `/v3/users/df154087f69f4bfab45c05e2ee8526a3` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:12.838349 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48868f5e-3491-443c-b21d-585d8dd6cec5 None admin] RBAC: Authorizing `identity:get_user(user_id=df154087f69f4bfab45c05e2ee8526a3)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:12.840099 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48868f5e-3491-443c-b21d-585d8dd6cec5 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:12.842608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 64/129] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:12 2022] GET /identity/v3/users/df154087f69f4bfab45c05e2ee8526a3 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:12.843367 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48868f5e-3491-443c-b21d-585d8dd6cec5 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:12.879422 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:12.894189 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:12.949135 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604baa9-b48b-4290-a04d-c377b15881a1 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:12.977036 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48868f5e-3491-443c-b21d-585d8dd6cec5 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:12.985630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235506c8-19ee-441d-9f2e-a6963b07b963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:12.986417 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235506c8-19ee-441d-9f2e-a6963b07b963 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:12.986793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235506c8-19ee-441d-9f2e-a6963b07b963 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:12.987160 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235506c8-19ee-441d-9f2e-a6963b07b963 None admin] PATH_INFO: `/v3/users/04e3f170726347fd969cdebfb9efc783` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:13.001962 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235506c8-19ee-441d-9f2e-a6963b07b963 None admin] RBAC: Authorizing `identity:get_user(user_id=04e3f170726347fd969cdebfb9efc783)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:13.003726 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235506c8-19ee-441d-9f2e-a6963b07b963 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:13.005650 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 66/130] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:12 2022] GET /identity/v3/users/04e3f170726347fd969cdebfb9efc783 => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:13.010145 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235506c8-19ee-441d-9f2e-a6963b07b963 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:13.028431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b3946-14d1-4fce-95eb-d7dd90523d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:13.030189 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b3946-14d1-4fce-95eb-d7dd90523d63 None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:13.030664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b3946-14d1-4fce-95eb-d7dd90523d63 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:13.031518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b3946-14d1-4fce-95eb-d7dd90523d63 None admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:13.032326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b3946-14d1-4fce-95eb-d7dd90523d63 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:13.033954 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b3946-14d1-4fce-95eb-d7dd90523d63 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:13.116451 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235506c8-19ee-441d-9f2e-a6963b07b963 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:13.123882 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 65/131] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Aug 11 09:40:12 2022] POST /identity/v3/projects => generated 302 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:40:13.126050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b3946-14d1-4fce-95eb-d7dd90523d63 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:13.138144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:13.175204 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d46f58-44a5-45d8-bc8f-a445b84d5ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:13.175705 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d46f58-44a5-45d8-bc8f-a445b84d5ec8 None admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:13.175983 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d46f58-44a5-45d8-bc8f-a445b84d5ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:13.176262 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d46f58-44a5-45d8-bc8f-a445b84d5ec8 None admin] PATH_INFO: `/v3/projects/efa1046add794b2eb629463dd092363b/users/07db6516e8ce4759bb6e5167b3fb5367/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:13.180710 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d46f58-44a5-45d8-bc8f-a445b84d5ec8 None admin] RBAC: Authorizing `identity:create_grant(project_id=efa1046add794b2eb629463dd092363b, user_id=07db6516e8ce4759bb6e5167b3fb5367, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:13.182488 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d46f58-44a5-45d8-bc8f-a445b84d5ec8 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:13.230233 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:13.256735 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b3946-14d1-4fce-95eb-d7dd90523d63 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:13.274414 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 67/132] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Aug 11 09:40:13 2022] PUT /identity/v3/projects/efa1046add794b2eb629463dd092363b/users/07db6516e8ce4759bb6e5167b3fb5367/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:40:13.275067 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d46f58-44a5-45d8-bc8f-a445b84d5ec8 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:13.302588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e2f9b-4bbe-459b-aa3d-67b01bf177b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:13.303641 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e2f9b-4bbe-459b-aa3d-67b01bf177b5 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:13.304285 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e2f9b-4bbe-459b-aa3d-67b01bf177b5 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:13.304788 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e2f9b-4bbe-459b-aa3d-67b01bf177b5 None admin] PATH_INFO: `/v3/projects/2961a9b68da5434bb181754edb1daae4` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:13.306330 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e2f9b-4bbe-459b-aa3d-67b01bf177b5 None admin] RBAC: Authorizing `identity:get_project(project_id=2961a9b68da5434bb181754edb1daae4)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:13.314117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e2f9b-4bbe-459b-aa3d-67b01bf177b5 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:13.317099 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 66/133] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:13 2022] GET /identity/v3/projects/2961a9b68da5434bb181754edb1daae4 => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:13.323865 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e2f9b-4bbe-459b-aa3d-67b01bf177b5 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:13.456331 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d46f58-44a5-45d8-bc8f-a445b84d5ec8 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:13.491364 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e2f9b-4bbe-459b-aa3d-67b01bf177b5 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:13.498790 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8319b-eb8d-44d4-bf67-39efb78b35f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:13.499406 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8319b-eb8d-44d4-bf67-39efb78b35f0 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:13.499682 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8319b-eb8d-44d4-bf67-39efb78b35f0 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:13.499948 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8319b-eb8d-44d4-bf67-39efb78b35f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:13.554471 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c1963-5cf1-4295-b5f9-1781da7b64c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:13.555229 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c1963-5cf1-4295-b5f9-1781da7b64c9 None admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:13.555520 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c1963-5cf1-4295-b5f9-1781da7b64c9 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:13.555799 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c1963-5cf1-4295-b5f9-1781da7b64c9 None admin] PATH_INFO: `/v3/projects/2961a9b68da5434bb181754edb1daae4/users/df154087f69f4bfab45c05e2ee8526a3/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:13.557743 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:13.558634 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c1963-5cf1-4295-b5f9-1781da7b64c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2961a9b68da5434bb181754edb1daae4, user_id=df154087f69f4bfab45c05e2ee8526a3, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:13.561374 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c1963-5cf1-4295-b5f9-1781da7b64c9 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:13.589808 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8319b-eb8d-44d4-bf67-39efb78b35f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:13.591814 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8319b-eb8d-44d4-bf67-39efb78b35f0 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:13.647258 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 67/134] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Aug 11 09:40:13 2022] PUT /identity/v3/projects/2961a9b68da5434bb181754edb1daae4/users/df154087f69f4bfab45c05e2ee8526a3/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 09:40:13.649551 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d861d-e210-4309-95b4-ba0e32ea55ba None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:13.650048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d861d-e210-4309-95b4-ba0e32ea55ba None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:13.650751 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d861d-e210-4309-95b4-ba0e32ea55ba None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:13.653181 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 68/135] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:13.666838 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fced4-30aa-427b-8369-15e739615ec0 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:13.667205 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fced4-30aa-427b-8369-15e739615ec0 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:13.667557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fced4-30aa-427b-8369-15e739615ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:13.684247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:13.712925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-473fced4-30aa-427b-8369-15e739615ec0 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:13.715154 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-473fced4-30aa-427b-8369-15e739615ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:13.751693 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 68/136] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:40:13.759202 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8319b-eb8d-44d4-bf67-39efb78b35f0 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:13.866173 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 69/137] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:13.871280 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:13.895229 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8319b-eb8d-44d4-bf67-39efb78b35f0 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:13.905391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473fced4-30aa-427b-8369-15e739615ec0 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:13.934047 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f9fd3-8b8e-4079-beb6-f9bf988c3fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:13.935068 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f9fd3-8b8e-4079-beb6-f9bf988c3fd8 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:13.936104 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f9fd3-8b8e-4079-beb6-f9bf988c3fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:13.936572 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f9fd3-8b8e-4079-beb6-f9bf988c3fd8 None admin] PATH_INFO: `/v3/projects/efa1046add794b2eb629463dd092363b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:13.937982 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f9fd3-8b8e-4079-beb6-f9bf988c3fd8 None admin] RBAC: Authorizing `identity:get_project(project_id=efa1046add794b2eb629463dd092363b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:13.939698 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f9fd3-8b8e-4079-beb6-f9bf988c3fd8 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:13.941941 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 69/138] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:13 2022] GET /identity/v3/projects/efa1046add794b2eb629463dd092363b => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:13.947999 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f9fd3-8b8e-4079-beb6-f9bf988c3fd8 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:14.052725 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f9fd3-8b8e-4079-beb6-f9bf988c3fd8 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:14.080824 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473fced4-30aa-427b-8369-15e739615ec0 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:14.089298 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883751f-4d21-4e62-903c-9a667959fe9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:14.090210 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883751f-4d21-4e62-903c-9a667959fe9b None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:14.090689 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883751f-4d21-4e62-903c-9a667959fe9b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:14.091151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883751f-4d21-4e62-903c-9a667959fe9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:14.092174 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883751f-4d21-4e62-903c-9a667959fe9b None admin] RBAC: Adding query filter params (role.id=5ec51441676c42e7b6a3026a449dade7, scope.project.id=efa1046add794b2eb629463dd092363b, user.id=04e3f170726347fd969cdebfb9efc783) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:14.092694 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883751f-4d21-4e62-903c-9a667959fe9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:14.094363 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883751f-4d21-4e62-903c-9a667959fe9b None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:14.101873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 70/139] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:40:13 2022] GET /identity/v3/role_assignments?user.id=04e3f170726347fd969cdebfb9efc783&scope.project.id=efa1046add794b2eb629463dd092363b&role.id=5ec51441676c42e7b6a3026a449dade7 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:14.128516 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc71011-a494-4353-87bc-24954d61fe84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:14.129300 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc71011-a494-4353-87bc-24954d61fe84 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:14.129582 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc71011-a494-4353-87bc-24954d61fe84 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:14.129855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc71011-a494-4353-87bc-24954d61fe84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:14.132169 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:14.144058 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc71011-a494-4353-87bc-24954d61fe84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:14.155550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-3fc71011-a494-4353-87bc-24954d61fe84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:14.155550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:14.155550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:14.155550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:14.155550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:14.155550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:14.155550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:14.155550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:14.155550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:14.155550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:14.155550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:14.155550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:14.155550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:14.155550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:14.155550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:14.155550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:14.156683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:14.156683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:14.156683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:14.156683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:14.156683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:14.156683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:14.156683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:14.156683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:14.156683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:14.156683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:14.156683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:14.156683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:14.156683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:14.156683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:14.156683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:14.156683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:14.157459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:14.157459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:14.157459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:14.157459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:14.157459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:14.157459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:14.157459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:14.157459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:14.157459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:14.157459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:14.157459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:14.157459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:40:14.157459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 70/140] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:14.163495 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883751f-4d21-4e62-903c-9a667959fe9b None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:14.184066 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:14.286735 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883751f-4d21-4e62-903c-9a667959fe9b None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:14.329773 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6e15d-887b-4c6d-9160-03242e3f7c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:14.330738 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6e15d-887b-4c6d-9160-03242e3f7c20 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:14.331216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6e15d-887b-4c6d-9160-03242e3f7c20 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:14.331683 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6e15d-887b-4c6d-9160-03242e3f7c20 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:14.332566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6e15d-887b-4c6d-9160-03242e3f7c20 None admin] RBAC: Adding query filter params (name=member) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:14.333080 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6e15d-887b-4c6d-9160-03242e3f7c20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:14.334695 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6e15d-887b-4c6d-9160-03242e3f7c20 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:14.345144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 71/141] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:14.350560 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc71011-a494-4353-87bc-24954d61fe84 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:14.505845 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc71011-a494-4353-87bc-24954d61fe84 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:14.552688 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be1e02-a049-49d2-81c0-e4ea2ce93118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:14.553329 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be1e02-a049-49d2-81c0-e4ea2ce93118 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:14.553660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be1e02-a049-49d2-81c0-e4ea2ce93118 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:14.553935 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be1e02-a049-49d2-81c0-e4ea2ce93118 None admin] PATH_INFO: `/v3/users/df154087f69f4bfab45c05e2ee8526a3` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:14.555123 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be1e02-a049-49d2-81c0-e4ea2ce93118 None admin] RBAC: Authorizing `identity:get_user(user_id=df154087f69f4bfab45c05e2ee8526a3)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:14.556574 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be1e02-a049-49d2-81c0-e4ea2ce93118 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:14.558733 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 71/142] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:14 2022] GET /identity/v3/users/df154087f69f4bfab45c05e2ee8526a3 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:14.564304 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6e15d-887b-4c6d-9160-03242e3f7c20 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:14.664349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:14.695400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6e15d-887b-4c6d-9160-03242e3f7c20 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:14.742324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cabd2b-1ba8-4e40-a9db-54360262a52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:14.742948 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cabd2b-1ba8-4e40-a9db-54360262a52a None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:14.743230 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cabd2b-1ba8-4e40-a9db-54360262a52a None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:14.743507 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cabd2b-1ba8-4e40-a9db-54360262a52a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:14.838563 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cabd2b-1ba8-4e40-a9db-54360262a52a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:14.840042 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cabd2b-1ba8-4e40-a9db-54360262a52a None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:14.943389 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:14.983857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 72/143] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:40:14.988198 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be1e02-a049-49d2-81c0-e4ea2ce93118 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:15.055931 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:15.097151 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be1e02-a049-49d2-81c0-e4ea2ce93118 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:15.133839 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08f3ac-7f3c-4df7-a248-490965d997f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:15.134653 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08f3ac-7f3c-4df7-a248-490965d997f1 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:15.134815 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08f3ac-7f3c-4df7-a248-490965d997f1 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:15.135058 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08f3ac-7f3c-4df7-a248-490965d997f1 None admin] PATH_INFO: `/v3/projects/efa1046add794b2eb629463dd092363b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:15.136191 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08f3ac-7f3c-4df7-a248-490965d997f1 None admin] RBAC: Authorizing `identity:get_project(project_id=efa1046add794b2eb629463dd092363b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:15.137641 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08f3ac-7f3c-4df7-a248-490965d997f1 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:15.139911 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 72/144] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:14 2022] GET /identity/v3/projects/efa1046add794b2eb629463dd092363b => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:15.145839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cabd2b-1ba8-4e40-a9db-54360262a52a None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:15.277645 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cabd2b-1ba8-4e40-a9db-54360262a52a None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:15.314445 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32467de8-7c55-4458-9fb5-2bf20fe150d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:15.315055 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32467de8-7c55-4458-9fb5-2bf20fe150d5 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:15.315334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32467de8-7c55-4458-9fb5-2bf20fe150d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:15.315606 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32467de8-7c55-4458-9fb5-2bf20fe150d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:15.316325 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32467de8-7c55-4458-9fb5-2bf20fe150d5 None admin] RBAC: Adding query filter params (role.id=9b9c9f22f65c459bacd757d5de4d5b8e, scope.project.id=efa1046add794b2eb629463dd092363b, user.id=df154087f69f4bfab45c05e2ee8526a3) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:15.316638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32467de8-7c55-4458-9fb5-2bf20fe150d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:15.318199 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32467de8-7c55-4458-9fb5-2bf20fe150d5 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:15.324197 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 73/145] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:40:15 2022] GET /identity/v3/role_assignments?user.id=df154087f69f4bfab45c05e2ee8526a3&scope.project.id=efa1046add794b2eb629463dd092363b&role.id=9b9c9f22f65c459bacd757d5de4d5b8e => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:15.395236 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4425752-728c-4b51-80a0-a7205170adb9 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:15.395551 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4425752-728c-4b51-80a0-a7205170adb9 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:15.395783 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4425752-728c-4b51-80a0-a7205170adb9 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:15.397290 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 73/146] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:15.402448 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac4770-f59f-4261-a9a7-d69bf90dfc9a None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:15.402730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac4770-f59f-4261-a9a7-d69bf90dfc9a None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:15.403003 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac4770-f59f-4261-a9a7-d69bf90dfc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:15.425438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-22ac4770-f59f-4261-a9a7-d69bf90dfc9a None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:15.426684 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-22ac4770-f59f-4261-a9a7-d69bf90dfc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:15.462014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:15.509925 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 74/147] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:15.533768 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4425752-728c-4b51-80a0-a7205170adb9 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:15.671250 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4425752-728c-4b51-80a0-a7205170adb9 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:15.702814 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:15.709123 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b546cf0-7c17-42f5-9ce6-3810177826ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:15.709749 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b546cf0-7c17-42f5-9ce6-3810177826ed None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:15.710179 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b546cf0-7c17-42f5-9ce6-3810177826ed None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:15.710479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b546cf0-7c17-42f5-9ce6-3810177826ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:15.721806 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b546cf0-7c17-42f5-9ce6-3810177826ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:15.726670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-3b546cf0-7c17-42f5-9ce6-3810177826ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:15.726670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:15.726670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:15.726670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:15.726670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:15.726670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:15.726670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:15.726670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:15.726670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:15.726670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:15.726670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:15.726670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:15.726670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:15.726670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:15.726670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:15.726670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:15.727534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:15.727534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:15.727534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:15.727534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:15.727534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:15.727534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:15.727534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:15.727534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:15.727534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:15.727534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:15.727534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:15.727534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:15.727534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:15.727534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:15.727534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:15.727534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:15.728366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:15.728366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:15.728366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:15.728366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:15.728366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:15.728366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:15.728366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:15.728366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:15.728366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:15.728366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:15.728366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:15.728366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:40:15.728366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 74/148] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Aug 11 09:40:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:15.734590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac4770-f59f-4261-a9a7-d69bf90dfc9a None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:15.836312 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac4770-f59f-4261-a9a7-d69bf90dfc9a None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:15.870886 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b47e6-098b-4f41-84d0-ada24ee8c2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:15.871488 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b47e6-098b-4f41-84d0-ada24ee8c2c3 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:15.871756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b47e6-098b-4f41-84d0-ada24ee8c2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:15.872020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b47e6-098b-4f41-84d0-ada24ee8c2c3 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:15.872697 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b47e6-098b-4f41-84d0-ada24ee8c2c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:15.872992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b47e6-098b-4f41-84d0-ada24ee8c2c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:15.874376 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b47e6-098b-4f41-84d0-ada24ee8c2c3 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:15.882344 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 75/149] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:40:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:15.888048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b546cf0-7c17-42f5-9ce6-3810177826ed None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:16.000995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b546cf0-7c17-42f5-9ce6-3810177826ed None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:16.037095 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e27985-0124-4283-9dbd-8ee34f7d8073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:16.037725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e27985-0124-4283-9dbd-8ee34f7d8073 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:16.037995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e27985-0124-4283-9dbd-8ee34f7d8073 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:16.038287 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e27985-0124-4283-9dbd-8ee34f7d8073 None admin] PATH_INFO: `/v3/users/df154087f69f4bfab45c05e2ee8526a3` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:16.039420 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e27985-0124-4283-9dbd-8ee34f7d8073 None admin] RBAC: Authorizing `identity:get_user(user_id=df154087f69f4bfab45c05e2ee8526a3)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:16.040857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e27985-0124-4283-9dbd-8ee34f7d8073 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:16.042542 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 75/150] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:15 2022] GET /identity/v3/users/df154087f69f4bfab45c05e2ee8526a3 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:16.049219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b47e6-098b-4f41-84d0-ada24ee8c2c3 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:16.079992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:16.168179 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b47e6-098b-4f41-84d0-ada24ee8c2c3 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:16.208459 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cec94f-ab49-44b8-8dc1-d0c20734f2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:16.209062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cec94f-ab49-44b8-8dc1-d0c20734f2d2 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:16.209333 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cec94f-ab49-44b8-8dc1-d0c20734f2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:16.209600 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cec94f-ab49-44b8-8dc1-d0c20734f2d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:16.295702 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cec94f-ab49-44b8-8dc1-d0c20734f2d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:16.297178 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cec94f-ab49-44b8-8dc1-d0c20734f2d2 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:16.329030 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:16.418302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 76/151] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:40:16.424132 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e27985-0124-4283-9dbd-8ee34f7d8073 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:16.487921 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1d720-cd76-4081-9818-bcd77547df00 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:16.488261 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1d720-cd76-4081-9818-bcd77547df00 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:16.488473 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1d720-cd76-4081-9818-bcd77547df00 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:16.489826 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 77/152] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:40:16.491109 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:16.495348 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde320c-03c0-42eb-b1a6-57206899a5ec None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:16.495694 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde320c-03c0-42eb-b1a6-57206899a5ec None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:16.495973 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde320c-03c0-42eb-b1a6-57206899a5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:16.526820 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-6dde320c-03c0-42eb-b1a6-57206899a5ec None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:16.528022 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-6dde320c-03c0-42eb-b1a6-57206899a5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:16.559826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e27985-0124-4283-9dbd-8ee34f7d8073 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:16.601215 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e846a1b-7006-4b36-bb06-9975c42c8391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:16.602186 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e846a1b-7006-4b36-bb06-9975c42c8391 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:16.602471 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e846a1b-7006-4b36-bb06-9975c42c8391 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:16.602743 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e846a1b-7006-4b36-bb06-9975c42c8391 None admin] PATH_INFO: `/v3/projects/efa1046add794b2eb629463dd092363b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:16.604033 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e846a1b-7006-4b36-bb06-9975c42c8391 None admin] RBAC: Authorizing `identity:get_project(project_id=efa1046add794b2eb629463dd092363b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:16.605599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e846a1b-7006-4b36-bb06-9975c42c8391 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:16.607530 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 76/153] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:16 2022] GET /identity/v3/projects/efa1046add794b2eb629463dd092363b => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:16.613087 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e846a1b-7006-4b36-bb06-9975c42c8391 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:16.717435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 78/154] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 09:40:16.718443 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac41c0f-c040-4ecb-83ba-4729546ed872 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:16.718722 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac41c0f-c040-4ecb-83ba-4729546ed872 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:16.718988 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac41c0f-c040-4ecb-83ba-4729546ed872 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:16.720208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 79/155] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:16.722157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e846a1b-7006-4b36-bb06-9975c42c8391 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:16.725301 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73767d-2106-40d1-82f0-527a930637ec None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:16.725575 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73767d-2106-40d1-82f0-527a930637ec None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:16.725843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73767d-2106-40d1-82f0-527a930637ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:16.743137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-2b73767d-2106-40d1-82f0-527a930637ec None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:16.744305 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-2b73767d-2106-40d1-82f0-527a930637ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:16.754495 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:16.762179 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c1d51-fc33-41a9-a7fd-63e6ffbe0934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:16.763127 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c1d51-fc33-41a9-a7fd-63e6ffbe0934 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:16.763923 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c1d51-fc33-41a9-a7fd-63e6ffbe0934 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:16.764198 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c1d51-fc33-41a9-a7fd-63e6ffbe0934 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:16.764928 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c1d51-fc33-41a9-a7fd-63e6ffbe0934 None admin] RBAC: Adding query filter params (role.id=da3ceb6dfa1746f19dbaf26e2c3ef7ab, scope.project.id=efa1046add794b2eb629463dd092363b, user.id=df154087f69f4bfab45c05e2ee8526a3) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:16.765236 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c1d51-fc33-41a9-a7fd-63e6ffbe0934 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:16.767152 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c1d51-fc33-41a9-a7fd-63e6ffbe0934 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:16.775283 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 77/156] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:40:16 2022] GET /identity/v3/role_assignments?user.id=df154087f69f4bfab45c05e2ee8526a3&scope.project.id=efa1046add794b2eb629463dd092363b&role.id=da3ceb6dfa1746f19dbaf26e2c3ef7ab => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:16.778263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c1d51-fc33-41a9-a7fd-63e6ffbe0934 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:16.833491 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:16.860037 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 80/157] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 09:40:16.875194 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fea9d-5122-4a33-a09b-f693357256db None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:16.875494 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fea9d-5122-4a33-a09b-f693357256db None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:16.875740 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fea9d-5122-4a33-a09b-f693357256db None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:16.877140 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 81/158] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:40:16.882741 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f6f3b-4c9b-4842-9b6b-0cb5aecbb7c5 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:16.883020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f6f3b-4c9b-4842-9b6b-0cb5aecbb7c5 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:16.883273 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f6f3b-4c9b-4842-9b6b-0cb5aecbb7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:16.905274 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-a76f6f3b-4c9b-4842-9b6b-0cb5aecbb7c5 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:16.906919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-a76f6f3b-4c9b-4842-9b6b-0cb5aecbb7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:16.978572 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c1d51-fc33-41a9-a7fd-63e6ffbe0934 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:16.996657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 82/159] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 09:40:17.004528 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f6f3b-4c9b-4842-9b6b-0cb5aecbb7c5 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:17.023727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d180b-7270-450f-bddf-fc6a5b704028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:17.024388 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d180b-7270-450f-bddf-fc6a5b704028 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:17.024657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d180b-7270-450f-bddf-fc6a5b704028 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:17.024926 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d180b-7270-450f-bddf-fc6a5b704028 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:17.028508 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d180b-7270-450f-bddf-fc6a5b704028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:17.030014 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d180b-7270-450f-bddf-fc6a5b704028 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:17.031780 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 78/160] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:40:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:17.032540 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d180b-7270-450f-bddf-fc6a5b704028 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:17.097580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:17.115875 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f6f3b-4c9b-4842-9b6b-0cb5aecbb7c5 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:17.133259 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:17.138173 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d180b-7270-450f-bddf-fc6a5b704028 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:17.150072 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347d2df-d140-4e9b-88c1-cf3d9baa3e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:17.150724 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347d2df-d140-4e9b-88c1-cf3d9baa3e8c None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:17.151000 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347d2df-d140-4e9b-88c1-cf3d9baa3e8c None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:17.151271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347d2df-d140-4e9b-88c1-cf3d9baa3e8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:17.161065 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347d2df-d140-4e9b-88c1-cf3d9baa3e8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:17.166460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-7347d2df-d140-4e9b-88c1-cf3d9baa3e8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:17.166460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:17.166460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:17.166460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:17.166460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:17.166460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:17.166460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:17.166460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:17.166460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:17.166460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:17.166460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:17.166460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:17.166460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:17.166460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:17.166460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:17.166460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:17.167499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:17.167499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:17.167499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:17.167499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:17.167499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:17.167499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:17.167499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:17.167499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:17.167499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:17.167499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:17.167499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:17.167499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:17.167499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:17.167499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:17.167499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:17.167499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:17.170991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:17.170991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:17.170991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:17.170991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:17.170991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:17.170991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:17.170991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:17.170991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:17.170991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:17.170991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:17.170991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:17.170991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:17.170991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 83/161] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:17.170991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347d2df-d140-4e9b-88c1-cf3d9baa3e8c None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:17.175822 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8a543-3caa-4d82-b166-89788ea18a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:17.176460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8a543-3caa-4d82-b166-89788ea18a2d None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:17.176740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8a543-3caa-4d82-b166-89788ea18a2d None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:17.177431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8a543-3caa-4d82-b166-89788ea18a2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:17.188583 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8a543-3caa-4d82-b166-89788ea18a2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:17.193657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-89a8a543-3caa-4d82-b166-89788ea18a2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:40:17.193657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:17.193657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:17.193657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:17.193657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:17.193657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:17.193657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:17.193657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:17.193657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:17.193657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:17.193657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:17.193657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:17.193657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:17.193657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:17.193657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:17.193657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:17.194596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:17.194596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:17.194596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:17.194596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:17.194596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:17.194596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:17.194596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:17.194596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:17.194596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:17.194596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:17.194596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:17.194596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:17.194596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:17.194596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:17.194596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:17.194596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:17.200486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:17.200486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:17.200486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:17.200486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:17.200486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:17.200486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:17.200486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:17.200486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:17.200486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:17.200486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:17.200486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:40:17.200486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:40:17.200486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 79/162] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:40:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:17.200486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d8e1d-4065-42ac-aa7d-785b9a6bb5e4 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:17.201262 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d8e1d-4065-42ac-aa7d-785b9a6bb5e4 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:17.201262 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d8e1d-4065-42ac-aa7d-785b9a6bb5e4 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:17.201262 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 80/163] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:17.201262 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d8e1d-4065-42ac-aa7d-785b9a6bb5e4 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:17.275172 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347d2df-d140-4e9b-88c1-cf3d9baa3e8c None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:17.301518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d8e1d-4065-42ac-aa7d-785b9a6bb5e4 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:17.308062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c42e61-e2e2-4596-bed2-b9ad79f65b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:17.308666 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c42e61-e2e2-4596-bed2-b9ad79f65b74 None admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:17.308937 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c42e61-e2e2-4596-bed2-b9ad79f65b74 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:17.309196 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c42e61-e2e2-4596-bed2-b9ad79f65b74 None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:17.309822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c42e61-e2e2-4596-bed2-b9ad79f65b74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:17.311835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c42e61-e2e2-4596-bed2-b9ad79f65b74 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:17.318720 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:17.334546 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b43e76-e60c-4205-82de-935ed85e82a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:17.335183 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b43e76-e60c-4205-82de-935ed85e82a4 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:17.335455 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b43e76-e60c-4205-82de-935ed85e82a4 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:17.335719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b43e76-e60c-4205-82de-935ed85e82a4 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:17.336363 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b43e76-e60c-4205-82de-935ed85e82a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:17.336657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b43e76-e60c-4205-82de-935ed85e82a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:17.338005 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b43e76-e60c-4205-82de-935ed85e82a4 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:17.346614 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 81/164] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:17.347367 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b43e76-e60c-4205-82de-935ed85e82a4 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:17.426905 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 84/165] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Aug 11 09:40:17 2022] POST /identity/v3/users => generated 283 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:40:17.428109 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d5c94-42fb-42bb-845a-93f78a5f0a09 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:17.428468 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d5c94-42fb-42bb-845a-93f78a5f0a09 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:17.428664 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d5c94-42fb-42bb-845a-93f78a5f0a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:17.447529 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-456d5c94-42fb-42bb-845a-93f78a5f0a09 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:17.448753 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-456d5c94-42fb-42bb-845a-93f78a5f0a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:17.449826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b43e76-e60c-4205-82de-935ed85e82a4 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:17.479737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:17.488323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9824bb9-bd2c-4b33-9801-d8cd8b33123f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:17.488941 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9824bb9-bd2c-4b33-9801-d8cd8b33123f None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:17.489215 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9824bb9-bd2c-4b33-9801-d8cd8b33123f None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:17.489480 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9824bb9-bd2c-4b33-9801-d8cd8b33123f None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:17.490181 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9824bb9-bd2c-4b33-9801-d8cd8b33123f None admin] RBAC: Adding query filter params (name=admin) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:17.490482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9824bb9-bd2c-4b33-9801-d8cd8b33123f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:17.491874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9824bb9-bd2c-4b33-9801-d8cd8b33123f None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:17.505523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 82/166] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:17.505523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9824bb9-bd2c-4b33-9801-d8cd8b33123f None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:17.546584 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 85/167] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:17.547490 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d5c94-42fb-42bb-845a-93f78a5f0a09 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:17.558913 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:17.622852 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9824bb9-bd2c-4b33-9801-d8cd8b33123f None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:17.665315 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6e545-9509-458c-b626-2b420b27d931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:17.665776 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d5c94-42fb-42bb-845a-93f78a5f0a09 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:17.665945 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6e545-9509-458c-b626-2b420b27d931 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:17.666261 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6e545-9509-458c-b626-2b420b27d931 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:17.666585 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6e545-9509-458c-b626-2b420b27d931 None admin] PATH_INFO: `/v3/users/df154087f69f4bfab45c05e2ee8526a3` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:17.668662 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6e545-9509-458c-b626-2b420b27d931 None admin] RBAC: Authorizing `identity:get_user(user_id=df154087f69f4bfab45c05e2ee8526a3)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:17.670703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6e545-9509-458c-b626-2b420b27d931 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:17.672601 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 83/168] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:17 2022] GET /identity/v3/users/df154087f69f4bfab45c05e2ee8526a3 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:17.673375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6e545-9509-458c-b626-2b420b27d931 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:17.714948 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f029e-033d-4211-929d-f1f8e3aa9528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:17.715759 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f029e-033d-4211-929d-f1f8e3aa9528 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:17.716033 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f029e-033d-4211-929d-f1f8e3aa9528 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:17.716922 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f029e-033d-4211-929d-f1f8e3aa9528 None admin] PATH_INFO: `/v3/users/07db6516e8ce4759bb6e5167b3fb5367` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:17.718164 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f029e-033d-4211-929d-f1f8e3aa9528 None admin] RBAC: Authorizing `identity:get_user(user_id=07db6516e8ce4759bb6e5167b3fb5367)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:17.720302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f029e-033d-4211-929d-f1f8e3aa9528 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:17.721978 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 86/169] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:17 2022] GET /identity/v3/users/07db6516e8ce4759bb6e5167b3fb5367 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:17.723912 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f029e-033d-4211-929d-f1f8e3aa9528 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:17.762781 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:17.800759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6e545-9509-458c-b626-2b420b27d931 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:17.815738 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:17.846045 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f029e-033d-4211-929d-f1f8e3aa9528 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:17.847559 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41c640-abd2-4ae9-8cb1-14aa6ed4f1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:17.848605 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41c640-abd2-4ae9-8cb1-14aa6ed4f1fc None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:17.848946 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41c640-abd2-4ae9-8cb1-14aa6ed4f1fc None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:17.849270 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41c640-abd2-4ae9-8cb1-14aa6ed4f1fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:17.862465 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41c640-abd2-4ae9-8cb1-14aa6ed4f1fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:17.867710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-2a41c640-abd2-4ae9-8cb1-14aa6ed4f1fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 09:40:17.867710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:17.867710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:17.867710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:17.867710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:17.867710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:17.867710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:17.867710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:17.867710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:17.867710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:17.867710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:17.867710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:17.867710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:17.867710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:17.867710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:17.867710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:17.868629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:17.868629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:17.868629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:17.868629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:17.868629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:17.868629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:17.868629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:17.868629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:17.868629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:17.868629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:17.868629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:17.868629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:17.868629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:17.868629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:17.868629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:17.868629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:17.869390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:17.869390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:17.869390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:17.869390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:17.869390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:17.869390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:17.869390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:17.869390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:17.869390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:17.869390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:17.869390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 09:40:17.869390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:40:17.869989 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 84/170] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:17.871164 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41c640-abd2-4ae9-8cb1-14aa6ed4f1fc None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:17.901924 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062f6b7-51b5-40ef-94b8-3698dc20720c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:17.902897 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062f6b7-51b5-40ef-94b8-3698dc20720c None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:17.904464 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062f6b7-51b5-40ef-94b8-3698dc20720c None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:17.904464 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062f6b7-51b5-40ef-94b8-3698dc20720c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:17.990115 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062f6b7-51b5-40ef-94b8-3698dc20720c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:17.991695 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062f6b7-51b5-40ef-94b8-3698dc20720c None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:18.007021 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41c640-abd2-4ae9-8cb1-14aa6ed4f1fc None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:18.031502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:18.056393 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d1aea-68f6-4d36-9031-8ebee348ad75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:18.057651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d1aea-68f6-4d36-9031-8ebee348ad75 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:18.058061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d1aea-68f6-4d36-9031-8ebee348ad75 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:18.058356 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d1aea-68f6-4d36-9031-8ebee348ad75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:18.119100 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:18.136686 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 87/171] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:40:18.137854 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062f6b7-51b5-40ef-94b8-3698dc20720c None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:18.162221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d1aea-68f6-4d36-9031-8ebee348ad75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:18.164079 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d1aea-68f6-4d36-9031-8ebee348ad75 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:18.297260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062f6b7-51b5-40ef-94b8-3698dc20720c None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:18.332022 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 85/172] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:40:18.333170 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d1aea-68f6-4d36-9031-8ebee348ad75 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:18.386450 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:18.400856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd18ea4-b007-4b71-93aa-be172f2ff1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:18.401479 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd18ea4-b007-4b71-93aa-be172f2ff1dc None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:18.401758 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd18ea4-b007-4b71-93aa-be172f2ff1dc None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:18.402027 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd18ea4-b007-4b71-93aa-be172f2ff1dc None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:18.402731 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd18ea4-b007-4b71-93aa-be172f2ff1dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:18.403029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd18ea4-b007-4b71-93aa-be172f2ff1dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:18.403459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:18.404456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd18ea4-b007-4b71-93aa-be172f2ff1dc None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:18.413084 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 88/173] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:18.413908 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd18ea4-b007-4b71-93aa-be172f2ff1dc None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:18.436973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d1aea-68f6-4d36-9031-8ebee348ad75 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:18.470369 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f342f-bbc0-44bd-bafe-1a8fd1fc19d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:18.471092 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f342f-bbc0-44bd-bafe-1a8fd1fc19d7 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:18.471274 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f342f-bbc0-44bd-bafe-1a8fd1fc19d7 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:18.471553 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f342f-bbc0-44bd-bafe-1a8fd1fc19d7 None admin] PATH_INFO: `/v3/projects/2961a9b68da5434bb181754edb1daae4` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:18.472677 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f342f-bbc0-44bd-bafe-1a8fd1fc19d7 None admin] RBAC: Authorizing `identity:get_project(project_id=2961a9b68da5434bb181754edb1daae4)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:18.474143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f342f-bbc0-44bd-bafe-1a8fd1fc19d7 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:18.476008 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 86/174] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:18 2022] GET /identity/v3/projects/2961a9b68da5434bb181754edb1daae4 => generated 312 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:18.476547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f342f-bbc0-44bd-bafe-1a8fd1fc19d7 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:18.576657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd18ea4-b007-4b71-93aa-be172f2ff1dc None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:18.578030 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f342f-bbc0-44bd-bafe-1a8fd1fc19d7 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:18.612232 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1b132-026b-4068-a811-0c83deb69f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:18.612784 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1b132-026b-4068-a811-0c83deb69f60 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:18.613061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1b132-026b-4068-a811-0c83deb69f60 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:18.613334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1b132-026b-4068-a811-0c83deb69f60 None admin] PATH_INFO: `/v3/users/04e3f170726347fd969cdebfb9efc783` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:18.614503 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1b132-026b-4068-a811-0c83deb69f60 None admin] RBAC: Authorizing `identity:get_user(user_id=04e3f170726347fd969cdebfb9efc783)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:18.615965 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1b132-026b-4068-a811-0c83deb69f60 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:18.617543 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 87/175] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:18 2022] GET /identity/v3/users/04e3f170726347fd969cdebfb9efc783 => generated 289 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:18.618605 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1b132-026b-4068-a811-0c83deb69f60 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:18.638442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:18.682829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fe7b1-4224-4216-ac77-d347913f0bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:18.683471 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fe7b1-4224-4216-ac77-d347913f0bca None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:18.683898 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fe7b1-4224-4216-ac77-d347913f0bca None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:18.684018 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fe7b1-4224-4216-ac77-d347913f0bca None admin] PATH_INFO: `/v3/projects/efa1046add794b2eb629463dd092363b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:18.685799 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2fe7b1-4224-4216-ac77-d347913f0bca None admin] RBAC: Authorizing `identity:get_project(project_id=efa1046add794b2eb629463dd092363b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:18.687341 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2fe7b1-4224-4216-ac77-d347913f0bca None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:18.689337 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 89/176] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:18 2022] GET /identity/v3/projects/efa1046add794b2eb629463dd092363b => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:18.689883 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fe7b1-4224-4216-ac77-d347913f0bca None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:18.727836 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1b132-026b-4068-a811-0c83deb69f60 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:18.763073 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26a79a-d9b3-4730-b3cd-331350ff6416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:18.763680 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26a79a-d9b3-4730-b3cd-331350ff6416 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:18.764006 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26a79a-d9b3-4730-b3cd-331350ff6416 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:18.764280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26a79a-d9b3-4730-b3cd-331350ff6416 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:18.765002 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26a79a-d9b3-4730-b3cd-331350ff6416 None admin] RBAC: Adding query filter params (role.id=9b9c9f22f65c459bacd757d5de4d5b8e, scope.project.id=2961a9b68da5434bb181754edb1daae4, user.id=df154087f69f4bfab45c05e2ee8526a3) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:18.765307 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26a79a-d9b3-4730-b3cd-331350ff6416 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:18.766764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26a79a-d9b3-4730-b3cd-331350ff6416 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:18.772686 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 88/177] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:40:18 2022] GET /identity/v3/role_assignments?user.id=df154087f69f4bfab45c05e2ee8526a3&scope.project.id=2961a9b68da5434bb181754edb1daae4&role.id=9b9c9f22f65c459bacd757d5de4d5b8e => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:18.773484 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26a79a-d9b3-4730-b3cd-331350ff6416 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:18.840219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:18.878235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:18.905016 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26a79a-d9b3-4730-b3cd-331350ff6416 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:18.978249 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6bae0-f7ae-4dae-912e-dd1e491a82dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:18.978862 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6bae0-f7ae-4dae-912e-dd1e491a82dc None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:18.979146 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6bae0-f7ae-4dae-912e-dd1e491a82dc None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:18.979396 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6bae0-f7ae-4dae-912e-dd1e491a82dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:18.980119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6bae0-f7ae-4dae-912e-dd1e491a82dc None admin] RBAC: Adding query filter params (role.id=6aae1c66f3f04cec80ed72c20d7e033b, scope.project.id=efa1046add794b2eb629463dd092363b, user.id=07db6516e8ce4759bb6e5167b3fb5367) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:18.980418 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6bae0-f7ae-4dae-912e-dd1e491a82dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:18.982783 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6bae0-f7ae-4dae-912e-dd1e491a82dc None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:18.984505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fe7b1-4224-4216-ac77-d347913f0bca None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:18.996047 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 89/178] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:40:18 2022] GET /identity/v3/role_assignments?user.id=07db6516e8ce4759bb6e5167b3fb5367&scope.project.id=efa1046add794b2eb629463dd092363b&role.id=6aae1c66f3f04cec80ed72c20d7e033b => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:19.058098 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8061e2-4df9-4827-9f61-e26299690be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:19.058758 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8061e2-4df9-4827-9f61-e26299690be5 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:19.059033 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8061e2-4df9-4827-9f61-e26299690be5 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:19.059309 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8061e2-4df9-4827-9f61-e26299690be5 None admin] PATH_INFO: `/v3/projects/efa1046add794b2eb629463dd092363b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:19.060559 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8061e2-4df9-4827-9f61-e26299690be5 None admin] RBAC: Authorizing `identity:get_project(project_id=efa1046add794b2eb629463dd092363b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:19.062049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8061e2-4df9-4827-9f61-e26299690be5 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:19.063976 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 90/179] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:18 2022] GET /identity/v3/projects/efa1046add794b2eb629463dd092363b => generated 298 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:19.070004 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6bae0-f7ae-4dae-912e-dd1e491a82dc None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:19.193188 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6bae0-f7ae-4dae-912e-dd1e491a82dc None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:19.233165 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b69e4-3780-4687-bc3b-3da869131881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:19.233832 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b69e4-3780-4687-bc3b-3da869131881 None admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:19.234144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b69e4-3780-4687-bc3b-3da869131881 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:19.234422 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b69e4-3780-4687-bc3b-3da869131881 None admin] PATH_INFO: `/v3/projects/efa1046add794b2eb629463dd092363b/users/04e3f170726347fd969cdebfb9efc783/roles/5ec51441676c42e7b6a3026a449dade7` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:19.236369 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b69e4-3780-4687-bc3b-3da869131881 None admin] RBAC: Authorizing `identity:create_grant(project_id=efa1046add794b2eb629463dd092363b, user_id=04e3f170726347fd969cdebfb9efc783, role_id=5ec51441676c42e7b6a3026a449dade7)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:19.237846 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b69e4-3780-4687-bc3b-3da869131881 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:19.240235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:19.324862 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 90/180] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Aug 11 09:40:19 2022] PUT /identity/v3/projects/efa1046add794b2eb629463dd092363b/users/04e3f170726347fd969cdebfb9efc783/roles/5ec51441676c42e7b6a3026a449dade7 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:40:19.948447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87322883-79af-49e0-b347-d4475a065fb9 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:19.948957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87322883-79af-49e0-b347-d4475a065fb9 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:19.948957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87322883-79af-49e0-b347-d4475a065fb9 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:19.950579 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 91/181] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:19.960130 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aadf78-f606-4f3d-9442-c911a069ad31 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:19.960564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aadf78-f606-4f3d-9442-c911a069ad31 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:19.960872 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aadf78-f606-4f3d-9442-c911a069ad31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:19.979036 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-18aadf78-f606-4f3d-9442-c911a069ad31 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:19.980213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-18aadf78-f606-4f3d-9442-c911a069ad31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:20.047674 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 91/182] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:20.071001 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87322883-79af-49e0-b347-d4475a065fb9 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:20.098009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41a7d6-21c4-4428-b6f0-f5a50846b395 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:20.098009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41a7d6-21c4-4428-b6f0-f5a50846b395 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:20.098009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41a7d6-21c4-4428-b6f0-f5a50846b395 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:20.098009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 92/183] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:40:20.103611 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8d6a2-0a20-4e4a-8547-0d86255ad086 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:20.104154 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8d6a2-0a20-4e4a-8547-0d86255ad086 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:20.104630 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8d6a2-0a20-4e4a-8547-0d86255ad086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:20.124424 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-55b8d6a2-0a20-4e4a-8547-0d86255ad086 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:20.125945 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-55b8d6a2-0a20-4e4a-8547-0d86255ad086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:20.178191 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87322883-79af-49e0-b347-d4475a065fb9 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:20.214178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 93/184] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 09:40:20.214338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:20.218321 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd9b4c-df46-4aaf-ae66-3611857b0feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:20.219000 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd9b4c-df46-4aaf-ae66-3611857b0feb None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:20.219274 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd9b4c-df46-4aaf-ae66-3611857b0feb None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:20.224682 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd9b4c-df46-4aaf-ae66-3611857b0feb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:20.230558 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd9b4c-df46-4aaf-ae66-3611857b0feb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:20.233039 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8d6a2-0a20-4e4a-8547-0d86255ad086 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:20.236049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-d1dd9b4c-df46-4aaf-ae66-3611857b0feb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:40:20.236049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:20.236049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:20.236049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:20.236049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:20.236049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:20.236049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:20.236049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:20.236049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:20.236049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:20.236049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:20.236049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:20.236049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:20.236049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:20.236049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:20.236049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:20.236944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:20.236944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:20.236944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:20.236944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:20.236944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:20.236944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:20.236944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:20.236944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:20.236944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:20.236944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:20.236944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:20.236944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:20.236944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:20.236944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:20.236944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:20.236944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:20.237733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:20.237733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:20.237733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:20.237733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:20.237733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:20.237733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:20.237733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:20.237733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:20.237733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:20.237733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:20.237733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:40:20.237733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:20.237733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 92/185] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:40:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:20.244142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd9b4c-df46-4aaf-ae66-3611857b0feb None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:20.298471 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:20.347980 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd9b4c-df46-4aaf-ae66-3611857b0feb None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:20.352720 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8d6a2-0a20-4e4a-8547-0d86255ad086 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:20.386018 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63e805-f12a-4902-8caa-c8207e3ba840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:20.386673 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63e805-f12a-4902-8caa-c8207e3ba840 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:20.386918 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63e805-f12a-4902-8caa-c8207e3ba840 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:20.387185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63e805-f12a-4902-8caa-c8207e3ba840 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:20.387899 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63e805-f12a-4902-8caa-c8207e3ba840 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:20.388198 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63e805-f12a-4902-8caa-c8207e3ba840 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:20.389578 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63e805-f12a-4902-8caa-c8207e3ba840 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:20.393661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48023c-e460-4589-b795-7d36fc34a0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:20.394340 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48023c-e460-4589-b795-7d36fc34a0e0 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:20.395035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48023c-e460-4589-b795-7d36fc34a0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:20.395310 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48023c-e460-4589-b795-7d36fc34a0e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:20.397727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 93/186] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:20.403233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956a6dc-4d14-4267-b388-d83722d67b15 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:20.403425 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956a6dc-4d14-4267-b388-d83722d67b15 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:20.404183 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956a6dc-4d14-4267-b388-d83722d67b15 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:20.406249 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 94/187] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:20.406249 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956a6dc-4d14-4267-b388-d83722d67b15 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:20.409299 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48023c-e460-4589-b795-7d36fc34a0e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:20.414185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-3d48023c-e460-4589-b795-7d36fc34a0e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:20.414185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:20.414185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:20.414185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:20.414185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:20.414185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:20.414185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:20.414185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:20.414185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:20.414185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:20.414185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:20.414185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:20.414185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:20.414185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:20.414185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:20.414185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:20.415061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:20.415061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:20.415061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:20.415061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:20.415061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:20.415061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:20.415061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:20.415061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:20.415061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:20.415061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:20.415061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:20.415061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:20.415061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:20.415061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:20.415061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:20.415061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:20.416048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:20.416048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:20.416048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:20.416048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:20.416048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:20.416048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:20.416048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:20.416048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:20.416048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:20.416048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:20.416048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:20.416048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:40:20.417961 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 94/188] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Aug 11 09:40:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:40:20.425304 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe38dcd-13e0-44ed-ac75-c4497ab2dae9 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:20.425639 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe38dcd-13e0-44ed-ac75-c4497ab2dae9 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:20.426348 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe38dcd-13e0-44ed-ac75-c4497ab2dae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:20.449503 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-dfe38dcd-13e0-44ed-ac75-c4497ab2dae9 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:20.451687 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-dfe38dcd-13e0-44ed-ac75-c4497ab2dae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:20.508133 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:20.522554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956a6dc-4d14-4267-b388-d83722d67b15 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:20.523071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 95/189] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:20.523795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe38dcd-13e0-44ed-ac75-c4497ab2dae9 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:20.569837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27c924-a129-46be-9d1a-89ded664f8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:20.570496 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27c924-a129-46be-9d1a-89ded664f8e5 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:20.570771 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27c924-a129-46be-9d1a-89ded664f8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:20.571054 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27c924-a129-46be-9d1a-89ded664f8e5 None admin] PATH_INFO: `/v3/users/2cbdadb1ca7145cebccb624e06115920` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:20.583282 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:20.584401 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27c924-a129-46be-9d1a-89ded664f8e5 None admin] RBAC: Authorizing `identity:get_user(user_id=2cbdadb1ca7145cebccb624e06115920)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:20.585885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27c924-a129-46be-9d1a-89ded664f8e5 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:20.587640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 95/190] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:20 2022] GET /identity/v3/users/2cbdadb1ca7145cebccb624e06115920 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:20.588409 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27c924-a129-46be-9d1a-89ded664f8e5 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:20.646821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe38dcd-13e0-44ed-ac75-c4497ab2dae9 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:20.681547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c3111-c7d4-4bc3-8fa0-c60de9f9dcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:20.682699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c3111-c7d4-4bc3-8fa0-c60de9f9dcd5 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:20.683173 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c3111-c7d4-4bc3-8fa0-c60de9f9dcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:20.683622 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c3111-c7d4-4bc3-8fa0-c60de9f9dcd5 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:20.684471 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c3111-c7d4-4bc3-8fa0-c60de9f9dcd5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:20.685011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c3111-c7d4-4bc3-8fa0-c60de9f9dcd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:20.686701 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c3111-c7d4-4bc3-8fa0-c60de9f9dcd5 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:20.695616 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 96/191] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:40:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:20.696655 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c3111-c7d4-4bc3-8fa0-c60de9f9dcd5 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:20.697753 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27c924-a129-46be-9d1a-89ded664f8e5 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:20.714677 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:20.738007 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce33ae-205c-4458-9c0c-e7d7bc7cd16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:20.738847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce33ae-205c-4458-9c0c-e7d7bc7cd16f None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:20.739119 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce33ae-205c-4458-9c0c-e7d7bc7cd16f None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:20.739380 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce33ae-205c-4458-9c0c-e7d7bc7cd16f None admin] PATH_INFO: `/v3/domains/default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:20.740505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce33ae-205c-4458-9c0c-e7d7bc7cd16f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:20.741999 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce33ae-205c-4458-9c0c-e7d7bc7cd16f None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:20.748067 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 96/192] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:40:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:20.748067 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce33ae-205c-4458-9c0c-e7d7bc7cd16f None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:20.807202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c3111-c7d4-4bc3-8fa0-c60de9f9dcd5 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:20.814933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:20.845704 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce33ae-205c-4458-9c0c-e7d7bc7cd16f None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:20.849319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa0703-2709-4580-8c76-3ae6e3b52821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:20.850381 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa0703-2709-4580-8c76-3ae6e3b52821 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:20.851016 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa0703-2709-4580-8c76-3ae6e3b52821 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:20.851803 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa0703-2709-4580-8c76-3ae6e3b52821 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:20.882889 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4dfac-4844-4485-8230-411a49f5fac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:20.883513 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4dfac-4844-4485-8230-411a49f5fac7 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:20.883784 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4dfac-4844-4485-8230-411a49f5fac7 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:20.884042 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4dfac-4844-4485-8230-411a49f5fac7 None admin] PATH_INFO: `/v3/users/2cbdadb1ca7145cebccb624e06115920` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:20.885162 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4dfac-4844-4485-8230-411a49f5fac7 None admin] RBAC: Authorizing `identity:get_user(user_id=2cbdadb1ca7145cebccb624e06115920)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:20.886674 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4dfac-4844-4485-8230-411a49f5fac7 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:20.888768 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 97/193] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:20 2022] GET /identity/v3/users/2cbdadb1ca7145cebccb624e06115920 => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:20.888768 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4dfac-4844-4485-8230-411a49f5fac7 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:20.931200 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa0703-2709-4580-8c76-3ae6e3b52821 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:20.933305 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa0703-2709-4580-8c76-3ae6e3b52821 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:20.941441 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:20.995166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4dfac-4844-4485-8230-411a49f5fac7 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:21.030515 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187ca94-b4e0-496c-8a4c-24fa1130b382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:21.031115 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187ca94-b4e0-496c-8a4c-24fa1130b382 None admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:21.031394 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187ca94-b4e0-496c-8a4c-24fa1130b382 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:21.031655 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187ca94-b4e0-496c-8a4c-24fa1130b382 None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:21.032287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187ca94-b4e0-496c-8a4c-24fa1130b382 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:21.033706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187ca94-b4e0-496c-8a4c-24fa1130b382 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:21.038603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 97/194] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:40:21.043566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa0703-2709-4580-8c76-3ae6e3b52821 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:21.050068 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:21.137101 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa0703-2709-4580-8c76-3ae6e3b52821 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:21.147400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 98/195] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Aug 11 09:40:20 2022] POST /identity/v3/users => generated 297 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:40:21.158379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187ca94-b4e0-496c-8a4c-24fa1130b382 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:21.188742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323738de-6720-4fda-8b79-08b820e8620f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:21.190910 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323738de-6720-4fda-8b79-08b820e8620f None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:21.190910 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323738de-6720-4fda-8b79-08b820e8620f None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:21.190910 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323738de-6720-4fda-8b79-08b820e8620f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:21.283531 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187ca94-b4e0-496c-8a4c-24fa1130b382 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:21.284097 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323738de-6720-4fda-8b79-08b820e8620f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:21.285225 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:21.286013 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323738de-6720-4fda-8b79-08b820e8620f None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:21.297472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:21.326015 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2231a65-0d62-4f2a-b4f5-531614e692ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:21.327082 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2231a65-0d62-4f2a-b4f5-531614e692ba None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:21.327597 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2231a65-0d62-4f2a-b4f5-531614e692ba None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:21.328349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2231a65-0d62-4f2a-b4f5-531614e692ba None admin] PATH_INFO: `/v3/projects/99fc3f2cb288430c9a330338644185b3` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:21.329695 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2231a65-0d62-4f2a-b4f5-531614e692ba None admin] RBAC: Authorizing `identity:get_project(project_id=99fc3f2cb288430c9a330338644185b3)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:21.331386 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2231a65-0d62-4f2a-b4f5-531614e692ba None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:21.333932 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 99/196] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:21 2022] GET /identity/v3/projects/99fc3f2cb288430c9a330338644185b3 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:21.339589 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2231a65-0d62-4f2a-b4f5-531614e692ba None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:21.417547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 98/197] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:40:21.424802 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323738de-6720-4fda-8b79-08b820e8620f None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:21.472275 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2231a65-0d62-4f2a-b4f5-531614e692ba None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:21.513420 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047f396-f92f-4a44-bee2-c6de4bc04104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:21.514025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047f396-f92f-4a44-bee2-c6de4bc04104 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:21.515945 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047f396-f92f-4a44-bee2-c6de4bc04104 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:21.515945 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047f396-f92f-4a44-bee2-c6de4bc04104 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:21.516321 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047f396-f92f-4a44-bee2-c6de4bc04104 None admin] RBAC: Adding query filter params (role.id=6aae1c66f3f04cec80ed72c20d7e033b, scope.project.id=99fc3f2cb288430c9a330338644185b3, user.id=2cbdadb1ca7145cebccb624e06115920) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:21.516700 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047f396-f92f-4a44-bee2-c6de4bc04104 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:21.518065 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047f396-f92f-4a44-bee2-c6de4bc04104 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:21.525692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 100/198] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:40:21 2022] GET /identity/v3/role_assignments?user.id=2cbdadb1ca7145cebccb624e06115920&scope.project.id=99fc3f2cb288430c9a330338644185b3&role.id=6aae1c66f3f04cec80ed72c20d7e033b => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:21.527024 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beab96c-43c4-47c5-b2f5-4e903d8ebd97 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:21.527421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beab96c-43c4-47c5-b2f5-4e903d8ebd97 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:21.527623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beab96c-43c4-47c5-b2f5-4e903d8ebd97 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:21.529010 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 101/199] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:21.534491 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5ddee-2b65-44ff-87c7-d1f760e63a1a None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:21.534789 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5ddee-2b65-44ff-87c7-d1f760e63a1a None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:21.535033 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5ddee-2b65-44ff-87c7-d1f760e63a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:21.551490 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323738de-6720-4fda-8b79-08b820e8620f None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:21.559074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-a2a5ddee-2b65-44ff-87c7-d1f760e63a1a None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:21.561117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:21.562422 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-a2a5ddee-2b65-44ff-87c7-d1f760e63a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:21.596836 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:21.603324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae549a-c6ea-482a-8187-abf844096761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:21.604507 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae549a-c6ea-482a-8187-abf844096761 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:21.605011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae549a-c6ea-482a-8187-abf844096761 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:21.605458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae549a-c6ea-482a-8187-abf844096761 None admin] PATH_INFO: `/v3/projects/99fc3f2cb288430c9a330338644185b3` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:21.607675 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae549a-c6ea-482a-8187-abf844096761 None admin] RBAC: Authorizing `identity:get_project(project_id=99fc3f2cb288430c9a330338644185b3)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:21.610374 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae549a-c6ea-482a-8187-abf844096761 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:21.612392 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 99/200] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:21 2022] GET /identity/v3/projects/99fc3f2cb288430c9a330338644185b3 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:21.625575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae549a-c6ea-482a-8187-abf844096761 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:21.658515 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 102/201] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 09:40:21.688045 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5ddee-2b65-44ff-87c7-d1f760e63a1a None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:21.774554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae549a-c6ea-482a-8187-abf844096761 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:21.812055 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5ddee-2b65-44ff-87c7-d1f760e63a1a None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:21.820042 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45775d-b8c0-48c2-af92-985ba88b8507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:21.821310 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45775d-b8c0-48c2-af92-985ba88b8507 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:21.821695 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45775d-b8c0-48c2-af92-985ba88b8507 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:21.821964 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45775d-b8c0-48c2-af92-985ba88b8507 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:21.822711 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45775d-b8c0-48c2-af92-985ba88b8507 None admin] RBAC: Adding query filter params (role.id=da3ceb6dfa1746f19dbaf26e2c3ef7ab, scope.project.id=99fc3f2cb288430c9a330338644185b3, user.id=2cbdadb1ca7145cebccb624e06115920) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:21.823012 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45775d-b8c0-48c2-af92-985ba88b8507 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:21.824436 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45775d-b8c0-48c2-af92-985ba88b8507 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:21.832645 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 100/202] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:40:21 2022] GET /identity/v3/role_assignments?user.id=2cbdadb1ca7145cebccb624e06115920&scope.project.id=99fc3f2cb288430c9a330338644185b3&role.id=da3ceb6dfa1746f19dbaf26e2c3ef7ab => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:21.854290 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018a5c7-2047-46ba-b81b-60abfcccc139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:21.855069 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018a5c7-2047-46ba-b81b-60abfcccc139 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:21.855398 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018a5c7-2047-46ba-b81b-60abfcccc139 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:21.855717 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018a5c7-2047-46ba-b81b-60abfcccc139 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:21.869120 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018a5c7-2047-46ba-b81b-60abfcccc139 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:21.874142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-f018a5c7-2047-46ba-b81b-60abfcccc139 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 09:40:21.874142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:21.874142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:21.874142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:21.874142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:21.874142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:21.874142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:21.874142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:21.874142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:21.874142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:21.874142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:21.874142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:21.874142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:21.874142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:21.874142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:21.874142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:21.875117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:21.875117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:21.875117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:21.875117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:21.875117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:21.875117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:21.875117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:21.875117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:21.875117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:21.875117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:21.875117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:21.875117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:21.875117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:21.875117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:21.875117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:21.875117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:21.875942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:21.875942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:21.875942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:21.875942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:21.875942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:21.875942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:21.875942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:21.875942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:21.875942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:21.875942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:21.875942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 09:40:21.875942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:21.875942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 103/203] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:40:21.881219 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45775d-b8c0-48c2-af92-985ba88b8507 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:21.977937 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:22.109324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45775d-b8c0-48c2-af92-985ba88b8507 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:22.149574 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42782ebb-0412-4329-b734-35ef6ecbca91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:22.150222 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42782ebb-0412-4329-b734-35ef6ecbca91 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:22.150496 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42782ebb-0412-4329-b734-35ef6ecbca91 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:22.154102 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42782ebb-0412-4329-b734-35ef6ecbca91 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:22.154102 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42782ebb-0412-4329-b734-35ef6ecbca91 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:22.154102 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42782ebb-0412-4329-b734-35ef6ecbca91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:22.154102 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42782ebb-0412-4329-b734-35ef6ecbca91 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:22.172107 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 101/204] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:22.177624 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018a5c7-2047-46ba-b81b-60abfcccc139 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:22.226750 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:22.316794 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018a5c7-2047-46ba-b81b-60abfcccc139 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:22.378112 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527d977-8614-4851-9591-28cdda23a868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:22.378112 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527d977-8614-4851-9591-28cdda23a868 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:22.378112 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527d977-8614-4851-9591-28cdda23a868 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:22.378112 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527d977-8614-4851-9591-28cdda23a868 None admin] PATH_INFO: `/v3/users/04e3f170726347fd969cdebfb9efc783` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:22.382105 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527d977-8614-4851-9591-28cdda23a868 None admin] RBAC: Authorizing `identity:get_user(user_id=04e3f170726347fd969cdebfb9efc783)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:22.382105 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527d977-8614-4851-9591-28cdda23a868 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:22.382296 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 104/205] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:22 2022] GET /identity/v3/users/04e3f170726347fd969cdebfb9efc783 => generated 289 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:22.388254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42782ebb-0412-4329-b734-35ef6ecbca91 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:22.607556 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:22.613357 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42782ebb-0412-4329-b734-35ef6ecbca91 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:22.695456 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5622f6-7607-4924-b58d-0b93958a6806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:22.696085 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5622f6-7607-4924-b58d-0b93958a6806 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:22.696362 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5622f6-7607-4924-b58d-0b93958a6806 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:22.696634 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5622f6-7607-4924-b58d-0b93958a6806 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:22.803710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5622f6-7607-4924-b58d-0b93958a6806 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:22.803710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5622f6-7607-4924-b58d-0b93958a6806 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:22.934631 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:22.942813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 102/206] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:40:22.952341 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527d977-8614-4851-9591-28cdda23a868 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:23.159157 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:23.171013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527d977-8614-4851-9591-28cdda23a868 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:23.233006 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74b24f-32f3-4c5d-bcbe-725ba7c14ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:23.233627 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74b24f-32f3-4c5d-bcbe-725ba7c14ee3 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:23.233914 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74b24f-32f3-4c5d-bcbe-725ba7c14ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:23.234101 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74b24f-32f3-4c5d-bcbe-725ba7c14ee3 None admin] PATH_INFO: `/v3/projects/efa1046add794b2eb629463dd092363b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:23.239171 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74b24f-32f3-4c5d-bcbe-725ba7c14ee3 None admin] RBAC: Authorizing `identity:get_project(project_id=efa1046add794b2eb629463dd092363b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:23.240242 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74b24f-32f3-4c5d-bcbe-725ba7c14ee3 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:23.242230 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 105/207] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:22 2022] GET /identity/v3/projects/efa1046add794b2eb629463dd092363b => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:23.247765 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5622f6-7607-4924-b58d-0b93958a6806 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:23.392503 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5622f6-7607-4924-b58d-0b93958a6806 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:23.440525 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668d330-49e5-4a28-837e-44a1a8ef6f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:23.441131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668d330-49e5-4a28-837e-44a1a8ef6f4a None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:23.441407 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668d330-49e5-4a28-837e-44a1a8ef6f4a None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:23.441672 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668d330-49e5-4a28-837e-44a1a8ef6f4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:23.442423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668d330-49e5-4a28-837e-44a1a8ef6f4a None admin] RBAC: Adding query filter params (role.id=5ec51441676c42e7b6a3026a449dade7, scope.project.id=efa1046add794b2eb629463dd092363b, user.id=04e3f170726347fd969cdebfb9efc783) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:23.442729 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668d330-49e5-4a28-837e-44a1a8ef6f4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:23.444171 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668d330-49e5-4a28-837e-44a1a8ef6f4a None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:23.450132 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 103/208] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:40:23 2022] GET /identity/v3/role_assignments?user.id=04e3f170726347fd969cdebfb9efc783&scope.project.id=efa1046add794b2eb629463dd092363b&role.id=5ec51441676c42e7b6a3026a449dade7 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:23.769683 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138cb35-130d-46a7-b075-47d0e72a8d2f None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:23.770051 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138cb35-130d-46a7-b075-47d0e72a8d2f None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:23.770267 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138cb35-130d-46a7-b075-47d0e72a8d2f None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:23.771594 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 106/209] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:23.778344 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ad84b-9001-46ee-928d-106ff8c40184 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:23.778629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ad84b-9001-46ee-928d-106ff8c40184 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:23.778899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ad84b-9001-46ee-928d-106ff8c40184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:23.797636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-976ad84b-9001-46ee-928d-106ff8c40184 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:23.798852 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-976ad84b-9001-46ee-928d-106ff8c40184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:23.860885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:23.869527 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 104/210] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:23.893140 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138cb35-130d-46a7-b075-47d0e72a8d2f None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:24.009118 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138cb35-130d-46a7-b075-47d0e72a8d2f None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:24.047158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25a805-0ab4-4308-9461-1ad3b6b993b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:24.048155 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25a805-0ab4-4308-9461-1ad3b6b993b4 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:24.048633 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25a805-0ab4-4308-9461-1ad3b6b993b4 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:24.049097 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25a805-0ab4-4308-9461-1ad3b6b993b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:24.061016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25a805-0ab4-4308-9461-1ad3b6b993b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:24.066121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-ac25a805-0ab4-4308-9461-1ad3b6b993b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:24.066121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:24.066121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:24.066121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:24.066121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:24.066121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:24.066121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:24.066121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:24.066121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:24.066121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:24.066121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:24.066121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:24.066121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:24.066121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:24.066121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:24.066121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:24.066987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:24.066987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:24.066987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:24.066987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:24.066987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:24.066987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:24.066987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:24.066987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:24.066987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:24.066987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:24.066987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:24.066987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:24.066987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:24.066987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:24.066987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:24.066987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:24.067775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:24.067775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:24.067775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:24.067775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:24.067775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:24.067775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:24.067775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:24.067775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:24.067775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:24.067775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:24.067775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:24.067775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:24.070060 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 107/211] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:24.076287 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ad84b-9001-46ee-928d-106ff8c40184 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:24.095673 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ccfd9-dc0b-409b-a05e-27cac91d74d8 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:24.096001 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ccfd9-dc0b-409b-a05e-27cac91d74d8 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:24.096221 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ccfd9-dc0b-409b-a05e-27cac91d74d8 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:24.097679 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 108/212] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:40:24.102655 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e97c2b-5f5c-407b-ab8a-493643363d40 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:24.103368 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e97c2b-5f5c-407b-ab8a-493643363d40 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:24.103865 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e97c2b-5f5c-407b-ab8a-493643363d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:24.125561 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-46e97c2b-5f5c-407b-ab8a-493643363d40 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:24.127170 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-46e97c2b-5f5c-407b-ab8a-493643363d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:24.145211 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:24.205548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ad84b-9001-46ee-928d-106ff8c40184 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:24.209424 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 109/213] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 09:40:24.240830 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e97c2b-5f5c-407b-ab8a-493643363d40 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:24.243001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fe776-6c65-4d9f-b2bb-ade96291c2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:24.243626 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fe776-6c65-4d9f-b2bb-ade96291c2ff None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:24.243903 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fe776-6c65-4d9f-b2bb-ade96291c2ff None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:24.244176 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fe776-6c65-4d9f-b2bb-ade96291c2ff None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:24.245174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fe776-6c65-4d9f-b2bb-ade96291c2ff None admin] RBAC: Adding query filter params (name=member) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:24.245479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fe776-6c65-4d9f-b2bb-ade96291c2ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:24.248401 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fe776-6c65-4d9f-b2bb-ade96291c2ff None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:24.259667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 105/214] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:24.265174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fe776-6c65-4d9f-b2bb-ade96291c2ff None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:24.329416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:24.365092 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e97c2b-5f5c-407b-ab8a-493643363d40 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:24.389517 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fe776-6c65-4d9f-b2bb-ade96291c2ff None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:24.402204 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bba0ed-b97d-425c-8860-ae8a1ec84e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:24.402838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bba0ed-b97d-425c-8860-ae8a1ec84e50 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:24.403111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bba0ed-b97d-425c-8860-ae8a1ec84e50 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:24.403542 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bba0ed-b97d-425c-8860-ae8a1ec84e50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:24.405234 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bba0ed-b97d-425c-8860-ae8a1ec84e50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:24.406987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bba0ed-b97d-425c-8860-ae8a1ec84e50 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:24.408591 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 110/215] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:40:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:24.411857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3d354-cffe-464a-8782-915df35d2ab4 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:24.412621 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3d354-cffe-464a-8782-915df35d2ab4 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:24.413160 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3d354-cffe-464a-8782-915df35d2ab4 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:24.415155 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 111/216] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:24.419372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3d354-cffe-464a-8782-915df35d2ab4 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:24.429877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f07524-cb60-4591-b688-d98574f20a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:24.430913 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f07524-cb60-4591-b688-d98574f20a9d None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:24.431198 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f07524-cb60-4591-b688-d98574f20a9d None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:24.431469 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f07524-cb60-4591-b688-d98574f20a9d None admin] PATH_INFO: `/v3/users/01f459c52fe84c738db0528d4b4f7419` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:24.440981 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:24.448295 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f07524-cb60-4591-b688-d98574f20a9d None admin] RBAC: Authorizing `identity:get_user(user_id=01f459c52fe84c738db0528d4b4f7419)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:24.451297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f07524-cb60-4591-b688-d98574f20a9d None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:24.456003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 106/217] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:24 2022] GET /identity/v3/users/01f459c52fe84c738db0528d4b4f7419 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:24.456003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb66a74-ce98-4e12-8d2f-2076d4d0d38a None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:24.456003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb66a74-ce98-4e12-8d2f-2076d4d0d38a None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:24.456003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb66a74-ce98-4e12-8d2f-2076d4d0d38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:24.471698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-bfb66a74-ce98-4e12-8d2f-2076d4d0d38a None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:24.472884 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-bfb66a74-ce98-4e12-8d2f-2076d4d0d38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:24.532494 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3d354-cffe-464a-8782-915df35d2ab4 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:24.539300 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 107/218] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:24.540048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb66a74-ce98-4e12-8d2f-2076d4d0d38a None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:24.568445 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2d438-6909-4d1c-a1ac-56069ccbd586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:24.569056 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2d438-6909-4d1c-a1ac-56069ccbd586 None admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:24.569328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2d438-6909-4d1c-a1ac-56069ccbd586 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:24.569595 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2d438-6909-4d1c-a1ac-56069ccbd586 None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:24.570273 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2d438-6909-4d1c-a1ac-56069ccbd586 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:24.571726 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2d438-6909-4d1c-a1ac-56069ccbd586 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:24.588396 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:24.639848 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb66a74-ce98-4e12-8d2f-2076d4d0d38a None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:24.673692 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ad1ae-b947-4a7e-857a-17fe24b08a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:24.674342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ad1ae-b947-4a7e-857a-17fe24b08a11 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:24.674611 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ad1ae-b947-4a7e-857a-17fe24b08a11 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:24.674875 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ad1ae-b947-4a7e-857a-17fe24b08a11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:24.690767 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 112/219] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Aug 11 09:40:24 2022] POST /identity/v3/users => generated 297 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:40:24.690767 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d86083-9516-496f-b807-24f0ddc22303 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:24.690767 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d86083-9516-496f-b807-24f0ddc22303 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:24.690767 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d86083-9516-496f-b807-24f0ddc22303 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:24.690767 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 113/220] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:24.690767 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d86083-9516-496f-b807-24f0ddc22303 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:24.755442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ad1ae-b947-4a7e-857a-17fe24b08a11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:24.756989 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ad1ae-b947-4a7e-857a-17fe24b08a11 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:24.780289 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:24.808006 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:24.809429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d86083-9516-496f-b807-24f0ddc22303 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:24.851018 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb8860-584b-403d-93ae-411886857bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:24.851662 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb8860-584b-403d-93ae-411886857bea None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:24.852049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb8860-584b-403d-93ae-411886857bea None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:24.852329 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb8860-584b-403d-93ae-411886857bea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:24.872056 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb8860-584b-403d-93ae-411886857bea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:24.875132 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 108/221] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:40:24.880013 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46062d-eca2-40b5-a891-89d37351e273 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:24.880013 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46062d-eca2-40b5-a891-89d37351e273 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:24.880013 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46062d-eca2-40b5-a891-89d37351e273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:24.880279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-b0cb8860-584b-403d-93ae-411886857bea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:40:24.880279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:24.880279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:24.880279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:24.880279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:24.880279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:24.880279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:24.880279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:24.880279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:24.880279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:24.880279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:24.880279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:24.880279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:24.880279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:24.880279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:24.880279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:24.881092 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:24.881092 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:24.881092 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:24.881092 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:24.881092 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:24.881092 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:24.881092 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:24.881092 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:24.881092 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:24.881092 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:24.881092 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:24.881092 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:24.881092 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:24.881092 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:24.881092 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:24.881092 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:24.881864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:24.881864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:24.881864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:24.881864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:24.881864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:24.881864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:24.881864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:24.881864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:24.881864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:24.881864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:24.881864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:40:24.881864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:24.881864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 114/222] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:40:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:24.884929 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb8860-584b-403d-93ae-411886857bea None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:24.899745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-de46062d-eca2-40b5-a891-89d37351e273 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:24.900938 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-de46062d-eca2-40b5-a891-89d37351e273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:24.989165 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 109/223] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:24.990174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46062d-eca2-40b5-a891-89d37351e273 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:25.010586 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb8860-584b-403d-93ae-411886857bea None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:25.050812 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc06f5-1f43-4011-aea3-5b7db141a27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:25.051452 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc06f5-1f43-4011-aea3-5b7db141a27b None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:25.051730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc06f5-1f43-4011-aea3-5b7db141a27b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:25.052004 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc06f5-1f43-4011-aea3-5b7db141a27b None admin] PATH_INFO: `/v3/projects/99fc3f2cb288430c9a330338644185b3` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:25.053171 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc06f5-1f43-4011-aea3-5b7db141a27b None admin] RBAC: Authorizing `identity:get_project(project_id=99fc3f2cb288430c9a330338644185b3)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:25.055412 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc06f5-1f43-4011-aea3-5b7db141a27b None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:25.057249 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 115/224] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:24 2022] GET /identity/v3/projects/99fc3f2cb288430c9a330338644185b3 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:25.057857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc06f5-1f43-4011-aea3-5b7db141a27b None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:25.065555 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:25.086795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:25.119105 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46062d-eca2-40b5-a891-89d37351e273 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:25.155239 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d2909-873b-43a9-b498-1d45e01ac05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:25.155917 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d2909-873b-43a9-b498-1d45e01ac05d None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:25.156199 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d2909-873b-43a9-b498-1d45e01ac05d None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:25.156470 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d2909-873b-43a9-b498-1d45e01ac05d None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:25.157197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d2909-873b-43a9-b498-1d45e01ac05d None admin] RBAC: Adding query filter params (name=admin) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:25.157507 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d2909-873b-43a9-b498-1d45e01ac05d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:25.158970 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d2909-873b-43a9-b498-1d45e01ac05d None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:25.167597 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 110/225] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:25.168425 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d2909-873b-43a9-b498-1d45e01ac05d None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:25.189396 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc06f5-1f43-4011-aea3-5b7db141a27b None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:25.230788 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c18676-0843-4970-879c-e9da057c4830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:25.231479 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c18676-0843-4970-879c-e9da057c4830 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:25.232005 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c18676-0843-4970-879c-e9da057c4830 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:25.232279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c18676-0843-4970-879c-e9da057c4830 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:25.245630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c18676-0843-4970-879c-e9da057c4830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:25.252122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-d3c18676-0843-4970-879c-e9da057c4830 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:25.252122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:25.252122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:25.252122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:25.252122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:25.252122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:25.252122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:25.252122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:25.252122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:25.252122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:25.252122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:25.252122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:25.252122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:25.252122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:25.252122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:25.252122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:25.253013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:25.253013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:25.253013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:25.253013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:25.253013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:25.253013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:25.253013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:25.253013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:25.253013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:25.253013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:25.253013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:25.253013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:25.253013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:25.253013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:25.253013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:25.253013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:25.253809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:25.253809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:25.253809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:25.253809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:25.253809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:25.253809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:25.253809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:25.253809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:25.253809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:25.253809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:25.253809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:25.253809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:25.258157 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 116/226] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Aug 11 09:40:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:25.259254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c18676-0843-4970-879c-e9da057c4830 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:25.292311 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d2909-873b-43a9-b498-1d45e01ac05d None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:25.330776 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f06fea-0dcb-468a-9652-5fa030e4b8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:25.331294 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f06fea-0dcb-468a-9652-5fa030e4b8e4 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:25.331567 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f06fea-0dcb-468a-9652-5fa030e4b8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:25.331833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f06fea-0dcb-468a-9652-5fa030e4b8e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:25.332648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f06fea-0dcb-468a-9652-5fa030e4b8e4 None admin] RBAC: Adding query filter params (role.id=9b9c9f22f65c459bacd757d5de4d5b8e, scope.project.id=99fc3f2cb288430c9a330338644185b3, user.id=01f459c52fe84c738db0528d4b4f7419) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:25.332952 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f06fea-0dcb-468a-9652-5fa030e4b8e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:25.334606 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f06fea-0dcb-468a-9652-5fa030e4b8e4 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:25.336033 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:25.338895 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:25.342510 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 111/227] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:40:25 2022] GET /identity/v3/role_assignments?user.id=01f459c52fe84c738db0528d4b4f7419&scope.project.id=99fc3f2cb288430c9a330338644185b3&role.id=9b9c9f22f65c459bacd757d5de4d5b8e => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:25.343114 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f06fea-0dcb-468a-9652-5fa030e4b8e4 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:25.400376 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c18676-0843-4970-879c-e9da057c4830 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:25.464620 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc63bf-0302-4be9-9c39-fce6691261a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:25.465699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc63bf-0302-4be9-9c39-fce6691261a7 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:25.466761 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc63bf-0302-4be9-9c39-fce6691261a7 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:25.467250 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc63bf-0302-4be9-9c39-fce6691261a7 None admin] PATH_INFO: `/v3/users/2cbdadb1ca7145cebccb624e06115920` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:25.468974 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc63bf-0302-4be9-9c39-fce6691261a7 None admin] RBAC: Authorizing `identity:get_user(user_id=2cbdadb1ca7145cebccb624e06115920)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:25.470837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc63bf-0302-4be9-9c39-fce6691261a7 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:25.473625 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 117/228] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:25 2022] GET /identity/v3/users/2cbdadb1ca7145cebccb624e06115920 => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:25.479643 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc63bf-0302-4be9-9c39-fce6691261a7 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:25.554177 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f06fea-0dcb-468a-9652-5fa030e4b8e4 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:25.595670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14345da9-6654-4781-88a0-81e5d36eaf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:25.596197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14345da9-6654-4781-88a0-81e5d36eaf3b None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:25.596471 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14345da9-6654-4781-88a0-81e5d36eaf3b None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:25.596738 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14345da9-6654-4781-88a0-81e5d36eaf3b None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:25.597401 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14345da9-6654-4781-88a0-81e5d36eaf3b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:25.597695 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14345da9-6654-4781-88a0-81e5d36eaf3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:25.599117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14345da9-6654-4781-88a0-81e5d36eaf3b None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:25.608210 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 112/229] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:40:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:25.613517 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14345da9-6654-4781-88a0-81e5d36eaf3b None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:25.625588 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc63bf-0302-4be9-9c39-fce6691261a7 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:25.677266 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:25.683650 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3da9f5-eaea-400c-b9b6-0e37581850b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:25.685121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3da9f5-eaea-400c-b9b6-0e37581850b9 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:25.685604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3da9f5-eaea-400c-b9b6-0e37581850b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:25.686006 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3da9f5-eaea-400c-b9b6-0e37581850b9 None admin] PATH_INFO: `/v3/projects/99fc3f2cb288430c9a330338644185b3` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:25.687306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3da9f5-eaea-400c-b9b6-0e37581850b9 None admin] RBAC: Authorizing `identity:get_project(project_id=99fc3f2cb288430c9a330338644185b3)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:25.689144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3da9f5-eaea-400c-b9b6-0e37581850b9 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:25.690471 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:25.691467 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 118/230] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:25 2022] GET /identity/v3/projects/99fc3f2cb288430c9a330338644185b3 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:25.697872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3da9f5-eaea-400c-b9b6-0e37581850b9 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:25.769911 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14345da9-6654-4781-88a0-81e5d36eaf3b None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:25.838636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf942808-0894-417a-85c8-df7f23f47759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:25.839504 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf942808-0894-417a-85c8-df7f23f47759 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:25.839780 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf942808-0894-417a-85c8-df7f23f47759 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:25.840043 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf942808-0894-417a-85c8-df7f23f47759 None admin] PATH_INFO: `/v3/users/2cbdadb1ca7145cebccb624e06115920` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:25.841311 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf942808-0894-417a-85c8-df7f23f47759 None admin] RBAC: Authorizing `identity:get_user(user_id=2cbdadb1ca7145cebccb624e06115920)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:25.844096 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf942808-0894-417a-85c8-df7f23f47759 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:25.848275 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 113/231] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:25 2022] GET /identity/v3/users/2cbdadb1ca7145cebccb624e06115920 => generated 283 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:25.855190 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf942808-0894-417a-85c8-df7f23f47759 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:25.891859 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3da9f5-eaea-400c-b9b6-0e37581850b9 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:25.976273 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e36ff3-b68c-4005-99f8-ac185e3468be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:25.976948 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e36ff3-b68c-4005-99f8-ac185e3468be None admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:25.977270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e36ff3-b68c-4005-99f8-ac185e3468be None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:25.977548 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e36ff3-b68c-4005-99f8-ac185e3468be None admin] PATH_INFO: `/v3/projects/99fc3f2cb288430c9a330338644185b3/users/2cbdadb1ca7145cebccb624e06115920/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:25.979509 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e36ff3-b68c-4005-99f8-ac185e3468be None admin] RBAC: Authorizing `identity:create_grant(project_id=99fc3f2cb288430c9a330338644185b3, user_id=2cbdadb1ca7145cebccb624e06115920, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:25.980975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e36ff3-b68c-4005-99f8-ac185e3468be None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:25.989315 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf942808-0894-417a-85c8-df7f23f47759 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:26.025760 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:26.027943 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156926e-db89-408e-9dd4-5ca25deef16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:26.028582 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156926e-db89-408e-9dd4-5ca25deef16e None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:26.028943 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156926e-db89-408e-9dd4-5ca25deef16e None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:26.029209 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156926e-db89-408e-9dd4-5ca25deef16e None admin] PATH_INFO: `/v3/projects/99fc3f2cb288430c9a330338644185b3` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:26.030403 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156926e-db89-408e-9dd4-5ca25deef16e None admin] RBAC: Authorizing `identity:get_project(project_id=99fc3f2cb288430c9a330338644185b3)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:26.032867 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156926e-db89-408e-9dd4-5ca25deef16e None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:26.033613 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 114/232] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:25 2022] GET /identity/v3/projects/99fc3f2cb288430c9a330338644185b3 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:26.039532 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156926e-db89-408e-9dd4-5ca25deef16e None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:26.062620 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 119/233] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Aug 11 09:40:25 2022] PUT /identity/v3/projects/99fc3f2cb288430c9a330338644185b3/users/2cbdadb1ca7145cebccb624e06115920/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:40:26.152659 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156926e-db89-408e-9dd4-5ca25deef16e None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:26.193813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c2660-ca77-4000-88c6-e2576aab2acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:26.194690 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c2660-ca77-4000-88c6-e2576aab2acc None admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:26.195030 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c2660-ca77-4000-88c6-e2576aab2acc None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:26.195402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c2660-ca77-4000-88c6-e2576aab2acc None admin] PATH_INFO: `/v3/projects/99fc3f2cb288430c9a330338644185b3/users/2cbdadb1ca7145cebccb624e06115920/roles/da3ceb6dfa1746f19dbaf26e2c3ef7ab` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:26.200052 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c2660-ca77-4000-88c6-e2576aab2acc None admin] RBAC: Authorizing `identity:create_grant(project_id=99fc3f2cb288430c9a330338644185b3, user_id=2cbdadb1ca7145cebccb624e06115920, role_id=da3ceb6dfa1746f19dbaf26e2c3ef7ab)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:26.201661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c2660-ca77-4000-88c6-e2576aab2acc None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:26.302120 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 115/234] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Aug 11 09:40:26 2022] PUT /identity/v3/projects/99fc3f2cb288430c9a330338644185b3/users/2cbdadb1ca7145cebccb624e06115920/roles/da3ceb6dfa1746f19dbaf26e2c3ef7ab => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:40:27.019724 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a56ed-f0bf-471c-bd3b-141c6f9c6c1d None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:27.020214 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a56ed-f0bf-471c-bd3b-141c6f9c6c1d None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:27.020214 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a56ed-f0bf-471c-bd3b-141c6f9c6c1d None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:27.022195 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 120/235] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:27.027604 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9a936-88dd-471e-8db0-04749f1bb4c5 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:27.027884 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9a936-88dd-471e-8db0-04749f1bb4c5 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:27.028712 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9a936-88dd-471e-8db0-04749f1bb4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:27.049935 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-1df9a936-88dd-471e-8db0-04749f1bb4c5 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:27.051149 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-1df9a936-88dd-471e-8db0-04749f1bb4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:27.122370 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:27.135572 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 116/236] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:27.158296 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a56ed-f0bf-471c-bd3b-141c6f9c6c1d None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:27.195590 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b17da-61ab-4eda-ba7f-90ca49f9a18e None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:27.195913 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b17da-61ab-4eda-ba7f-90ca49f9a18e None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:27.196138 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b17da-61ab-4eda-ba7f-90ca49f9a18e None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:27.197650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 117/237] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:27.220582 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b9b82-e385-4723-8cdc-a30aff84072f None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:27.220931 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b9b82-e385-4723-8cdc-a30aff84072f None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:27.221126 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b9b82-e385-4723-8cdc-a30aff84072f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:27.230440 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:27.251340 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-c28b9b82-e385-4723-8cdc-a30aff84072f None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:27.252533 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-c28b9b82-e385-4723-8cdc-a30aff84072f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:27.285663 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a56ed-f0bf-471c-bd3b-141c6f9c6c1d None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:27.355040 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51bc15-dc7a-432b-abf9-9e86060c73f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:27.355672 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51bc15-dc7a-432b-abf9-9e86060c73f7 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:27.355946 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51bc15-dc7a-432b-abf9-9e86060c73f7 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:27.356253 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51bc15-dc7a-432b-abf9-9e86060c73f7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:27.375616 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51bc15-dc7a-432b-abf9-9e86060c73f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:27.384621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 118/238] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 09:40:27.385334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-dc51bc15-dc7a-432b-abf9-9e86060c73f7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 09:40:27.385334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:27.385334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:27.385334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:27.385334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:27.385334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:27.385334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:27.385334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:27.385334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:27.385334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:27.385334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:27.385334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:27.385334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:27.385334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:27.385334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:27.385334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:27.386213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:27.386213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:27.386213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:27.386213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:27.386213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:27.386213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:27.386213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:27.386213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:27.386213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:27.386213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:27.386213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:27.386213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:27.386213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:27.386213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:27.386213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:27.386213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:27.388157 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:27.388157 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:27.388157 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:27.388157 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:27.388157 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:27.388157 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:27.388157 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:27.388157 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:27.388157 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:27.388157 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:27.388157 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 09:40:27.388157 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:27.388157 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 121/239] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:27.399191 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b9b82-e385-4723-8cdc-a30aff84072f None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:27.410336 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51bc15-dc7a-432b-abf9-9e86060c73f7 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:27.569243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51bc15-dc7a-432b-abf9-9e86060c73f7 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:27.586938 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b9b82-e385-4723-8cdc-a30aff84072f None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:27.587662 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:27.613595 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5daa3d-d2f7-44b7-962f-92bae2d235b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:27.614661 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5daa3d-d2f7-44b7-962f-92bae2d235b1 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:27.615172 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5daa3d-d2f7-44b7-962f-92bae2d235b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:27.615641 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5daa3d-d2f7-44b7-962f-92bae2d235b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:27.622688 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:27.622846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5daa3d-d2f7-44b7-962f-92bae2d235b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:27.622846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5daa3d-d2f7-44b7-962f-92bae2d235b1 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:27.623951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 122/240] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:40:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:27.631311 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5daa3d-d2f7-44b7-962f-92bae2d235b1 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:27.649966 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e907c6-aeca-4357-aabf-e42e3cb99157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:27.650668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e907c6-aeca-4357-aabf-e42e3cb99157 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:27.650927 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e907c6-aeca-4357-aabf-e42e3cb99157 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:27.651196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e907c6-aeca-4357-aabf-e42e3cb99157 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:27.654650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e907c6-aeca-4357-aabf-e42e3cb99157 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:27.654650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e907c6-aeca-4357-aabf-e42e3cb99157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:27.656265 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e907c6-aeca-4357-aabf-e42e3cb99157 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:27.672465 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 119/241] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:27.677824 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e907c6-aeca-4357-aabf-e42e3cb99157 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:27.833785 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e907c6-aeca-4357-aabf-e42e3cb99157 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:27.842320 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5daa3d-d2f7-44b7-962f-92bae2d235b1 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:27.877624 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf6d7a-81e5-482a-ba40-13bdffcfab45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:27.878287 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf6d7a-81e5-482a-ba40-13bdffcfab45 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:27.878560 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf6d7a-81e5-482a-ba40-13bdffcfab45 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:27.878826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf6d7a-81e5-482a-ba40-13bdffcfab45 None admin] PATH_INFO: `/v3/users/d750b586fdde485f8d6872c4c0d62b0f` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:27.896170 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf6d7a-81e5-482a-ba40-13bdffcfab45 None admin] RBAC: Authorizing `identity:get_user(user_id=d750b586fdde485f8d6872c4c0d62b0f)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:27.897610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf6d7a-81e5-482a-ba40-13bdffcfab45 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:27.897831 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b7481-9cb2-4f77-b3fb-604307d4e887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:27.898700 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b7481-9cb2-4f77-b3fb-604307d4e887 None admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:27.899175 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b7481-9cb2-4f77-b3fb-604307d4e887 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:27.899296 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 120/242] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:27 2022] GET /identity/v3/users/d750b586fdde485f8d6872c4c0d62b0f => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:27.906201 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b2402-ebb7-4cd1-b42b-306ca84f3f51 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:27.906201 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b2402-ebb7-4cd1-b42b-306ca84f3f51 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:27.906201 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b2402-ebb7-4cd1-b42b-306ca84f3f51 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:27.906201 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 121/243] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:27.906515 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b7481-9cb2-4f77-b3fb-604307d4e887 None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:27.906515 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b7481-9cb2-4f77-b3fb-604307d4e887 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:27.906664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b2402-ebb7-4cd1-b42b-306ca84f3f51 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:27.907047 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b7481-9cb2-4f77-b3fb-604307d4e887 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:27.955151 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:27.990966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 123/244] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Aug 11 09:40:27 2022] POST /identity/v3/users => generated 293 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 09:40:27.993134 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d23ba-edd6-4e19-b4c9-95c797dde7ad None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:27.994067 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d23ba-edd6-4e19-b4c9-95c797dde7ad None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:27.994498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d23ba-edd6-4e19-b4c9-95c797dde7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:28.021450 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-242d23ba-edd6-4e19-b4c9-95c797dde7ad None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:28.022926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-242d23ba-edd6-4e19-b4c9-95c797dde7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:28.061544 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b2402-ebb7-4cd1-b42b-306ca84f3f51 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:28.071820 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:28.112598 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 124/245] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:28.144346 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6ca16-a44a-4eb3-b85b-d0e06cea7abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:28.145015 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6ca16-a44a-4eb3-b85b-d0e06cea7abe None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:28.145293 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6ca16-a44a-4eb3-b85b-d0e06cea7abe None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:28.145620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6ca16-a44a-4eb3-b85b-d0e06cea7abe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:28.149744 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d23ba-edd6-4e19-b4c9-95c797dde7ad None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:28.229607 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6ca16-a44a-4eb3-b85b-d0e06cea7abe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:28.231285 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6ca16-a44a-4eb3-b85b-d0e06cea7abe None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:28.266724 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d23ba-edd6-4e19-b4c9-95c797dde7ad None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:28.272670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:28.309337 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520736e-a447-4fc2-937a-143771d8eff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:28.310377 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520736e-a447-4fc2-937a-143771d8eff2 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:28.310850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520736e-a447-4fc2-937a-143771d8eff2 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:28.311310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520736e-a447-4fc2-937a-143771d8eff2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:28.322867 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520736e-a447-4fc2-937a-143771d8eff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:28.328729 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-3520736e-a447-4fc2-937a-143771d8eff2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:28.328729 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:28.328729 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:28.328729 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:28.328729 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:28.328729 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:28.328729 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:28.328729 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:28.328729 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:28.328729 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:28.328729 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:28.328729 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:28.328729 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:28.328729 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:28.328729 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:28.328729 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:28.329615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:28.329615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:28.329615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:28.329615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:28.329615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:28.329615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:28.329615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:28.329615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:28.329615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:28.329615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:28.329615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:28.329615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:28.329615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:28.329615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:28.329615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:28.329615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:28.330454 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:28.330454 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:28.330454 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:28.330454 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:28.330454 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:28.330454 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:28.330454 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:28.330454 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:28.330454 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:28.330454 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:28.330454 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:28.330454 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:28.333161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 125/246] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:40:28.338450 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520736e-a447-4fc2-937a-143771d8eff2 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:28.343226 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 122/247] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:40:28.348758 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6ca16-a44a-4eb3-b85b-d0e06cea7abe None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:28.375240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:28.452480 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6ca16-a44a-4eb3-b85b-d0e06cea7abe None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:28.453355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520736e-a447-4fc2-937a-143771d8eff2 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:28.490739 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f55f1-5d3e-4ba9-9b2e-4606db5adf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:28.491542 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f55f1-5d3e-4ba9-9b2e-4606db5adf7b None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:28.491998 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f55f1-5d3e-4ba9-9b2e-4606db5adf7b None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:28.492378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f55f1-5d3e-4ba9-9b2e-4606db5adf7b None admin] PATH_INFO: `/v3/projects/99fc3f2cb288430c9a330338644185b3` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:28.493615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f55f1-5d3e-4ba9-9b2e-4606db5adf7b None admin] RBAC: Authorizing `identity:get_project(project_id=99fc3f2cb288430c9a330338644185b3)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:28.493875 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8a1a0-a700-4cb6-943d-cdb301ecf4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:28.494798 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8a1a0-a700-4cb6-943d-cdb301ecf4a8 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:28.495260 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f55f1-5d3e-4ba9-9b2e-4606db5adf7b None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:28.495430 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8a1a0-a700-4cb6-943d-cdb301ecf4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:28.495857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8a1a0-a700-4cb6-943d-cdb301ecf4a8 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:28.496699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8a1a0-a700-4cb6-943d-cdb301ecf4a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:28.497200 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8a1a0-a700-4cb6-943d-cdb301ecf4a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:28.497477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 123/248] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:28 2022] GET /identity/v3/projects/99fc3f2cb288430c9a330338644185b3 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:28.499090 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8a1a0-a700-4cb6-943d-cdb301ecf4a8 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:28.503044 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f55f1-5d3e-4ba9-9b2e-4606db5adf7b None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:28.509117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 126/249] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:28.513627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:28.516576 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8a1a0-a700-4cb6-943d-cdb301ecf4a8 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:28.616146 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f55f1-5d3e-4ba9-9b2e-4606db5adf7b None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:28.629728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:28.646107 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8a1a0-a700-4cb6-943d-cdb301ecf4a8 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:28.666693 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea09dd8-339c-4876-942c-426a812d1137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:28.667402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea09dd8-339c-4876-942c-426a812d1137 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:28.671989 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea09dd8-339c-4876-942c-426a812d1137 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:28.671989 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea09dd8-339c-4876-942c-426a812d1137 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:28.671989 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea09dd8-339c-4876-942c-426a812d1137 None admin] RBAC: Adding query filter params (role.id=5ec51441676c42e7b6a3026a449dade7, scope.project.id=99fc3f2cb288430c9a330338644185b3, user.id=d750b586fdde485f8d6872c4c0d62b0f) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:28.671989 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea09dd8-339c-4876-942c-426a812d1137 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:28.671989 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea09dd8-339c-4876-942c-426a812d1137 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:28.681390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 124/250] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:40:28 2022] GET /identity/v3/role_assignments?user.id=d750b586fdde485f8d6872c4c0d62b0f&scope.project.id=99fc3f2cb288430c9a330338644185b3&role.id=5ec51441676c42e7b6a3026a449dade7 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:28.683893 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a5220-b568-45c2-9cf0-ce2556c24610 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:28.684018 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a5220-b568-45c2-9cf0-ce2556c24610 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:28.684922 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a5220-b568-45c2-9cf0-ce2556c24610 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:28.691187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 125/251] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:28.692838 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3a083-711f-46fa-a6ac-db33a9db7fb3 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:28.693120 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3a083-711f-46fa-a6ac-db33a9db7fb3 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:28.693388 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3a083-711f-46fa-a6ac-db33a9db7fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:28.698139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68b5d6-e2e9-45be-83aa-8b217743aec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:28.699182 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68b5d6-e2e9-45be-83aa-8b217743aec7 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:28.699655 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68b5d6-e2e9-45be-83aa-8b217743aec7 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:28.700666 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68b5d6-e2e9-45be-83aa-8b217743aec7 None admin] PATH_INFO: `/v3/users/01f459c52fe84c738db0528d4b4f7419` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:28.704347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68b5d6-e2e9-45be-83aa-8b217743aec7 None admin] RBAC: Authorizing `identity:get_user(user_id=01f459c52fe84c738db0528d4b4f7419)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:28.706134 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68b5d6-e2e9-45be-83aa-8b217743aec7 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:28.709883 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 127/252] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:28 2022] GET /identity/v3/users/01f459c52fe84c738db0528d4b4f7419 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:28.716790 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68b5d6-e2e9-45be-83aa-8b217743aec7 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:28.719894 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-e9a3a083-711f-46fa-a6ac-db33a9db7fb3 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:28.721474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-e9a3a083-711f-46fa-a6ac-db33a9db7fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:28.882213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:28.887081 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 126/253] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:28.927866 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3a083-711f-46fa-a6ac-db33a9db7fb3 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:28.934987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68b5d6-e2e9-45be-83aa-8b217743aec7 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:28.992705 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c251ab7-645d-4c07-ac9f-f9fb6f410e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:28.993340 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c251ab7-645d-4c07-ac9f-f9fb6f410e4f None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:28.993611 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c251ab7-645d-4c07-ac9f-f9fb6f410e4f None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:28.993878 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c251ab7-645d-4c07-ac9f-f9fb6f410e4f None admin] PATH_INFO: `/v3/projects/99fc3f2cb288430c9a330338644185b3` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:28.995200 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c251ab7-645d-4c07-ac9f-f9fb6f410e4f None admin] RBAC: Authorizing `identity:get_project(project_id=99fc3f2cb288430c9a330338644185b3)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:28.996643 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c251ab7-645d-4c07-ac9f-f9fb6f410e4f None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:29.002387 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 128/254] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:28 2022] GET /identity/v3/projects/99fc3f2cb288430c9a330338644185b3 => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:29.008186 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c251ab7-645d-4c07-ac9f-f9fb6f410e4f None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:29.075058 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:29.098811 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3a083-711f-46fa-a6ac-db33a9db7fb3 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:29.139985 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c227653-beda-47e0-a897-8928151f9104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:29.140529 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c227653-beda-47e0-a897-8928151f9104 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:29.140804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c227653-beda-47e0-a897-8928151f9104 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:29.141094 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c227653-beda-47e0-a897-8928151f9104 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:29.163050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c227653-beda-47e0-a897-8928151f9104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:29.165176 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c251ab7-645d-4c07-ac9f-f9fb6f410e4f None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:29.168334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-1c227653-beda-47e0-a897-8928151f9104 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:40:29.168334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:29.168334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:29.168334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:29.168334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:29.168334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:29.168334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:29.168334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:29.168334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:29.168334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:29.168334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:29.168334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:29.168334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:29.168334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:29.168334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:29.168334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:29.169756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:29.169756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:29.169756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:29.169756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:29.169756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:29.169756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:29.169756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:29.169756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:29.169756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:29.169756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:29.169756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:29.169756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:29.169756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:29.169756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:29.169756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:29.169756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:29.170585 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:29.170585 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:29.170585 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:29.170585 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:29.170585 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:29.170585 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:29.170585 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:29.170585 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:29.170585 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:29.170585 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:29.170585 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:40:29.170585 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:40:29.170585 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 127/255] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:40:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:40:29.179256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df01d5e-acca-4e08-8af1-dc4ef32bdff4 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:29.179534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df01d5e-acca-4e08-8af1-dc4ef32bdff4 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:29.179813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df01d5e-acca-4e08-8af1-dc4ef32bdff4 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:29.181176 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 128/256] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:29 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:29.182159 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df01d5e-acca-4e08-8af1-dc4ef32bdff4 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:29.209218 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869149f-eded-4f16-a137-81bcf88dbd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:29.210294 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869149f-eded-4f16-a137-81bcf88dbd61 None admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:29.210776 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869149f-eded-4f16-a137-81bcf88dbd61 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:29.211420 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869149f-eded-4f16-a137-81bcf88dbd61 None admin] PATH_INFO: `/v3/projects/99fc3f2cb288430c9a330338644185b3/users/01f459c52fe84c738db0528d4b4f7419/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:29.216564 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869149f-eded-4f16-a137-81bcf88dbd61 None admin] RBAC: Authorizing `identity:create_grant(project_id=99fc3f2cb288430c9a330338644185b3, user_id=01f459c52fe84c738db0528d4b4f7419, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:29.218620 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869149f-eded-4f16-a137-81bcf88dbd61 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:29.278487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:29.313857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 129/257] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Aug 11 09:40:29 2022] PUT /identity/v3/projects/99fc3f2cb288430c9a330338644185b3/users/01f459c52fe84c738db0528d4b4f7419/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:40:29.315687 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0e0fa-f09d-4964-9388-969c2868d09d None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:29.316173 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0e0fa-f09d-4964-9388-969c2868d09d None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:29.316723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0e0fa-f09d-4964-9388-969c2868d09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:29.323677 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df01d5e-acca-4e08-8af1-dc4ef32bdff4 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:29.355628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-7bf0e0fa-f09d-4964-9388-969c2868d09d None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:29.358657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-7bf0e0fa-f09d-4964-9388-969c2868d09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:29.398516 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49f0d2-6b1d-4537-98c7-033d717889d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:29.399530 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49f0d2-6b1d-4537-98c7-033d717889d0 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:29.400055 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49f0d2-6b1d-4537-98c7-033d717889d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:29.400522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49f0d2-6b1d-4537-98c7-033d717889d0 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:29.401401 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49f0d2-6b1d-4537-98c7-033d717889d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:29.401970 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49f0d2-6b1d-4537-98c7-033d717889d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:29.404309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49f0d2-6b1d-4537-98c7-033d717889d0 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:29.419766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 129/258] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:29.426411 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49f0d2-6b1d-4537-98c7-033d717889d0 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:29.509398 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 130/259] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:29.544479 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0e0fa-f09d-4964-9388-969c2868d09d None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:29.569492 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:29.614716 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49f0d2-6b1d-4537-98c7-033d717889d0 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:29.647910 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:29.664127 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27616f-e583-44e7-8353-f7f89fa9e97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:29.664779 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27616f-e583-44e7-8353-f7f89fa9e97e None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:29.665056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27616f-e583-44e7-8353-f7f89fa9e97e None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:29.665326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27616f-e583-44e7-8353-f7f89fa9e97e None admin] PATH_INFO: `/v3/users/2cbdadb1ca7145cebccb624e06115920` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:29.666561 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27616f-e583-44e7-8353-f7f89fa9e97e None admin] RBAC: Authorizing `identity:get_user(user_id=2cbdadb1ca7145cebccb624e06115920)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:29.668392 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27616f-e583-44e7-8353-f7f89fa9e97e None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:29.671485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 130/260] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:29 2022] GET /identity/v3/users/2cbdadb1ca7145cebccb624e06115920 => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:29.677804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27616f-e583-44e7-8353-f7f89fa9e97e None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:29.754914 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0e0fa-f09d-4964-9388-969c2868d09d None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:29.839749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7982bbb-0ccc-4e15-b7d2-092671feb4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:29.840437 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7982bbb-0ccc-4e15-b7d2-092671feb4a9 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:29.841249 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7982bbb-0ccc-4e15-b7d2-092671feb4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:29.841514 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7982bbb-0ccc-4e15-b7d2-092671feb4a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:29.854944 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27616f-e583-44e7-8353-f7f89fa9e97e None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:29.863005 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7982bbb-0ccc-4e15-b7d2-092671feb4a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:29.868245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-c7982bbb-0ccc-4e15-b7d2-092671feb4a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:29.868245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:29.868245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:29.868245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:29.868245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:29.868245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:29.868245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:29.868245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:29.868245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:29.868245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:29.868245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:29.868245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:29.868245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:29.868245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:29.868245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:29.868245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:29.869111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:29.869111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:29.869111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:29.869111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:29.869111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:29.869111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:29.869111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:29.869111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:29.869111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:29.869111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:29.869111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:29.869111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:29.869111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:29.869111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:29.869111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:29.869111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:29.869878 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:29.869878 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:29.869878 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:29.869878 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:29.869878 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:29.869878 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:29.869878 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:29.869878 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:29.869878 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:29.869878 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:29.869878 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:29.869878 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:29.872418 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 131/261] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Aug 11 09:40:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:40:29.876867 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7982bbb-0ccc-4e15-b7d2-092671feb4a9 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:29.923736 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58a9d1-9b87-46c4-a4da-c1166edf8d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:29.924694 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58a9d1-9b87-46c4-a4da-c1166edf8d57 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:29.925176 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58a9d1-9b87-46c4-a4da-c1166edf8d57 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:29.925652 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58a9d1-9b87-46c4-a4da-c1166edf8d57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:30.037542 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:30.068728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:30.073426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7982bbb-0ccc-4e15-b7d2-092671feb4a9 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:30.091599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58a9d1-9b87-46c4-a4da-c1166edf8d57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:30.093147 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58a9d1-9b87-46c4-a4da-c1166edf8d57 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:30.138862 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bd117-9a5c-4964-8ee5-16fe57b8b05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:30.139546 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bd117-9a5c-4964-8ee5-16fe57b8b05a None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:30.140196 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bd117-9a5c-4964-8ee5-16fe57b8b05a None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:30.140477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bd117-9a5c-4964-8ee5-16fe57b8b05a None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:30.141140 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36bd117-9a5c-4964-8ee5-16fe57b8b05a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:30.141437 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36bd117-9a5c-4964-8ee5-16fe57b8b05a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:30.142997 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36bd117-9a5c-4964-8ee5-16fe57b8b05a None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:30.152415 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 132/262] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:40:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:30.158003 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bd117-9a5c-4964-8ee5-16fe57b8b05a None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:30.343050 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bd117-9a5c-4964-8ee5-16fe57b8b05a None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:30.347363 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 131/263] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 09:40:30.355175 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58a9d1-9b87-46c4-a4da-c1166edf8d57 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:30.403493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c3f46-8899-4d85-ba94-a0bd5bd1b38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:30.404644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c3f46-8899-4d85-ba94-a0bd5bd1b38b None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:30.405138 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c3f46-8899-4d85-ba94-a0bd5bd1b38b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:30.405594 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c3f46-8899-4d85-ba94-a0bd5bd1b38b None admin] PATH_INFO: `/v3/users/2cbdadb1ca7145cebccb624e06115920` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:30.407800 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c3f46-8899-4d85-ba94-a0bd5bd1b38b None admin] RBAC: Authorizing `identity:get_user(user_id=2cbdadb1ca7145cebccb624e06115920)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:30.409671 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c3f46-8899-4d85-ba94-a0bd5bd1b38b None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:30.411491 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 133/264] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:30 2022] GET /identity/v3/users/2cbdadb1ca7145cebccb624e06115920 => generated 283 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:30.417873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c3f46-8899-4d85-ba94-a0bd5bd1b38b None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:30.442110 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:30.533078 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:30.549933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58a9d1-9b87-46c4-a4da-c1166edf8d57 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:30.574156 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c3f46-8899-4d85-ba94-a0bd5bd1b38b None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:30.615557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932d852-c51b-48cf-af7f-105aafaabb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:30.616907 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932d852-c51b-48cf-af7f-105aafaabb00 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:30.617681 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932d852-c51b-48cf-af7f-105aafaabb00 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:30.618675 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932d852-c51b-48cf-af7f-105aafaabb00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:30.619459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539c341-26a7-44d0-934a-990ac421b01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:30.621142 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539c341-26a7-44d0-934a-990ac421b01d None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:30.622576 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539c341-26a7-44d0-934a-990ac421b01d None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:30.623039 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539c341-26a7-44d0-934a-990ac421b01d None admin] PATH_INFO: `/v3/projects/99fc3f2cb288430c9a330338644185b3` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:30.627666 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539c341-26a7-44d0-934a-990ac421b01d None admin] RBAC: Authorizing `identity:get_project(project_id=99fc3f2cb288430c9a330338644185b3)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:30.629342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539c341-26a7-44d0-934a-990ac421b01d None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:30.636375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 132/265] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:30 2022] GET /identity/v3/projects/99fc3f2cb288430c9a330338644185b3 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:30.643217 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539c341-26a7-44d0-934a-990ac421b01d None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:30.761729 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932d852-c51b-48cf-af7f-105aafaabb00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:30.763299 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932d852-c51b-48cf-af7f-105aafaabb00 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:30.790434 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:30.841940 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539c341-26a7-44d0-934a-990ac421b01d None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:30.881377 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1804e5-cc30-4e97-9a5a-52de68e100dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:30.881905 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1804e5-cc30-4e97-9a5a-52de68e100dd None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:30.882214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1804e5-cc30-4e97-9a5a-52de68e100dd None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:30.882481 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1804e5-cc30-4e97-9a5a-52de68e100dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:30.885578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1804e5-cc30-4e97-9a5a-52de68e100dd None admin] RBAC: Adding query filter params (role.id=6aae1c66f3f04cec80ed72c20d7e033b, scope.project.id=99fc3f2cb288430c9a330338644185b3, user.id=2cbdadb1ca7145cebccb624e06115920) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:30.885887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1804e5-cc30-4e97-9a5a-52de68e100dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:30.887390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1804e5-cc30-4e97-9a5a-52de68e100dd None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:30.902039 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 133/266] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:40:30 2022] GET /identity/v3/role_assignments?user.id=2cbdadb1ca7145cebccb624e06115920&scope.project.id=99fc3f2cb288430c9a330338644185b3&role.id=6aae1c66f3f04cec80ed72c20d7e033b => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:30.940764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 134/267] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:40:30.946784 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1804e5-cc30-4e97-9a5a-52de68e100dd None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:30.992648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:31.087355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1804e5-cc30-4e97-9a5a-52de68e100dd None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:31.133276 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e081f9a-6a55-4cdf-990a-c0b180046770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:31.133832 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e081f9a-6a55-4cdf-990a-c0b180046770 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:31.134120 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e081f9a-6a55-4cdf-990a-c0b180046770 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:31.134395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e081f9a-6a55-4cdf-990a-c0b180046770 None admin] PATH_INFO: `/v3/projects/99fc3f2cb288430c9a330338644185b3` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:31.135597 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e081f9a-6a55-4cdf-990a-c0b180046770 None admin] RBAC: Authorizing `identity:get_project(project_id=99fc3f2cb288430c9a330338644185b3)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:31.137037 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e081f9a-6a55-4cdf-990a-c0b180046770 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:31.138962 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 134/268] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:30 2022] GET /identity/v3/projects/99fc3f2cb288430c9a330338644185b3 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:31.145209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932d852-c51b-48cf-af7f-105aafaabb00 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:31.275844 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932d852-c51b-48cf-af7f-105aafaabb00 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:31.287912 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:31.313001 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca16d2-85b8-48df-b133-c4001d2cf633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:31.313608 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca16d2-85b8-48df-b133-c4001d2cf633 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:31.313885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca16d2-85b8-48df-b133-c4001d2cf633 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:31.314178 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca16d2-85b8-48df-b133-c4001d2cf633 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:31.314908 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca16d2-85b8-48df-b133-c4001d2cf633 None admin] RBAC: Adding query filter params (role.id=da3ceb6dfa1746f19dbaf26e2c3ef7ab, scope.project.id=99fc3f2cb288430c9a330338644185b3, user.id=2cbdadb1ca7145cebccb624e06115920) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:31.315210 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca16d2-85b8-48df-b133-c4001d2cf633 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:31.316661 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca16d2-85b8-48df-b133-c4001d2cf633 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:31.324300 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 135/269] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:40:31 2022] GET /identity/v3/role_assignments?user.id=2cbdadb1ca7145cebccb624e06115920&scope.project.id=99fc3f2cb288430c9a330338644185b3&role.id=da3ceb6dfa1746f19dbaf26e2c3ef7ab => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:31.383565 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d5091-646a-4a92-ad19-c2e5bee130bb None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:31.383748 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d5091-646a-4a92-ad19-c2e5bee130bb None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:31.384022 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d5091-646a-4a92-ad19-c2e5bee130bb None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:31.385807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 135/270] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:31.390330 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c087b-5bbf-4a95-841f-aae866866dd5 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:31.390747 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c087b-5bbf-4a95-841f-aae866866dd5 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:31.391123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c087b-5bbf-4a95-841f-aae866866dd5 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:31.393125 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 136/271] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:31.396211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be013ee6-8322-4dd1-a88a-ec9e5a822151 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:31.396493 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be013ee6-8322-4dd1-a88a-ec9e5a822151 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:31.396765 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be013ee6-8322-4dd1-a88a-ec9e5a822151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:31.404775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b36dd0-a4ae-4217-9056-e7711adfbdfb None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:31.405052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b36dd0-a4ae-4217-9056-e7711adfbdfb None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:31.405321 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b36dd0-a4ae-4217-9056-e7711adfbdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:31.435342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-be013ee6-8322-4dd1-a88a-ec9e5a822151 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:31.436562 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-be013ee6-8322-4dd1-a88a-ec9e5a822151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:31.443225 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-b0b36dd0-a4ae-4217-9056-e7711adfbdfb None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:31.444450 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-b0b36dd0-a4ae-4217-9056-e7711adfbdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:31.534054 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 136/272] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:31.535308 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aeb576-05e6-4713-b618-21f6a4231dab None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:31.535591 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aeb576-05e6-4713-b618-21f6a4231dab None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:31.536197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aeb576-05e6-4713-b618-21f6a4231dab None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:31.537709 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 137/273] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:31.544171 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536d0c1-539b-4a1e-85de-cb390b0ad714 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:31.544307 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 137/274] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 11 09:40:31.544640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536d0c1-539b-4a1e-85de-cb390b0ad714 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:31.544960 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536d0c1-539b-4a1e-85de-cb390b0ad714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:31.562841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b36dd0-a4ae-4217-9056-e7711adfbdfb None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:31.570681 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-8536d0c1-539b-4a1e-85de-cb390b0ad714 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:31.571891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-8536d0c1-539b-4a1e-85de-cb390b0ad714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:31.589410 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:31.656520 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 138/275] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:31.657549 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536d0c1-539b-4a1e-85de-cb390b0ad714 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:31.718284 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b36dd0-a4ae-4217-9056-e7711adfbdfb None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:31.721497 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:31.752831 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8f2df-5e9f-4aa9-b79d-7ddfba7580b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:31.753867 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8f2df-5e9f-4aa9-b79d-7ddfba7580b5 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:31.754172 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8f2df-5e9f-4aa9-b79d-7ddfba7580b5 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:31.754761 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8f2df-5e9f-4aa9-b79d-7ddfba7580b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:31.766643 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8f2df-5e9f-4aa9-b79d-7ddfba7580b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:31.771345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-c8d8f2df-5e9f-4aa9-b79d-7ddfba7580b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:31.771345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:31.771345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:31.771345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:31.771345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:31.771345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:31.771345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:31.771345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:31.771345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:31.771345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:31.771345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:31.771345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:31.771345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:31.771345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:31.771345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:31.771345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:31.772223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:31.772223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:31.772223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:31.772223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:31.772223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:31.772223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:31.772223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:31.772223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:31.772223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:31.772223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:31.772223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:31.772223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:31.772223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:31.772223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:31.772223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:31.772223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:31.778181 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:31.778181 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:31.778181 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:31.778181 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:31.778181 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:31.778181 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:31.778181 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:31.778181 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:31.778181 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:31.778181 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:31.778181 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:31.778181 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:31.778181 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 138/276] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:31.778181 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8f2df-5e9f-4aa9-b79d-7ddfba7580b5 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:31.781171 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536d0c1-539b-4a1e-85de-cb390b0ad714 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:31.820646 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac2ce4-9166-412d-910d-5d5c033bf5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:31.821280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac2ce4-9166-412d-910d-5d5c033bf5e1 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:31.821554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac2ce4-9166-412d-910d-5d5c033bf5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:31.821828 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac2ce4-9166-412d-910d-5d5c033bf5e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:31.832805 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac2ce4-9166-412d-910d-5d5c033bf5e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:31.837408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-c4ac2ce4-9166-412d-910d-5d5c033bf5e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 09:40:31.837408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:31.837408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:31.837408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:31.837408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:31.837408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:31.837408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:31.837408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:31.837408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:31.837408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:31.837408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:31.837408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:31.837408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:31.837408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:31.837408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:31.837408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:31.838380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:31.838380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:31.838380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:31.838380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:31.838380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:31.838380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:31.838380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:31.838380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:31.838380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:31.838380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:31.838380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:31.838380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:31.838380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:31.838380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:31.838380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:31.838380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:31.844472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:31.844472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:31.844472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:31.844472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:31.844472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:31.844472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:31.844472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:31.844472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:31.844472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:31.844472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:31.844472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 09:40:31.844472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:40:31.844472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 139/277] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:31.844472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac2ce4-9166-412d-910d-5d5c033bf5e1 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:31.854730 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:31.880694 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8f2df-5e9f-4aa9-b79d-7ddfba7580b5 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:31.914907 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70088595-d48e-49c0-b385-eedb07a1a3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:31.915540 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70088595-d48e-49c0-b385-eedb07a1a3e4 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:31.915880 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70088595-d48e-49c0-b385-eedb07a1a3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:31.916153 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70088595-d48e-49c0-b385-eedb07a1a3e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:31.917243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70088595-d48e-49c0-b385-eedb07a1a3e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:31.919265 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70088595-d48e-49c0-b385-eedb07a1a3e4 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:31.920806 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 139/278] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:40:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:31.921965 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70088595-d48e-49c0-b385-eedb07a1a3e4 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:31.949449 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac2ce4-9166-412d-910d-5d5c033bf5e1 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:31.956424 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:31.985451 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c4f97-6be4-4395-a9ec-cb1e1bfb473d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:31.986049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c4f97-6be4-4395-a9ec-cb1e1bfb473d None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:31.986362 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c4f97-6be4-4395-a9ec-cb1e1bfb473d None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:31.986631 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c4f97-6be4-4395-a9ec-cb1e1bfb473d None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:31.987278 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c4f97-6be4-4395-a9ec-cb1e1bfb473d None admin] RBAC: Adding query filter params (name=member) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:31.987576 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c4f97-6be4-4395-a9ec-cb1e1bfb473d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:31.988945 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c4f97-6be4-4395-a9ec-cb1e1bfb473d None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:32.002027 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 140/279] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:32.002027 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c4f97-6be4-4395-a9ec-cb1e1bfb473d None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:32.030930 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70088595-d48e-49c0-b385-eedb07a1a3e4 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:32.067098 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32483260-0a12-4f71-b7ff-134a0c427aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:32.068112 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32483260-0a12-4f71-b7ff-134a0c427aeb None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:32.068590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32483260-0a12-4f71-b7ff-134a0c427aeb None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:32.069040 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32483260-0a12-4f71-b7ff-134a0c427aeb None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:32.069855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32483260-0a12-4f71-b7ff-134a0c427aeb None admin] RBAC: Adding query filter params (name=reader) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:32.070456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32483260-0a12-4f71-b7ff-134a0c427aeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:32.071135 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:32.072757 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32483260-0a12-4f71-b7ff-134a0c427aeb None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:32.085868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 140/280] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:32.086933 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32483260-0a12-4f71-b7ff-134a0c427aeb None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:32.100744 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c4f97-6be4-4395-a9ec-cb1e1bfb473d None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:32.135457 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4749dab-ce64-494a-899e-53163db537d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:32.136059 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4749dab-ce64-494a-899e-53163db537d5 None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:32.136333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4749dab-ce64-494a-899e-53163db537d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:32.136599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4749dab-ce64-494a-899e-53163db537d5 None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:32.137256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4749dab-ce64-494a-899e-53163db537d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:32.138717 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4749dab-ce64-494a-899e-53163db537d5 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:32.185198 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:32.191748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32483260-0a12-4f71-b7ff-134a0c427aeb None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:32.223928 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61098cb-0f2d-481e-b0cb-2ac79e74e6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:32.224549 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61098cb-0f2d-481e-b0cb-2ac79e74e6fc None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:32.224822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61098cb-0f2d-481e-b0cb-2ac79e74e6fc None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:32.225084 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61098cb-0f2d-481e-b0cb-2ac79e74e6fc None admin] PATH_INFO: `/v3/users/71881647a8264381977641374a1847d5` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:32.238905 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61098cb-0f2d-481e-b0cb-2ac79e74e6fc None admin] RBAC: Authorizing `identity:get_user(user_id=71881647a8264381977641374a1847d5)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:32.240366 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61098cb-0f2d-481e-b0cb-2ac79e74e6fc None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:32.241956 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 141/281] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:32 2022] GET /identity/v3/users/71881647a8264381977641374a1847d5 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:32.242744 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61098cb-0f2d-481e-b0cb-2ac79e74e6fc None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:32.254310 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 141/282] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Aug 11 09:40:31 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:40:32.255007 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4749dab-ce64-494a-899e-53163db537d5 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:32.374852 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4749dab-ce64-494a-899e-53163db537d5 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:32.398812 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61098cb-0f2d-481e-b0cb-2ac79e74e6fc None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:32.404571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:32.413351 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f0445-27bf-462c-ac5a-5877928b43d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:32.414007 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f0445-27bf-462c-ac5a-5877928b43d7 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:32.414277 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f0445-27bf-462c-ac5a-5877928b43d7 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:32.414662 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f0445-27bf-462c-ac5a-5877928b43d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:32.415453 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f0445-27bf-462c-ac5a-5877928b43d7 None admin] RBAC: Adding query filter params (role.id=9b9c9f22f65c459bacd757d5de4d5b8e, user.id=71881647a8264381977641374a1847d5, scope.system=all) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:32.415764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f0445-27bf-462c-ac5a-5877928b43d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:32.417215 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f0445-27bf-462c-ac5a-5877928b43d7 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:32.424582 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 142/283] 10.222.0.13 () {56 vars in 1308 bytes} [Thu Aug 11 09:40:32 2022] GET /identity/v3/role_assignments?user.id=71881647a8264381977641374a1847d5&scope.system=all&role.id=9b9c9f22f65c459bacd757d5de4d5b8e => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:32.425487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef960d6-9f88-405b-a779-3c395e794619 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:32.426464 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef960d6-9f88-405b-a779-3c395e794619 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:32.426464 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef960d6-9f88-405b-a779-3c395e794619 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:32.427422 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 143/284] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:32.436045 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891190e-13a1-4488-bc4c-a363e5d891f5 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:32.436272 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891190e-13a1-4488-bc4c-a363e5d891f5 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:32.436663 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891190e-13a1-4488-bc4c-a363e5d891f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:32.455356 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cb664-743b-4a92-be31-b75fcdb975d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:32.455949 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-d891190e-13a1-4488-bc4c-a363e5d891f5 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:32.456054 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cb664-743b-4a92-be31-b75fcdb975d4 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:32.456299 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cb664-743b-4a92-be31-b75fcdb975d4 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:32.456566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cb664-743b-4a92-be31-b75fcdb975d4 None admin] PATH_INFO: `/v3/users/d750b586fdde485f8d6872c4c0d62b0f` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:32.457199 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-d891190e-13a1-4488-bc4c-a363e5d891f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:32.457763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cb664-743b-4a92-be31-b75fcdb975d4 None admin] RBAC: Authorizing `identity:get_user(user_id=d750b586fdde485f8d6872c4c0d62b0f)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:32.459288 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cb664-743b-4a92-be31-b75fcdb975d4 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:32.460949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 142/285] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:32 2022] GET /identity/v3/users/d750b586fdde485f8d6872c4c0d62b0f => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:32.467426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cb664-743b-4a92-be31-b75fcdb975d4 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:32.492642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:32.555731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 144/286] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 09:40:32.580811 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891190e-13a1-4488-bc4c-a363e5d891f5 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:32.607039 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cb664-743b-4a92-be31-b75fcdb975d4 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:32.660009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4f974-4b96-44ff-8eb5-eb41dd46f390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:32.660914 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4f974-4b96-44ff-8eb5-eb41dd46f390 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:32.661463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4f974-4b96-44ff-8eb5-eb41dd46f390 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:32.661914 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4f974-4b96-44ff-8eb5-eb41dd46f390 None admin] PATH_INFO: `/v3/projects/99fc3f2cb288430c9a330338644185b3` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:32.663271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4f974-4b96-44ff-8eb5-eb41dd46f390 None admin] RBAC: Authorizing `identity:get_project(project_id=99fc3f2cb288430c9a330338644185b3)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:32.669676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4f974-4b96-44ff-8eb5-eb41dd46f390 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:32.669676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 143/287] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:32 2022] GET /identity/v3/projects/99fc3f2cb288430c9a330338644185b3 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:32.675757 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4f974-4b96-44ff-8eb5-eb41dd46f390 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:32.714462 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891190e-13a1-4488-bc4c-a363e5d891f5 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:32.751096 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:32.763566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c319f-9da1-49a1-9cda-d9eaf3120420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:32.767147 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c319f-9da1-49a1-9cda-d9eaf3120420 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:32.767147 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c319f-9da1-49a1-9cda-d9eaf3120420 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:32.767147 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c319f-9da1-49a1-9cda-d9eaf3120420 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:32.776238 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c319f-9da1-49a1-9cda-d9eaf3120420 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:32.778741 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:32.782124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-c01c319f-9da1-49a1-9cda-d9eaf3120420 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:32.782124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:32.782124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:32.782124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:32.782124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:32.782124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:32.782124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:32.782124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:32.782124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:32.782124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:32.782124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:32.782124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:32.782124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:32.782124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:32.782124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:32.782124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:32.782995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:32.782995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:32.782995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:32.782995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:32.782995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:32.782995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:32.782995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:32.782995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:32.782995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:32.782995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:32.782995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:32.782995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:32.782995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:32.782995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:32.782995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:32.782995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:32.783795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:32.783795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:32.783795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:32.783795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:32.783795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:32.783795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:32.783795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:32.783795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:32.783795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:32.783795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:32.783795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:32.783795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:40:32.783795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 145/288] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:40:32.790270 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c319f-9da1-49a1-9cda-d9eaf3120420 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:32.794686 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4f974-4b96-44ff-8eb5-eb41dd46f390 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:32.830482 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33fd79-6a89-4eb6-a9dd-74971e7e6597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:32.831152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33fd79-6a89-4eb6-a9dd-74971e7e6597 None admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:32.831433 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33fd79-6a89-4eb6-a9dd-74971e7e6597 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:32.831708 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33fd79-6a89-4eb6-a9dd-74971e7e6597 None admin] PATH_INFO: `/v3/projects/99fc3f2cb288430c9a330338644185b3/users/d750b586fdde485f8d6872c4c0d62b0f/roles/5ec51441676c42e7b6a3026a449dade7` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:32.833660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33fd79-6a89-4eb6-a9dd-74971e7e6597 None admin] RBAC: Authorizing `identity:create_grant(project_id=99fc3f2cb288430c9a330338644185b3, user_id=d750b586fdde485f8d6872c4c0d62b0f, role_id=5ec51441676c42e7b6a3026a449dade7)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:32.836018 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33fd79-6a89-4eb6-a9dd-74971e7e6597 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:32.907154 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 144/289] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Aug 11 09:40:32 2022] PUT /identity/v3/projects/99fc3f2cb288430c9a330338644185b3/users/d750b586fdde485f8d6872c4c0d62b0f/roles/5ec51441676c42e7b6a3026a449dade7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 09:40:32.941184 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c319f-9da1-49a1-9cda-d9eaf3120420 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:32.989464 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7538c8a-7377-4230-8553-5c0da2a3dc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:32.990008 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7538c8a-7377-4230-8553-5c0da2a3dc23 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:32.990380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7538c8a-7377-4230-8553-5c0da2a3dc23 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:32.990680 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7538c8a-7377-4230-8553-5c0da2a3dc23 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:32.991372 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7538c8a-7377-4230-8553-5c0da2a3dc23 None admin] RBAC: Adding query filter params (name=member) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:32.991686 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7538c8a-7377-4230-8553-5c0da2a3dc23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:32.993044 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7538c8a-7377-4230-8553-5c0da2a3dc23 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:33.003005 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 146/290] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:33.008753 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33fd79-6a89-4eb6-a9dd-74971e7e6597 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:33.142711 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33fd79-6a89-4eb6-a9dd-74971e7e6597 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:33.180435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6ef79-cd0a-4f2d-8e98-84d1f997094b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:33.181362 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6ef79-cd0a-4f2d-8e98-84d1f997094b None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:33.182185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6ef79-cd0a-4f2d-8e98-84d1f997094b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:33.182622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6ef79-cd0a-4f2d-8e98-84d1f997094b None admin] PATH_INFO: `/v3/users/01f459c52fe84c738db0528d4b4f7419` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:33.184533 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6ef79-cd0a-4f2d-8e98-84d1f997094b None admin] RBAC: Authorizing `identity:get_user(user_id=01f459c52fe84c738db0528d4b4f7419)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:33.186223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6ef79-cd0a-4f2d-8e98-84d1f997094b None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:33.188762 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 145/291] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:33 2022] GET /identity/v3/users/01f459c52fe84c738db0528d4b4f7419 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:33.194427 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7538c8a-7377-4230-8553-5c0da2a3dc23 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:33.242893 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:33.300510 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7538c8a-7377-4230-8553-5c0da2a3dc23 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:33.342865 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30278626-16f8-45bb-93ef-8b4b1d92fabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:33.343787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30278626-16f8-45bb-93ef-8b4b1d92fabd None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:33.344289 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30278626-16f8-45bb-93ef-8b4b1d92fabd None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:33.344756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30278626-16f8-45bb-93ef-8b4b1d92fabd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:33.433773 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30278626-16f8-45bb-93ef-8b4b1d92fabd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:33.436048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30278626-16f8-45bb-93ef-8b4b1d92fabd None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:33.493077 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:33.565357 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 147/292] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:40:33.571195 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6ef79-cd0a-4f2d-8e98-84d1f997094b None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:33.595576 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:33.714934 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6ef79-cd0a-4f2d-8e98-84d1f997094b None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:33.764896 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd406e-b45d-445d-a03f-e93e7cb83124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:33.765472 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd406e-b45d-445d-a03f-e93e7cb83124 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:33.765756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd406e-b45d-445d-a03f-e93e7cb83124 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:33.766031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd406e-b45d-445d-a03f-e93e7cb83124 None admin] PATH_INFO: `/v3/projects/99fc3f2cb288430c9a330338644185b3` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:33.767283 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd406e-b45d-445d-a03f-e93e7cb83124 None admin] RBAC: Authorizing `identity:get_project(project_id=99fc3f2cb288430c9a330338644185b3)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:33.768781 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd406e-b45d-445d-a03f-e93e7cb83124 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:33.770861 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 146/293] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:33 2022] GET /identity/v3/projects/99fc3f2cb288430c9a330338644185b3 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:33.776666 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30278626-16f8-45bb-93ef-8b4b1d92fabd None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:33.917114 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30278626-16f8-45bb-93ef-8b4b1d92fabd None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:33.967640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f99f63-6fb2-4728-b7dc-e433f58ddadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:33.968617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f99f63-6fb2-4728-b7dc-e433f58ddadd None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:33.969115 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f99f63-6fb2-4728-b7dc-e433f58ddadd None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:33.969573 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f99f63-6fb2-4728-b7dc-e433f58ddadd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:33.970504 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f99f63-6fb2-4728-b7dc-e433f58ddadd None admin] RBAC: Adding query filter params (role.id=9b9c9f22f65c459bacd757d5de4d5b8e, scope.project.id=99fc3f2cb288430c9a330338644185b3, user.id=01f459c52fe84c738db0528d4b4f7419) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:33.971001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f99f63-6fb2-4728-b7dc-e433f58ddadd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:33.972692 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f99f63-6fb2-4728-b7dc-e433f58ddadd None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:33.980606 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 148/294] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:40:33 2022] GET /identity/v3/role_assignments?user.id=01f459c52fe84c738db0528d4b4f7419&scope.project.id=99fc3f2cb288430c9a330338644185b3&role.id=9b9c9f22f65c459bacd757d5de4d5b8e => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:34.703263 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbf808-fd51-40ee-aae6-455245bfaf51 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:34.703760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbf808-fd51-40ee-aae6-455245bfaf51 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:34.703834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbf808-fd51-40ee-aae6-455245bfaf51 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:34.705141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 147/295] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:34.710258 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295f718-02de-4bb2-b890-804035c63279 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:34.710543 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295f718-02de-4bb2-b890-804035c63279 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:34.710817 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295f718-02de-4bb2-b890-804035c63279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:34.774115 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-2295f718-02de-4bb2-b890-804035c63279 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:34.775319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-2295f718-02de-4bb2-b890-804035c63279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:34.777360 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:34.845652 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 149/296] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:34.867517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbf808-fd51-40ee-aae6-455245bfaf51 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:34.959748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:34.976458 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbf808-fd51-40ee-aae6-455245bfaf51 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:34.986791 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ade69-5ce9-47f3-b13a-c91828451656 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:34.987508 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ade69-5ce9-47f3-b13a-c91828451656 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:34.987976 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ade69-5ce9-47f3-b13a-c91828451656 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:34.989491 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 150/297] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:34.994618 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6d7cd-3a47-4300-b1e0-0e1f214a3c52 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:34.995173 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6d7cd-3a47-4300-b1e0-0e1f214a3c52 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:34.995662 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6d7cd-3a47-4300-b1e0-0e1f214a3c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:35.015530 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd969256-3519-41ab-9cb1-793caf59fafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:35.016159 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd969256-3519-41ab-9cb1-793caf59fafc None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:35.016437 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd969256-3519-41ab-9cb1-793caf59fafc None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:35.016708 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd969256-3519-41ab-9cb1-793caf59fafc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:35.017600 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-3fb6d7cd-3a47-4300-b1e0-0e1f214a3c52 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:35.019124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-3fb6d7cd-3a47-4300-b1e0-0e1f214a3c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:35.027004 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd969256-3519-41ab-9cb1-793caf59fafc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:35.031749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-fd969256-3519-41ab-9cb1-793caf59fafc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 09:40:35.031749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:35.031749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:35.031749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:35.031749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:35.031749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:35.031749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:35.031749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:35.031749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:35.031749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:35.031749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:35.031749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:35.031749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:35.031749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:35.031749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:35.031749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:35.032642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:35.032642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:35.032642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:35.032642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:35.032642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:35.032642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:35.032642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:35.032642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:35.032642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:35.032642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:35.032642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:35.032642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:35.032642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:35.032642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:35.032642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:35.032642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:35.033907 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:35.033907 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:35.033907 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:35.033907 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:35.033907 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:35.033907 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:35.033907 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:35.033907 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:35.033907 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:35.033907 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:35.033907 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 09:40:35.033907 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:35.033907 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 148/298] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:35.034811 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cff1a4-c2ec-47e5-a4f6-99a1368e41d5 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:35.034811 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cff1a4-c2ec-47e5-a4f6-99a1368e41d5 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:35.034811 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cff1a4-c2ec-47e5-a4f6-99a1368e41d5 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:35.035991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 149/299] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:35.038855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cff1a4-c2ec-47e5-a4f6-99a1368e41d5 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:35.110102 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 151/300] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 09:40:35.110102 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387bcd5-d641-434c-93b9-5d0ec0a1e456 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:35.110102 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387bcd5-d641-434c-93b9-5d0ec0a1e456 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:35.110102 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387bcd5-d641-434c-93b9-5d0ec0a1e456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:35.129937 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-9387bcd5-d641-434c-93b9-5d0ec0a1e456 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:35.131169 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-9387bcd5-d641-434c-93b9-5d0ec0a1e456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:35.151490 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cff1a4-c2ec-47e5-a4f6-99a1368e41d5 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:35.186810 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9e9bd-8e68-445b-92e0-a073b216021a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:35.187444 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9e9bd-8e68-445b-92e0-a073b216021a None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:35.187732 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9e9bd-8e68-445b-92e0-a073b216021a None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:35.187992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9e9bd-8e68-445b-92e0-a073b216021a None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:35.188652 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9e9bd-8e68-445b-92e0-a073b216021a None admin] RBAC: Adding query filter params (name=reader) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:35.188949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9e9bd-8e68-445b-92e0-a073b216021a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:35.190348 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9e9bd-8e68-445b-92e0-a073b216021a None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:35.198792 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 150/301] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:35.199243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:35.203300 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9e9bd-8e68-445b-92e0-a073b216021a None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:35.205157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 152/302] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:35.205766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387bcd5-d641-434c-93b9-5d0ec0a1e456 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:35.214792 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:35.314074 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387bcd5-d641-434c-93b9-5d0ec0a1e456 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:35.320143 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9e9bd-8e68-445b-92e0-a073b216021a None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:35.351411 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6704c-881c-4959-a8c7-44bd7dd9ab8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:35.352330 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6704c-881c-4959-a8c7-44bd7dd9ab8c None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:35.352810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6704c-881c-4959-a8c7-44bd7dd9ab8c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:35.353410 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6704c-881c-4959-a8c7-44bd7dd9ab8c None admin] PATH_INFO: `/v3/users/24cda6e386474c1c9b70670cf5ac61e7` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:35.357156 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca274d93-29a3-430f-af1f-812add52f03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:35.357784 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca274d93-29a3-430f-af1f-812add52f03a None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:35.358058 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca274d93-29a3-430f-af1f-812add52f03a None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:35.358356 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca274d93-29a3-430f-af1f-812add52f03a None admin] PATH_INFO: `/v3/domains/default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:35.359475 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca274d93-29a3-430f-af1f-812add52f03a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:35.360917 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca274d93-29a3-430f-af1f-812add52f03a None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:35.362529 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 151/303] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:40:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:35.363285 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca274d93-29a3-430f-af1f-812add52f03a None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:35.370834 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6704c-881c-4959-a8c7-44bd7dd9ab8c None admin] RBAC: Authorizing `identity:get_user(user_id=24cda6e386474c1c9b70670cf5ac61e7)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:35.372291 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6704c-881c-4959-a8c7-44bd7dd9ab8c None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:35.374188 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 153/304] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:35 2022] GET /identity/v3/users/24cda6e386474c1c9b70670cf5ac61e7 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:35.378824 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6704c-881c-4959-a8c7-44bd7dd9ab8c None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:35.432963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:35.448142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:35.472271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca274d93-29a3-430f-af1f-812add52f03a None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:35.476170 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6704c-881c-4959-a8c7-44bd7dd9ab8c None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:35.506273 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25331288-52f9-4c2b-98a6-00c8e9cbd8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:35.506883 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25331288-52f9-4c2b-98a6-00c8e9cbd8b8 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:35.507154 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25331288-52f9-4c2b-98a6-00c8e9cbd8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:35.507424 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25331288-52f9-4c2b-98a6-00c8e9cbd8b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:35.509396 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936e659-911a-4a0f-b12d-abca41d44ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:35.509998 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936e659-911a-4a0f-b12d-abca41d44ae7 None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:35.510298 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936e659-911a-4a0f-b12d-abca41d44ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:35.510569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936e659-911a-4a0f-b12d-abca41d44ae7 None admin] PATH_INFO: `/v3/groups` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:35.511174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936e659-911a-4a0f-b12d-abca41d44ae7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:35.513166 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936e659-911a-4a0f-b12d-abca41d44ae7 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:35.517639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25331288-52f9-4c2b-98a6-00c8e9cbd8b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:35.522407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-25331288-52f9-4c2b-98a6-00c8e9cbd8b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:35.522407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:35.522407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:35.522407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:35.522407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:35.522407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:35.522407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:35.522407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:35.522407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:35.522407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:35.522407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:35.522407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:35.522407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:35.522407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:35.522407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:35.522407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:35.523426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:35.523426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:35.523426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:35.523426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:35.523426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:35.523426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:35.523426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:35.523426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:35.523426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:35.523426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:35.523426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:35.523426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:35.523426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:35.523426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:35.523426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:35.523426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:35.524209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:35.524209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:35.524209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:35.524209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:35.524209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:35.524209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:35.524209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:35.524209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:35.524209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:35.524209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:35.524209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:35.524209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:35.524209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 152/305] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:35.524935 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25331288-52f9-4c2b-98a6-00c8e9cbd8b8 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:35.592168 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 154/306] 10.222.0.13 () {60 vars in 1134 bytes} [Thu Aug 11 09:40:35 2022] POST /identity/v3/groups => generated 229 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:40:35.593507 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c5cbc-76da-46dc-a8c2-beaf4e4dcecc None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:35.593792 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c5cbc-76da-46dc-a8c2-beaf4e4dcecc None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:35.594065 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c5cbc-76da-46dc-a8c2-beaf4e4dcecc None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:35.595469 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 155/307] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:35.596010 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c5cbc-76da-46dc-a8c2-beaf4e4dcecc None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:35.630101 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25331288-52f9-4c2b-98a6-00c8e9cbd8b8 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:35.677866 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b91a4-846c-414f-a445-ccfdc0f2f752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:35.678517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b91a4-846c-414f-a445-ccfdc0f2f752 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:35.678794 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b91a4-846c-414f-a445-ccfdc0f2f752 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:35.679061 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b91a4-846c-414f-a445-ccfdc0f2f752 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:35.679796 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b91a4-846c-414f-a445-ccfdc0f2f752 None admin] RBAC: Adding query filter params (role.id=5ec51441676c42e7b6a3026a449dade7, user.id=24cda6e386474c1c9b70670cf5ac61e7, scope.system=all) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:35.680101 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b91a4-846c-414f-a445-ccfdc0f2f752 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:35.681912 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b91a4-846c-414f-a445-ccfdc0f2f752 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:35.684648 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:35.698125 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 153/308] 10.222.0.13 () {56 vars in 1308 bytes} [Thu Aug 11 09:40:35 2022] GET /identity/v3/role_assignments?user.id=24cda6e386474c1c9b70670cf5ac61e7&scope.system=all&role.id=5ec51441676c42e7b6a3026a449dade7 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:35.698125 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29f685-8fb3-48ae-8948-732c42577af5 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:35.698125 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29f685-8fb3-48ae-8948-732c42577af5 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:35.698125 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29f685-8fb3-48ae-8948-732c42577af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:35.710275 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-6d29f685-8fb3-48ae-8948-732c42577af5 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:35.711635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-6d29f685-8fb3-48ae-8948-732c42577af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:35.742486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c5cbc-76da-46dc-a8c2-beaf4e4dcecc None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:35.767466 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:35.788646 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fdd17-d94d-4c77-8da8-6c0f27556182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:35.789363 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fdd17-d94d-4c77-8da8-6c0f27556182 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:35.789525 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fdd17-d94d-4c77-8da8-6c0f27556182 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:35.789792 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fdd17-d94d-4c77-8da8-6c0f27556182 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:35.790518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fdd17-d94d-4c77-8da8-6c0f27556182 None admin] RBAC: Adding query filter params (name=member) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:35.790819 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fdd17-d94d-4c77-8da8-6c0f27556182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:35.792257 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fdd17-d94d-4c77-8da8-6c0f27556182 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:35.802379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 154/309] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:35.803571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 156/310] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:35.809928 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29f685-8fb3-48ae-8948-732c42577af5 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:35.830118 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fdd17-d94d-4c77-8da8-6c0f27556182 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:35.938779 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29f685-8fb3-48ae-8948-732c42577af5 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:35.959588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fdd17-d94d-4c77-8da8-6c0f27556182 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:35.970499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:35.974504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce478cd7-7a14-4720-8a49-b1d156aa7ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:35.975353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce478cd7-7a14-4720-8a49-b1d156aa7ccb None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:35.975824 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce478cd7-7a14-4720-8a49-b1d156aa7ccb None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:35.976262 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce478cd7-7a14-4720-8a49-b1d156aa7ccb None admin] PATH_INFO: `/v3/users/71881647a8264381977641374a1847d5` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:35.977906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce478cd7-7a14-4720-8a49-b1d156aa7ccb None admin] RBAC: Authorizing `identity:get_user(user_id=71881647a8264381977641374a1847d5)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:35.979532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce478cd7-7a14-4720-8a49-b1d156aa7ccb None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:35.983414 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 155/311] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:35 2022] GET /identity/v3/users/71881647a8264381977641374a1847d5 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:35.992110 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce478cd7-7a14-4720-8a49-b1d156aa7ccb None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:36.001185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b15850-6ec5-4a47-9465-2cf1f0ef5e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:36.001900 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b15850-6ec5-4a47-9465-2cf1f0ef5e2a None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:36.002277 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b15850-6ec5-4a47-9465-2cf1f0ef5e2a None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:36.002649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b15850-6ec5-4a47-9465-2cf1f0ef5e2a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:36.015952 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b15850-6ec5-4a47-9465-2cf1f0ef5e2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:36.022318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-88b15850-6ec5-4a47-9465-2cf1f0ef5e2a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 09:40:36.022318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:36.022318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:36.022318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:36.022318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:36.022318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:36.022318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:36.022318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:36.022318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:36.022318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:36.022318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:36.022318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:36.022318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:36.022318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:36.022318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:36.022318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:36.023213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:36.023213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:36.023213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:36.023213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:36.023213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:36.023213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:36.023213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:36.023213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:36.023213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:36.023213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:36.023213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:36.023213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:36.023213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:36.023213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:36.023213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:36.023213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:36.024003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:36.024003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:36.024003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:36.024003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:36.024003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:36.024003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:36.024003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:36.024003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:36.024003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:36.024003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:36.024003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 09:40:36.024003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:40:36.024003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 157/312] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:40:36.029634 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b15850-6ec5-4a47-9465-2cf1f0ef5e2a None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:36.071298 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:36.108343 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce478cd7-7a14-4720-8a49-b1d156aa7ccb None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:36.132317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b15850-6ec5-4a47-9465-2cf1f0ef5e2a None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:36.147910 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d79f52-d35b-4edd-8915-447566517248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:36.148625 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d79f52-d35b-4edd-8915-447566517248 None admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:36.148904 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d79f52-d35b-4edd-8915-447566517248 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:36.149173 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d79f52-d35b-4edd-8915-447566517248 None admin] PATH_INFO: `/v3/system/users/71881647a8264381977641374a1847d5/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:36.151048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d79f52-d35b-4edd-8915-447566517248 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=71881647a8264381977641374a1847d5, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:36.153333 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d79f52-d35b-4edd-8915-447566517248 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:36.171825 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19218d41-5959-45ce-835b-2c682df53b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:36.172529 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19218d41-5959-45ce-835b-2c682df53b54 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:36.172885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19218d41-5959-45ce-835b-2c682df53b54 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:36.173216 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19218d41-5959-45ce-835b-2c682df53b54 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:36.173932 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19218d41-5959-45ce-835b-2c682df53b54 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:36.174322 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19218d41-5959-45ce-835b-2c682df53b54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:36.175749 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19218d41-5959-45ce-835b-2c682df53b54 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:36.185014 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 158/313] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:36.190280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19218d41-5959-45ce-835b-2c682df53b54 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:36.239114 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 156/314] 10.222.0.13 () {58 vars in 1334 bytes} [Thu Aug 11 09:40:35 2022] PUT /identity/v3/system/users/71881647a8264381977641374a1847d5/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 09:40:36.309322 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:36.313220 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19218d41-5959-45ce-835b-2c682df53b54 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:36.354580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13921907-6984-4839-9bd7-b3cb43aef79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:36.355666 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13921907-6984-4839-9bd7-b3cb43aef79f None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:36.356660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13921907-6984-4839-9bd7-b3cb43aef79f None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:36.357206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13921907-6984-4839-9bd7-b3cb43aef79f None admin] PATH_INFO: `/v3/users/d750b586fdde485f8d6872c4c0d62b0f` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:36.358689 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13921907-6984-4839-9bd7-b3cb43aef79f None admin] RBAC: Authorizing `identity:get_user(user_id=d750b586fdde485f8d6872c4c0d62b0f)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:36.360492 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13921907-6984-4839-9bd7-b3cb43aef79f None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:36.366616 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 159/315] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:36 2022] GET /identity/v3/users/d750b586fdde485f8d6872c4c0d62b0f => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:36.369188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d79f52-d35b-4edd-8915-447566517248 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:36.437156 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:36.481342 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d79f52-d35b-4edd-8915-447566517248 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:36.519615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6a233-cc1f-46fc-9568-8d5b71d0daa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:36.520544 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6a233-cc1f-46fc-9568-8d5b71d0daa8 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:36.521045 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6a233-cc1f-46fc-9568-8d5b71d0daa8 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:36.521508 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6a233-cc1f-46fc-9568-8d5b71d0daa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:36.594808 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6a233-cc1f-46fc-9568-8d5b71d0daa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:36.596625 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6a233-cc1f-46fc-9568-8d5b71d0daa8 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:36.660587 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:36.701291 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 157/316] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:40:36.707138 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13921907-6984-4839-9bd7-b3cb43aef79f None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:36.818654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13921907-6984-4839-9bd7-b3cb43aef79f None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:36.856324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8302ef-e696-40a2-9e22-d08ec7c4051f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:36.856871 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8302ef-e696-40a2-9e22-d08ec7c4051f None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:36.857212 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8302ef-e696-40a2-9e22-d08ec7c4051f None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:36.857494 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8302ef-e696-40a2-9e22-d08ec7c4051f None admin] PATH_INFO: `/v3/projects/99fc3f2cb288430c9a330338644185b3` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:36.858651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8302ef-e696-40a2-9e22-d08ec7c4051f None admin] RBAC: Authorizing `identity:get_project(project_id=99fc3f2cb288430c9a330338644185b3)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:36.860109 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8302ef-e696-40a2-9e22-d08ec7c4051f None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:36.862039 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 160/317] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:36 2022] GET /identity/v3/projects/99fc3f2cb288430c9a330338644185b3 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:36.867542 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6a233-cc1f-46fc-9568-8d5b71d0daa8 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:36.967938 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6a233-cc1f-46fc-9568-8d5b71d0daa8 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:37.002498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a163cf5-185f-48f9-a443-0c299376cde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:37.003098 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a163cf5-185f-48f9-a443-0c299376cde8 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:37.003371 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a163cf5-185f-48f9-a443-0c299376cde8 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:37.003639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a163cf5-185f-48f9-a443-0c299376cde8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:37.004351 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a163cf5-185f-48f9-a443-0c299376cde8 None admin] RBAC: Adding query filter params (role.id=5ec51441676c42e7b6a3026a449dade7, scope.project.id=99fc3f2cb288430c9a330338644185b3, user.id=d750b586fdde485f8d6872c4c0d62b0f) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:37.004656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a163cf5-185f-48f9-a443-0c299376cde8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:37.006106 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a163cf5-185f-48f9-a443-0c299376cde8 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:37.012649 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 158/318] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:40:36 2022] GET /identity/v3/role_assignments?user.id=d750b586fdde485f8d6872c4c0d62b0f&scope.project.id=99fc3f2cb288430c9a330338644185b3&role.id=5ec51441676c42e7b6a3026a449dade7 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:37.736417 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0a290-2c31-4c83-98eb-6ca36b9a4581 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:37.736754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0a290-2c31-4c83-98eb-6ca36b9a4581 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:37.736956 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0a290-2c31-4c83-98eb-6ca36b9a4581 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:37.738458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 161/319] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:37.743294 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da3832-c80d-4ff7-aaea-84d36313b2a9 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:37.743577 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da3832-c80d-4ff7-aaea-84d36313b2a9 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:37.743845 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da3832-c80d-4ff7-aaea-84d36313b2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:37.756531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c231fb7-f01e-461f-ba82-e24247c8c927 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:37.756950 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c231fb7-f01e-461f-ba82-e24247c8c927 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:37.757373 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c231fb7-f01e-461f-ba82-e24247c8c927 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:37.759536 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 162/320] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:37.763152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-d1da3832-c80d-4ff7-aaea-84d36313b2a9 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:37.764351 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-d1da3832-c80d-4ff7-aaea-84d36313b2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:37.766972 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f24de-6fd5-4345-ae4f-85a4b632fd26 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:37.767379 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f24de-6fd5-4345-ae4f-85a4b632fd26 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:37.767770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f24de-6fd5-4345-ae4f-85a4b632fd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:37.785685 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:37.790652 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-442f24de-6fd5-4345-ae4f-85a4b632fd26 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:37.791846 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-442f24de-6fd5-4345-ae4f-85a4b632fd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:37.825954 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:37.842576 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 159/321] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:37.863654 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da3832-c80d-4ff7-aaea-84d36313b2a9 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:37.870158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 163/322] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 09:40:37.887838 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f24de-6fd5-4345-ae4f-85a4b632fd26 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:37.971240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da3832-c80d-4ff7-aaea-84d36313b2a9 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:37.988140 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f24de-6fd5-4345-ae4f-85a4b632fd26 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:38.007021 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84855871-404d-4b2d-950b-36721a2db6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:38.007752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84855871-404d-4b2d-950b-36721a2db6b9 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:38.008024 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84855871-404d-4b2d-950b-36721a2db6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:38.008290 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84855871-404d-4b2d-950b-36721a2db6b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:38.019289 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84855871-404d-4b2d-950b-36721a2db6b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:38.023318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ce5e9-7a2c-46d8-b5ae-a5dde91e405a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:38.023869 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-84855871-404d-4b2d-950b-36721a2db6b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 09:40:38.023869 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:38.023869 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:38.023869 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:38.023869 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:38.023869 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:38.023869 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:38.023869 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:38.023869 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:38.023869 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:38.023869 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:38.023869 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:38.023869 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:38.023869 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:38.023869 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:38.023869 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:38.024727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:38.024727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:38.024727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:38.024727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:38.024727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:38.024727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:38.024727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:38.024727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:38.024727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:38.024727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:38.024727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:38.024727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:38.024727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:38.024727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:38.024727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:38.024727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:38.025527 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:38.025527 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:38.025527 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:38.025527 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:38.025527 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:38.025527 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:38.025527 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:38.025527 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:38.025527 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:38.025527 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:38.025527 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 09:40:38.025527 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:38.026149 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ce5e9-7a2c-46d8-b5ae-a5dde91e405a None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:38.026149 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ce5e9-7a2c-46d8-b5ae-a5dde91e405a None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:38.026149 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ce5e9-7a2c-46d8-b5ae-a5dde91e405a None admin] PATH_INFO: `/v3/domains/default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:38.026333 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 160/323] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:40:38.027594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ce5e9-7a2c-46d8-b5ae-a5dde91e405a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:38.029053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ce5e9-7a2c-46d8-b5ae-a5dde91e405a None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:38.035377 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 164/324] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:40:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:38.035503 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84855871-404d-4b2d-950b-36721a2db6b9 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:38.037242 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ce5e9-7a2c-46d8-b5ae-a5dde91e405a None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:38.050030 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:38.073476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:38.134795 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84855871-404d-4b2d-950b-36721a2db6b9 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:38.140425 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ce5e9-7a2c-46d8-b5ae-a5dde91e405a None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:38.169732 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c0e64-3cc0-4c74-808c-63ea8bed102b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:38.170471 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c0e64-3cc0-4c74-808c-63ea8bed102b None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:38.170743 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c0e64-3cc0-4c74-808c-63ea8bed102b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:38.171007 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c0e64-3cc0-4c74-808c-63ea8bed102b None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:38.171697 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c0e64-3cc0-4c74-808c-63ea8bed102b None admin] RBAC: Adding query filter params (name=reader) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:38.171959 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c0e64-3cc0-4c74-808c-63ea8bed102b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:38.173314 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c0e64-3cc0-4c74-808c-63ea8bed102b None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:38.174975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fc3ef-44f4-40c4-b0a7-53736992794d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:38.175700 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fc3ef-44f4-40c4-b0a7-53736992794d None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:38.175886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fc3ef-44f4-40c4-b0a7-53736992794d None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:38.176155 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fc3ef-44f4-40c4-b0a7-53736992794d None admin] PATH_INFO: `/v3/groups` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:38.176765 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fc3ef-44f4-40c4-b0a7-53736992794d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:38.178205 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fc3ef-44f4-40c4-b0a7-53736992794d None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:38.182393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 161/325] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:38.188507 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c0e64-3cc0-4c74-808c-63ea8bed102b None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:38.249322 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 165/326] 10.222.0.13 () {60 vars in 1134 bytes} [Thu Aug 11 09:40:38 2022] POST /identity/v3/groups => generated 226 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 09:40:38.265689 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:38.291929 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c0e64-3cc0-4c74-808c-63ea8bed102b None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:38.307875 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57e1f3-e2e7-448a-967d-96d0715f6a8f None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:38.308241 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57e1f3-e2e7-448a-967d-96d0715f6a8f None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:38.308532 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57e1f3-e2e7-448a-967d-96d0715f6a8f None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:38.310508 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 166/327] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:40:38.317023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75bc9f-5a76-4c66-a50e-64cd86f5ee84 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:38.317307 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75bc9f-5a76-4c66-a50e-64cd86f5ee84 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:38.317583 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75bc9f-5a76-4c66-a50e-64cd86f5ee84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:38.333091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c287c-4f4b-4554-ad31-1beaa5f91abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:38.333884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c287c-4f4b-4554-ad31-1beaa5f91abf None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:38.334257 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c287c-4f4b-4554-ad31-1beaa5f91abf None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:38.334587 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c287c-4f4b-4554-ad31-1beaa5f91abf None admin] PATH_INFO: `/v3/users/24cda6e386474c1c9b70670cf5ac61e7` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:38.335832 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c287c-4f4b-4554-ad31-1beaa5f91abf None admin] RBAC: Authorizing `identity:get_user(user_id=24cda6e386474c1c9b70670cf5ac61e7)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:38.335956 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-7c75bc9f-5a76-4c66-a50e-64cd86f5ee84 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:38.337125 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-7c75bc9f-5a76-4c66-a50e-64cd86f5ee84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:38.337504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c287c-4f4b-4554-ad31-1beaa5f91abf None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:38.339379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 162/328] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:38 2022] GET /identity/v3/users/24cda6e386474c1c9b70670cf5ac61e7 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:38.345567 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c287c-4f4b-4554-ad31-1beaa5f91abf None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:38.414745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 167/329] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 09:40:38.440065 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75bc9f-5a76-4c66-a50e-64cd86f5ee84 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:38.466370 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c287c-4f4b-4554-ad31-1beaa5f91abf None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:38.467927 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:38.508220 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f4f7c-384a-47ad-bb28-273da0d44b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:38.508809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f4f7c-384a-47ad-bb28-273da0d44b54 None admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:38.509085 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f4f7c-384a-47ad-bb28-273da0d44b54 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:38.509366 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f4f7c-384a-47ad-bb28-273da0d44b54 None admin] PATH_INFO: `/v3/system/users/24cda6e386474c1c9b70670cf5ac61e7/roles/5ec51441676c42e7b6a3026a449dade7` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:38.511788 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f4f7c-384a-47ad-bb28-273da0d44b54 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=24cda6e386474c1c9b70670cf5ac61e7, role_id=5ec51441676c42e7b6a3026a449dade7)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:38.513173 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f4f7c-384a-47ad-bb28-273da0d44b54 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:38.553928 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75bc9f-5a76-4c66-a50e-64cd86f5ee84 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:38.569937 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 163/330] 10.222.0.13 () {58 vars in 1334 bytes} [Thu Aug 11 09:40:38 2022] PUT /identity/v3/system/users/24cda6e386474c1c9b70670cf5ac61e7/roles/5ec51441676c42e7b6a3026a449dade7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 09:40:38.596430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75912688-a152-4e8a-a436-066bc1a7194a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:38.597303 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75912688-a152-4e8a-a436-066bc1a7194a None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:38.597671 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75912688-a152-4e8a-a436-066bc1a7194a None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:38.598041 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75912688-a152-4e8a-a436-066bc1a7194a None admin] PATH_INFO: `/v3/roles/member` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:38.614519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75912688-a152-4e8a-a436-066bc1a7194a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:38.619620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-75912688-a152-4e8a-a436-066bc1a7194a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:38.619620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:38.619620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:38.619620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:38.619620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:38.619620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:38.619620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:38.619620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:38.619620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:38.619620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:38.619620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:38.619620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:38.619620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:38.619620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:38.619620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:38.619620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:38.620713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:38.620713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:38.620713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:38.620713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:38.620713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:38.620713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:38.620713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:38.620713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:38.620713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:38.620713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:38.620713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:38.620713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:38.620713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:38.620713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:38.620713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:38.620713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:38.622433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:38.622433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:38.622433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:38.622433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:38.622433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:38.622433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:38.622433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:38.622433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:38.622433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:38.622433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:38.622433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:38.622433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:40:38.624026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 168/331] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:40:38.630397 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f4f7c-384a-47ad-bb28-273da0d44b54 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:38.647065 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:38.768141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f4f7c-384a-47ad-bb28-273da0d44b54 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:38.803163 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47bacf-3df6-43e6-98a8-629afe7ed2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:38.803769 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47bacf-3df6-43e6-98a8-629afe7ed2a7 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:38.804040 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47bacf-3df6-43e6-98a8-629afe7ed2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:38.804308 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47bacf-3df6-43e6-98a8-629afe7ed2a7 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:38.804961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47bacf-3df6-43e6-98a8-629afe7ed2a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:38.805255 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47bacf-3df6-43e6-98a8-629afe7ed2a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:38.806961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47bacf-3df6-43e6-98a8-629afe7ed2a7 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:38.815932 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 164/332] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:38.821677 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75912688-a152-4e8a-a436-066bc1a7194a None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:38.910948 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:38.927910 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75912688-a152-4e8a-a436-066bc1a7194a None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:38.963509 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c2965-84ba-4f49-906d-c805aa0baacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:38.964129 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c2965-84ba-4f49-906d-c805aa0baacc None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:38.964400 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c2965-84ba-4f49-906d-c805aa0baacc None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:38.964666 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c2965-84ba-4f49-906d-c805aa0baacc None admin] PATH_INFO: `/v3/users/71881647a8264381977641374a1847d5` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:38.965826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c2965-84ba-4f49-906d-c805aa0baacc None admin] RBAC: Authorizing `identity:get_user(user_id=71881647a8264381977641374a1847d5)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:38.967309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c2965-84ba-4f49-906d-c805aa0baacc None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:38.973595 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 169/333] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:38 2022] GET /identity/v3/users/71881647a8264381977641374a1847d5 => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:38.974961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47bacf-3df6-43e6-98a8-629afe7ed2a7 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:39.049632 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:39.083225 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47bacf-3df6-43e6-98a8-629afe7ed2a7 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:39.128045 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39546127-549f-453d-94ac-6448437d2c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:39.128671 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39546127-549f-453d-94ac-6448437d2c51 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:39.128941 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39546127-549f-453d-94ac-6448437d2c51 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:39.129265 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39546127-549f-453d-94ac-6448437d2c51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:39.129989 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39546127-549f-453d-94ac-6448437d2c51 None admin] RBAC: Adding query filter params (role.id=9b9c9f22f65c459bacd757d5de4d5b8e, user.id=71881647a8264381977641374a1847d5, scope.system=all) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:39.130310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39546127-549f-453d-94ac-6448437d2c51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:39.131766 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39546127-549f-453d-94ac-6448437d2c51 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:39.144092 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 165/334] 10.222.0.13 () {56 vars in 1308 bytes} [Thu Aug 11 09:40:38 2022] GET /identity/v3/role_assignments?user.id=71881647a8264381977641374a1847d5&scope.system=all&role.id=9b9c9f22f65c459bacd757d5de4d5b8e => generated 510 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:40.535108 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e485c-204f-487a-b598-43ca729d87d8 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:40.535647 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e485c-204f-487a-b598-43ca729d87d8 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:40.535647 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e485c-204f-487a-b598-43ca729d87d8 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:40.537246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 170/335] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:40.545851 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae93983-9c9c-4641-940c-f755d6a52b6b None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:40.546294 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae93983-9c9c-4641-940c-f755d6a52b6b None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:40.546462 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae93983-9c9c-4641-940c-f755d6a52b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:40.566026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-7ae93983-9c9c-4641-940c-f755d6a52b6b None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:40.567267 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-7ae93983-9c9c-4641-940c-f755d6a52b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:40.652135 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 166/336] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:40.690489 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e485c-204f-487a-b598-43ca729d87d8 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:40.760359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a482e-5145-4e71-a9df-3e308bb9c833 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:40.760681 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a482e-5145-4e71-a9df-3e308bb9c833 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:40.760894 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a482e-5145-4e71-a9df-3e308bb9c833 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:40.767223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 167/337] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:40:40.770283 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047c19c-efec-4aee-8b07-beb7068512d5 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:40.770563 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047c19c-efec-4aee-8b07-beb7068512d5 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:40.770832 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047c19c-efec-4aee-8b07-beb7068512d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:40.802571 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-5047c19c-efec-4aee-8b07-beb7068512d5 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:40.803687 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-5047c19c-efec-4aee-8b07-beb7068512d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:40.848966 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e485c-204f-487a-b598-43ca729d87d8 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:40.896674 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:40.910239 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf190910-a282-4c1e-8ffc-72fe29203aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:40.910880 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf190910-a282-4c1e-8ffc-72fe29203aed None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:40.911103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 168/338] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:40.914623 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf190910-a282-4c1e-8ffc-72fe29203aed None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:40.914623 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf190910-a282-4c1e-8ffc-72fe29203aed None admin] PATH_INFO: `/v3/roles/member` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:40.931672 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf190910-a282-4c1e-8ffc-72fe29203aed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:40.936772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047c19c-efec-4aee-8b07-beb7068512d5 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:40.937764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-bf190910-a282-4c1e-8ffc-72fe29203aed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:40.937764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:40.937764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:40.937764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:40.937764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:40.937764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:40.937764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:40.937764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:40.937764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:40.937764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:40.937764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:40.937764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:40.937764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:40.937764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:40.937764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:40.937764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:40.938725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:40.938725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:40.938725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:40.938725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:40.938725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:40.938725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:40.938725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:40.938725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:40.938725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:40.938725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:40.938725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:40.938725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:40.938725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:40.938725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:40.938725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:40.938725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:40.939524 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:40.939524 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:40.939524 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:40.939524 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:40.939524 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:40.939524 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:40.939524 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:40.939524 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:40.939524 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:40.939524 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:40.939524 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:40.939524 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:40:40.947731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 171/339] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:40.953507 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf190910-a282-4c1e-8ffc-72fe29203aed None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:40.976052 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:41.046104 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047c19c-efec-4aee-8b07-beb7068512d5 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:41.083433 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b43cbe-f71c-40d9-8d47-76d00100f926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:41.084066 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b43cbe-f71c-40d9-8d47-76d00100f926 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:41.084406 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b43cbe-f71c-40d9-8d47-76d00100f926 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:41.084676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b43cbe-f71c-40d9-8d47-76d00100f926 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:41.090559 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf190910-a282-4c1e-8ffc-72fe29203aed None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:41.095586 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b43cbe-f71c-40d9-8d47-76d00100f926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:41.100601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-e7b43cbe-f71c-40d9-8d47-76d00100f926 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 09:40:41.100601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:41.100601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:41.100601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:41.100601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:41.100601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:41.100601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:41.100601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:41.100601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:41.100601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:41.100601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:41.100601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:41.100601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:41.100601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:41.100601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:41.100601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:41.102696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:41.102696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:41.102696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:41.102696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:41.102696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:41.102696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:41.102696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:41.102696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:41.102696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:41.102696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:41.102696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:41.102696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:41.102696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:41.102696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:41.102696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:41.102696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:41.104626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:41.104626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:41.104626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:41.104626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:41.104626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:41.104626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:41.104626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:41.104626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:41.104626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:41.104626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:41.104626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 09:40:41.104626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:41.104626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 169/340] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:41.110803 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b43cbe-f71c-40d9-8d47-76d00100f926 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:41.167407 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef59e9-0220-4fe1-902e-16ee468faefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:41.168929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef59e9-0220-4fe1-902e-16ee468faefb None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:41.169406 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef59e9-0220-4fe1-902e-16ee468faefb None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:41.169872 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef59e9-0220-4fe1-902e-16ee468faefb None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:41.170753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef59e9-0220-4fe1-902e-16ee468faefb None admin] RBAC: Adding query filter params (name=member) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:41.171268 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef59e9-0220-4fe1-902e-16ee468faefb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:41.172840 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef59e9-0220-4fe1-902e-16ee468faefb None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:41.193544 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 172/341] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:41.198435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:41.198950 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef59e9-0220-4fe1-902e-16ee468faefb None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:41.235360 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b43cbe-f71c-40d9-8d47-76d00100f926 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:41.310788 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab250fb-8bf6-4154-9f20-5b5aec3ad558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:41.311405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab250fb-8bf6-4154-9f20-5b5aec3ad558 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:41.311680 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab250fb-8bf6-4154-9f20-5b5aec3ad558 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:41.311954 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab250fb-8bf6-4154-9f20-5b5aec3ad558 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:41.312612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab250fb-8bf6-4154-9f20-5b5aec3ad558 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:41.312909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab250fb-8bf6-4154-9f20-5b5aec3ad558 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:41.314382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab250fb-8bf6-4154-9f20-5b5aec3ad558 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:41.325695 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 170/342] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:41.330809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab250fb-8bf6-4154-9f20-5b5aec3ad558 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:41.371835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:41.412850 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef59e9-0220-4fe1-902e-16ee468faefb None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:41.483703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8abbe3-10cc-47b9-968e-e1a6362f110d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:41.484440 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8abbe3-10cc-47b9-968e-e1a6362f110d None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:41.484716 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8abbe3-10cc-47b9-968e-e1a6362f110d None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:41.484987 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8abbe3-10cc-47b9-968e-e1a6362f110d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:41.516517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab250fb-8bf6-4154-9f20-5b5aec3ad558 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:41.554463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:41.558041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9dd121-0274-438e-947f-e8fc24c2d9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:41.558791 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dd121-0274-438e-947f-e8fc24c2d9e2 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:41.559070 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dd121-0274-438e-947f-e8fc24c2d9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:41.559387 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dd121-0274-438e-947f-e8fc24c2d9e2 None admin] PATH_INFO: `/v3/users/24cda6e386474c1c9b70670cf5ac61e7` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:41.560537 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9dd121-0274-438e-947f-e8fc24c2d9e2 None admin] RBAC: Authorizing `identity:get_user(user_id=24cda6e386474c1c9b70670cf5ac61e7)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:41.562173 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9dd121-0274-438e-947f-e8fc24c2d9e2 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:41.563749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 171/343] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:40:41 2022] GET /identity/v3/users/24cda6e386474c1c9b70670cf5ac61e7 => generated 293 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:41.564911 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c0c4d-fd4b-410e-905b-fd4fcd278025 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:41.565188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c0c4d-fd4b-410e-905b-fd4fcd278025 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:41.565458 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c0c4d-fd4b-410e-905b-fd4fcd278025 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:41.571212 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 172/344] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:41.572634 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c0c4d-fd4b-410e-905b-fd4fcd278025 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:41.644874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8abbe3-10cc-47b9-968e-e1a6362f110d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:41.654323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8abbe3-10cc-47b9-968e-e1a6362f110d None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:41.691040 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c0c4d-fd4b-410e-905b-fd4fcd278025 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:41.764768 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3350e7-50bf-44e8-b045-2d347606efa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:41.765381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3350e7-50bf-44e8-b045-2d347606efa1 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:41.765654 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3350e7-50bf-44e8-b045-2d347606efa1 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:41.765920 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3350e7-50bf-44e8-b045-2d347606efa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:41.766829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3350e7-50bf-44e8-b045-2d347606efa1 None admin] RBAC: Adding query filter params (role.id=5ec51441676c42e7b6a3026a449dade7, user.id=24cda6e386474c1c9b70670cf5ac61e7, scope.system=all) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:41.767135 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3350e7-50bf-44e8-b045-2d347606efa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:41.769358 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3350e7-50bf-44e8-b045-2d347606efa1 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:41.783967 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:41.795097 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 173/345] 10.222.0.13 () {56 vars in 1308 bytes} [Thu Aug 11 09:40:41 2022] GET /identity/v3/role_assignments?user.id=24cda6e386474c1c9b70670cf5ac61e7&scope.system=all&role.id=5ec51441676c42e7b6a3026a449dade7 => generated 510 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:41.796066 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fe56f-432f-4c0a-9562-1e4a2482bddf None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:41.796592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fe56f-432f-4c0a-9562-1e4a2482bddf None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:41.796825 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fe56f-432f-4c0a-9562-1e4a2482bddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:41.832396 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-0f6fe56f-432f-4c0a-9562-1e4a2482bddf None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:41.834627 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-0f6fe56f-432f-4c0a-9562-1e4a2482bddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:41.844634 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 173/346] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:40:41.846262 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e695b-7268-480a-9e94-c0fb94821d58 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:41.850710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e695b-7268-480a-9e94-c0fb94821d58 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:41.851222 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e695b-7268-480a-9e94-c0fb94821d58 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:41.852819 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 174/347] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:41.853725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e695b-7268-480a-9e94-c0fb94821d58 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:41.902049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:41.978435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 174/348] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:41.981317 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9022a6-6d04-4c63-90f1-b6eb7c0b92a2 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:41.982054 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9022a6-6d04-4c63-90f1-b6eb7c0b92a2 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:41.983231 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9022a6-6d04-4c63-90f1-b6eb7c0b92a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:42.011164 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-4a9022a6-6d04-4c63-90f1-b6eb7c0b92a2 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:42.013110 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-4a9022a6-6d04-4c63-90f1-b6eb7c0b92a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:42.056453 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e695b-7268-480a-9e94-c0fb94821d58 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:42.090248 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 175/349] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:42.091315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9022a6-6d04-4c63-90f1-b6eb7c0b92a2 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:42.108442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebeda44-ab4b-41fe-af2b-f3bf2551c525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:42.109121 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebeda44-ab4b-41fe-af2b-f3bf2551c525 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:42.109364 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebeda44-ab4b-41fe-af2b-f3bf2551c525 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:42.109636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebeda44-ab4b-41fe-af2b-f3bf2551c525 None admin] PATH_INFO: `/v3/projects/efa1046add794b2eb629463dd092363b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:42.111469 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebeda44-ab4b-41fe-af2b-f3bf2551c525 None admin] RBAC: Authorizing `identity:get_project(project_id=efa1046add794b2eb629463dd092363b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:42.112913 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebeda44-ab4b-41fe-af2b-f3bf2551c525 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:42.117163 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 175/350] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:41 2022] GET /identity/v3/projects/efa1046add794b2eb629463dd092363b => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:42.122733 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebeda44-ab4b-41fe-af2b-f3bf2551c525 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:42.172756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:42.208568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:42.215209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9022a6-6d04-4c63-90f1-b6eb7c0b92a2 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:42.236576 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebeda44-ab4b-41fe-af2b-f3bf2551c525 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:42.254640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc749def-86ad-4b38-8188-1212291d9b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:42.255364 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc749def-86ad-4b38-8188-1212291d9b63 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:42.255749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc749def-86ad-4b38-8188-1212291d9b63 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:42.256020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc749def-86ad-4b38-8188-1212291d9b63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:42.268261 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc749def-86ad-4b38-8188-1212291d9b63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:42.273258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-fc749def-86ad-4b38-8188-1212291d9b63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:42.273258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:42.273258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:42.273258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:42.273258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:42.273258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:42.273258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:42.273258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:42.273258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:42.273258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:42.273258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:42.273258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:42.273258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:42.273258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:42.273258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:42.273258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:42.274208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:42.274208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:42.274208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:42.274208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:42.274208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:42.274208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:42.274208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:42.274208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:42.274208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:42.274208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:42.274208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:42.274208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:42.274208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:42.274208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:42.274208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:42.274208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:42.275028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:42.275028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:42.275028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:42.275028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:42.275028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:42.275028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:42.275028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:42.275028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:42.275028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:42.275028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:42.275028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:42.275028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:42.275635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c565be7-b4dd-43f7-a5b3-5ac4ab60a751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:42.275635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c565be7-b4dd-43f7-a5b3-5ac4ab60a751 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:42.275635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c565be7-b4dd-43f7-a5b3-5ac4ab60a751 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:42.275635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c565be7-b4dd-43f7-a5b3-5ac4ab60a751 None admin] PATH_INFO: `/v3/groups/649f764bc71c4fff9fabef5a0fd2bbb5` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:42.275884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 176/351] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Aug 11 09:40:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:42.275884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc749def-86ad-4b38-8188-1212291d9b63 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:42.282919 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c565be7-b4dd-43f7-a5b3-5ac4ab60a751 None admin] RBAC: Authorizing `identity:get_group(group_id=649f764bc71c4fff9fabef5a0fd2bbb5)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:42.284429 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c565be7-b4dd-43f7-a5b3-5ac4ab60a751 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:42.286478 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 176/352] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Aug 11 09:40:42 2022] GET /identity/v3/groups/649f764bc71c4fff9fabef5a0fd2bbb5 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:42.287238 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c565be7-b4dd-43f7-a5b3-5ac4ab60a751 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:42.392528 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc749def-86ad-4b38-8188-1212291d9b63 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:42.396303 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c565be7-b4dd-43f7-a5b3-5ac4ab60a751 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:42.403445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:42.430231 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a7744-3366-47ad-8816-2e850b66deb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:42.430789 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a7744-3366-47ad-8816-2e850b66deb8 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:42.431069 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a7744-3366-47ad-8816-2e850b66deb8 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:42.431448 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5fd18-f7de-4c5b-bf86-b1f6986dc661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:42.431655 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a7744-3366-47ad-8816-2e850b66deb8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:42.432075 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5fd18-f7de-4c5b-bf86-b1f6986dc661 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:42.432343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5fd18-f7de-4c5b-bf86-b1f6986dc661 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:42.432614 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5fd18-f7de-4c5b-bf86-b1f6986dc661 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:42.433322 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5fd18-f7de-4c5b-bf86-b1f6986dc661 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:42.434192 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5fd18-f7de-4c5b-bf86-b1f6986dc661 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:42.435552 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5fd18-f7de-4c5b-bf86-b1f6986dc661 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:42.444193 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a7744-3366-47ad-8816-2e850b66deb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:42.444653 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 177/353] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:40:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:42.445574 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5fd18-f7de-4c5b-bf86-b1f6986dc661 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:42.450947 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-451a7744-3366-47ad-8816-2e850b66deb8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:42.450947 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:42.450947 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:42.450947 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:42.450947 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:42.450947 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:42.450947 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:42.450947 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:42.450947 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:42.450947 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:42.450947 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:42.450947 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:42.450947 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:42.450947 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:42.450947 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:42.450947 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:42.451846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:42.451846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:42.451846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:42.451846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:42.451846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:42.451846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:42.451846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:42.451846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:42.451846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:42.451846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:42.451846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:42.451846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:42.451846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:42.451846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:42.451846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:42.451846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:42.452630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:42.452630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:42.452630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:42.452630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:42.452630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:42.452630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:42.452630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:42.452630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:42.452630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:42.452630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:42.452630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:42.452630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:42.452630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 177/354] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:42.459060 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a7744-3366-47ad-8816-2e850b66deb8 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:42.487996 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:42.557715 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5fd18-f7de-4c5b-bf86-b1f6986dc661 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:42.582367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a7744-3366-47ad-8816-2e850b66deb8 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:42.592333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cadf81-6240-41b4-9744-16091550bbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:42.592937 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cadf81-6240-41b4-9744-16091550bbff None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:42.593212 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cadf81-6240-41b4-9744-16091550bbff None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:42.593484 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cadf81-6240-41b4-9744-16091550bbff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:42.595223 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cadf81-6240-41b4-9744-16091550bbff None admin] RBAC: Adding query filter params (group.id=649f764bc71c4fff9fabef5a0fd2bbb5, role.id=9b9c9f22f65c459bacd757d5de4d5b8e, scope.project.id=efa1046add794b2eb629463dd092363b) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:42.595534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cadf81-6240-41b4-9744-16091550bbff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:42.597108 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cadf81-6240-41b4-9744-16091550bbff None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:42.603672 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 178/355] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Aug 11 09:40:42 2022] GET /identity/v3/role_assignments?group.id=649f764bc71c4fff9fabef5a0fd2bbb5&scope.project.id=efa1046add794b2eb629463dd092363b&role.id=9b9c9f22f65c459bacd757d5de4d5b8e => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:42.604291 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cadf81-6240-41b4-9744-16091550bbff None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:42.640736 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bc728-3839-49a7-a868-3116e7d49455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:42.641409 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bc728-3839-49a7-a868-3116e7d49455 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:42.641687 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bc728-3839-49a7-a868-3116e7d49455 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:42.641959 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bc728-3839-49a7-a868-3116e7d49455 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:42.691357 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:42.757814 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bc728-3839-49a7-a868-3116e7d49455 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:42.759332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bc728-3839-49a7-a868-3116e7d49455 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:42.778937 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cadf81-6240-41b4-9744-16091550bbff None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:42.783570 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:42.858101 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959f6e7-9bd5-4f66-9399-b1c36f628013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:42.858733 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959f6e7-9bd5-4f66-9399-b1c36f628013 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:42.859008 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959f6e7-9bd5-4f66-9399-b1c36f628013 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:42.859273 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959f6e7-9bd5-4f66-9399-b1c36f628013 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:42.859946 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959f6e7-9bd5-4f66-9399-b1c36f628013 None admin] RBAC: Adding query filter params (name=member) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:42.860349 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959f6e7-9bd5-4f66-9399-b1c36f628013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:42.861719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959f6e7-9bd5-4f66-9399-b1c36f628013 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:42.874584 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 179/356] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:42.880845 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959f6e7-9bd5-4f66-9399-b1c36f628013 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:42.893000 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 178/357] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:40:42.898737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bc728-3839-49a7-a868-3116e7d49455 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:42.984279 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:42.992301 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959f6e7-9bd5-4f66-9399-b1c36f628013 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:43.028259 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ee77b-2e11-420a-b3dd-b9898dbc5ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:43.029174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ee77b-2e11-420a-b3dd-b9898dbc5ddc None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:43.029627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ee77b-2e11-420a-b3dd-b9898dbc5ddc None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:43.030122 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ee77b-2e11-420a-b3dd-b9898dbc5ddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:43.063443 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bc728-3839-49a7-a868-3116e7d49455 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:43.082829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:43.104757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ee77b-2e11-420a-b3dd-b9898dbc5ddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:43.107149 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ee77b-2e11-420a-b3dd-b9898dbc5ddc None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:43.120821 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c85333-c0e0-4ef9-9266-045c4369f892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:43.121814 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c85333-c0e0-4ef9-9266-045c4369f892 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:43.125113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c85333-c0e0-4ef9-9266-045c4369f892 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:43.126043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c85333-c0e0-4ef9-9266-045c4369f892 None admin] PATH_INFO: `/v3/projects/efa1046add794b2eb629463dd092363b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:43.127754 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c85333-c0e0-4ef9-9266-045c4369f892 None admin] RBAC: Authorizing `identity:get_project(project_id=efa1046add794b2eb629463dd092363b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:43.132946 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c85333-c0e0-4ef9-9266-045c4369f892 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:43.137927 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 179/358] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:42 2022] GET /identity/v3/projects/efa1046add794b2eb629463dd092363b => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:43.140181 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24d0fd-2320-4206-b5c4-4263fa560331 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:43.140658 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24d0fd-2320-4206-b5c4-4263fa560331 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:43.141106 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24d0fd-2320-4206-b5c4-4263fa560331 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:43.143146 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 180/359] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:43.144588 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24d0fd-2320-4206-b5c4-4263fa560331 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:43.226531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:43.242850 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 180/360] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 09:40:43.242850 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b671b7-cad8-4498-864f-3b184bf04c79 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:43.242850 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b671b7-cad8-4498-864f-3b184bf04c79 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:43.242850 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b671b7-cad8-4498-864f-3b184bf04c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:43.260828 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-c4b671b7-cad8-4498-864f-3b184bf04c79 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:43.262966 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-c4b671b7-cad8-4498-864f-3b184bf04c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:43.281619 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24d0fd-2320-4206-b5c4-4263fa560331 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:43.330179 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf4381-97e3-47d4-827b-427c428e480c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:43.330967 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf4381-97e3-47d4-827b-427c428e480c None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:43.331344 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf4381-97e3-47d4-827b-427c428e480c None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:43.331619 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf4381-97e3-47d4-827b-427c428e480c None admin] PATH_INFO: `/v3/groups/649f764bc71c4fff9fabef5a0fd2bbb5` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:43.332888 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf4381-97e3-47d4-827b-427c428e480c None admin] RBAC: Authorizing `identity:get_group(group_id=649f764bc71c4fff9fabef5a0fd2bbb5)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:43.334961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf4381-97e3-47d4-827b-427c428e480c None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:43.338239 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 181/361] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Aug 11 09:40:43 2022] GET /identity/v3/groups/649f764bc71c4fff9fabef5a0fd2bbb5 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:43.338239 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf4381-97e3-47d4-827b-427c428e480c None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:43.345999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 181/362] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:43.347144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b671b7-cad8-4498-864f-3b184bf04c79 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:43.422978 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:43.499053 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf4381-97e3-47d4-827b-427c428e480c None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:43.499384 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b671b7-cad8-4498-864f-3b184bf04c79 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:43.526714 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:43.538652 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134901d-3f9b-4e92-8ea6-ebea31537968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:43.540699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134901d-3f9b-4e92-8ea6-ebea31537968 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:43.540699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134901d-3f9b-4e92-8ea6-ebea31537968 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:43.540892 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134901d-3f9b-4e92-8ea6-ebea31537968 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:43.541507 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134901d-3f9b-4e92-8ea6-ebea31537968 None admin] RBAC: Adding query filter params (group.id=649f764bc71c4fff9fabef5a0fd2bbb5, role.id=da3ceb6dfa1746f19dbaf26e2c3ef7ab, scope.project.id=efa1046add794b2eb629463dd092363b) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:43.541809 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134901d-3f9b-4e92-8ea6-ebea31537968 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:43.543856 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134901d-3f9b-4e92-8ea6-ebea31537968 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:43.550755 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 182/363] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Aug 11 09:40:43 2022] GET /identity/v3/role_assignments?group.id=649f764bc71c4fff9fabef5a0fd2bbb5&scope.project.id=efa1046add794b2eb629463dd092363b&role.id=da3ceb6dfa1746f19dbaf26e2c3ef7ab => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:43.551493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612eaf52-710e-4be8-a95f-e7cd03b17cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:43.551690 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134901d-3f9b-4e92-8ea6-ebea31537968 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:43.552228 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612eaf52-710e-4be8-a95f-e7cd03b17cea None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:43.552505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612eaf52-710e-4be8-a95f-e7cd03b17cea None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:43.552770 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612eaf52-710e-4be8-a95f-e7cd03b17cea None admin] PATH_INFO: `/v3/projects/99fc3f2cb288430c9a330338644185b3` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:43.553951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612eaf52-710e-4be8-a95f-e7cd03b17cea None admin] RBAC: Authorizing `identity:get_project(project_id=99fc3f2cb288430c9a330338644185b3)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:43.555464 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612eaf52-710e-4be8-a95f-e7cd03b17cea None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:43.557584 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 182/364] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:43 2022] GET /identity/v3/projects/99fc3f2cb288430c9a330338644185b3 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:43.562949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bb7b8-63ec-4d72-ac47-220984b7b53f None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:43.563241 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bb7b8-63ec-4d72-ac47-220984b7b53f None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:43.563499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bb7b8-63ec-4d72-ac47-220984b7b53f None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:43.569224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 183/365] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:43.570256 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744bb7b8-63ec-4d72-ac47-220984b7b53f None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:43.673188 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134901d-3f9b-4e92-8ea6-ebea31537968 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:43.701205 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744bb7b8-63ec-4d72-ac47-220984b7b53f None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:43.721925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca41d50-698e-498b-a719-4d1d7c755372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:43.723392 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca41d50-698e-498b-a719-4d1d7c755372 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:43.723925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca41d50-698e-498b-a719-4d1d7c755372 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:43.724436 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca41d50-698e-498b-a719-4d1d7c755372 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:43.727375 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:43.737367 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca41d50-698e-498b-a719-4d1d7c755372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:43.743421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-7ca41d50-698e-498b-a719-4d1d7c755372 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:43.743421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:43.743421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:43.743421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:43.743421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:43.743421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:43.743421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:43.743421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:43.743421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:43.743421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:43.743421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:43.743421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:43.743421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:43.743421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:43.743421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:43.743421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:43.744319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:43.744319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:43.744319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:43.744319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:43.744319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:43.744319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:43.744319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:43.744319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:43.744319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:43.744319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:43.744319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:43.744319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:43.744319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:43.744319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:43.744319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:43.744319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:43.745147 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:43.745147 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:43.745147 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:43.745147 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:43.745147 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:43.745147 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:43.745147 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:43.745147 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:43.745147 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:43.745147 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:43.745147 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:43.745147 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:40:43.746372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe52b8-e3a2-49b6-9ee6-85c6fe00beb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:43.746372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe52b8-e3a2-49b6-9ee6-85c6fe00beb8 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:43.746372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe52b8-e3a2-49b6-9ee6-85c6fe00beb8 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:43.746372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe52b8-e3a2-49b6-9ee6-85c6fe00beb8 None admin] PATH_INFO: `/v3/groups/649f764bc71c4fff9fabef5a0fd2bbb5` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:43.747173 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe52b8-e3a2-49b6-9ee6-85c6fe00beb8 None admin] RBAC: Authorizing `identity:get_group(group_id=649f764bc71c4fff9fabef5a0fd2bbb5)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:43.748550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 183/366] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Aug 11 09:40:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:43.748654 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe52b8-e3a2-49b6-9ee6-85c6fe00beb8 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:43.750133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0d988-1065-4f22-b6a5-5886a7eecbb3 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:43.750437 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 184/367] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Aug 11 09:40:43 2022] GET /identity/v3/groups/649f764bc71c4fff9fabef5a0fd2bbb5 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:43.750717 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0d988-1065-4f22-b6a5-5886a7eecbb3 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:43.751189 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0d988-1065-4f22-b6a5-5886a7eecbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:43.755333 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe52b8-e3a2-49b6-9ee6-85c6fe00beb8 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:43.779057 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-28b0d988-1065-4f22-b6a5-5886a7eecbb3 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:43.780267 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-28b0d988-1065-4f22-b6a5-5886a7eecbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:43.838753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:43.864765 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 184/368] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:43.865619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0d988-1065-4f22-b6a5-5886a7eecbb3 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:43.878177 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe52b8-e3a2-49b6-9ee6-85c6fe00beb8 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:43.945026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64dce3-80f8-442a-8e62-e8437643fa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:43.945697 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64dce3-80f8-442a-8e62-e8437643fa89 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:43.945981 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64dce3-80f8-442a-8e62-e8437643fa89 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:43.946322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64dce3-80f8-442a-8e62-e8437643fa89 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:43.946997 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64dce3-80f8-442a-8e62-e8437643fa89 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:43.947297 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64dce3-80f8-442a-8e62-e8437643fa89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:43.949339 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64dce3-80f8-442a-8e62-e8437643fa89 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:43.966145 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 185/369] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:40:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:43.967115 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64dce3-80f8-442a-8e62-e8437643fa89 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:43.979950 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0d988-1065-4f22-b6a5-5886a7eecbb3 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:44.023714 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b2a34-c79f-40c5-89b4-91c4d8556435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:44.024389 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b2a34-c79f-40c5-89b4-91c4d8556435 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:44.024667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b2a34-c79f-40c5-89b4-91c4d8556435 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:44.024935 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b2a34-c79f-40c5-89b4-91c4d8556435 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:44.025680 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b2a34-c79f-40c5-89b4-91c4d8556435 None admin] RBAC: Adding query filter params (group.id=649f764bc71c4fff9fabef5a0fd2bbb5, role.id=9b9c9f22f65c459bacd757d5de4d5b8e, scope.project.id=99fc3f2cb288430c9a330338644185b3) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:44.025986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b2a34-c79f-40c5-89b4-91c4d8556435 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:44.027676 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b2a34-c79f-40c5-89b4-91c4d8556435 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:44.035771 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:44.037237 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 185/370] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Aug 11 09:40:43 2022] GET /identity/v3/role_assignments?group.id=649f764bc71c4fff9fabef5a0fd2bbb5&scope.project.id=99fc3f2cb288430c9a330338644185b3&role.id=9b9c9f22f65c459bacd757d5de4d5b8e => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:44.042360 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b2a34-c79f-40c5-89b4-91c4d8556435 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:44.136215 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:44.145222 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64dce3-80f8-442a-8e62-e8437643fa89 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:44.221592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d3dcf-4869-4037-8125-d95fa9e89980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:44.222255 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d3dcf-4869-4037-8125-d95fa9e89980 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:44.222532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d3dcf-4869-4037-8125-d95fa9e89980 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:44.222798 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d3dcf-4869-4037-8125-d95fa9e89980 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:44.237622 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b2a34-c79f-40c5-89b4-91c4d8556435 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:44.238117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d3dcf-4869-4037-8125-d95fa9e89980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:44.244463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-037d3dcf-4869-4037-8125-d95fa9e89980 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:40:44.244463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:44.244463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:44.244463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:44.244463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:44.244463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:44.244463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:44.244463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:44.244463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:44.244463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:44.244463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:44.244463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:44.244463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:44.244463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:44.244463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:44.244463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:44.245324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:44.245324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:44.245324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:44.245324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:44.245324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:44.245324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:44.245324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:44.245324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:44.245324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:44.245324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:44.245324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:44.245324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:44.245324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:44.245324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:44.245324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:44.245324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:44.246722 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:44.246722 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:44.246722 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:44.246722 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:44.246722 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:44.246722 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:44.246722 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:44.246722 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:44.246722 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:44.246722 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:44.246722 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:40:44.246722 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:44.250658 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 186/371] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:40:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:44.253388 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d3dcf-4869-4037-8125-d95fa9e89980 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:44.302416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf052dc3-b87f-4547-bc90-81cbe7d061e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:44.303137 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf052dc3-b87f-4547-bc90-81cbe7d061e1 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:44.303422 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf052dc3-b87f-4547-bc90-81cbe7d061e1 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:44.303703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf052dc3-b87f-4547-bc90-81cbe7d061e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:44.370342 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d3dcf-4869-4037-8125-d95fa9e89980 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:44.382282 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:44.409658 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4764588-f253-4058-938d-34f61ae6d05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:44.410464 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4764588-f253-4058-938d-34f61ae6d05d None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:44.410806 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4764588-f253-4058-938d-34f61ae6d05d None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:44.411143 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4764588-f253-4058-938d-34f61ae6d05d None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:44.411968 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4764588-f253-4058-938d-34f61ae6d05d None admin] RBAC: Adding query filter params (name=admin) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:44.412334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4764588-f253-4058-938d-34f61ae6d05d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:44.413927 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4764588-f253-4058-938d-34f61ae6d05d None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:44.430139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 187/372] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:44.431835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4764588-f253-4058-938d-34f61ae6d05d None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:44.445255 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf052dc3-b87f-4547-bc90-81cbe7d061e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:44.446876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf052dc3-b87f-4547-bc90-81cbe7d061e1 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:44.523694 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:44.549207 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4764588-f253-4058-938d-34f61ae6d05d None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:44.590381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79081c98-e618-4686-842d-ffaf2ff83980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:44.594102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79081c98-e618-4686-842d-ffaf2ff83980 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:44.594102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79081c98-e618-4686-842d-ffaf2ff83980 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:44.594102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79081c98-e618-4686-842d-ffaf2ff83980 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:44.646888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 186/373] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:40:44.658441 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf052dc3-b87f-4547-bc90-81cbe7d061e1 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:44.658589 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:44.670801 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79081c98-e618-4686-842d-ffaf2ff83980 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:44.673452 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79081c98-e618-4686-842d-ffaf2ff83980 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:44.789920 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf052dc3-b87f-4547-bc90-81cbe7d061e1 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:44.810446 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 188/374] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:40:44.815362 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79081c98-e618-4686-842d-ffaf2ff83980 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:44.832943 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfa525-ede9-41ce-8090-d3db3b407d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:44.833368 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfa525-ede9-41ce-8090-d3db3b407d3e None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:44.833645 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfa525-ede9-41ce-8090-d3db3b407d3e None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:44.833917 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfa525-ede9-41ce-8090-d3db3b407d3e None admin] PATH_INFO: `/v3/projects/99fc3f2cb288430c9a330338644185b3` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:44.835092 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edfa525-ede9-41ce-8090-d3db3b407d3e None admin] RBAC: Authorizing `identity:get_project(project_id=99fc3f2cb288430c9a330338644185b3)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:44.836555 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edfa525-ede9-41ce-8090-d3db3b407d3e None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:44.839558 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 187/375] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:44 2022] GET /identity/v3/projects/99fc3f2cb288430c9a330338644185b3 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:44.846186 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfa525-ede9-41ce-8090-d3db3b407d3e None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:44.859389 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:44.902626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:44.941333 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79081c98-e618-4686-842d-ffaf2ff83980 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:44.965873 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfa525-ede9-41ce-8090-d3db3b407d3e None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:44.988692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136df72-a6ba-406a-bee9-b5dfbd509042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:44.990217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136df72-a6ba-406a-bee9-b5dfbd509042 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:44.990844 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136df72-a6ba-406a-bee9-b5dfbd509042 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:44.991415 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136df72-a6ba-406a-bee9-b5dfbd509042 None admin] PATH_INFO: `/v3/projects/ba0bc4e750d24ff2b5db7519dfabe004` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:44.993413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136df72-a6ba-406a-bee9-b5dfbd509042 None admin] RBAC: Authorizing `identity:get_project(project_id=ba0bc4e750d24ff2b5db7519dfabe004)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:44.995508 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136df72-a6ba-406a-bee9-b5dfbd509042 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:45.003369 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 189/376] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:44 2022] GET /identity/v3/projects/ba0bc4e750d24ff2b5db7519dfabe004 => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:45.005570 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136df72-a6ba-406a-bee9-b5dfbd509042 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:45.009109 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84711376-5685-4c75-a496-e476c03f5270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:45.010404 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84711376-5685-4c75-a496-e476c03f5270 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:45.010404 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84711376-5685-4c75-a496-e476c03f5270 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:45.010404 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84711376-5685-4c75-a496-e476c03f5270 None admin] PATH_INFO: `/v3/groups/649f764bc71c4fff9fabef5a0fd2bbb5` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:45.011988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84711376-5685-4c75-a496-e476c03f5270 None admin] RBAC: Authorizing `identity:get_group(group_id=649f764bc71c4fff9fabef5a0fd2bbb5)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:45.013439 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84711376-5685-4c75-a496-e476c03f5270 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:45.015240 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 188/377] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Aug 11 09:40:44 2022] GET /identity/v3/groups/649f764bc71c4fff9fabef5a0fd2bbb5 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:45.021800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84711376-5685-4c75-a496-e476c03f5270 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:45.127321 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:45.140746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136df72-a6ba-406a-bee9-b5dfbd509042 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:45.159598 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84711376-5685-4c75-a496-e476c03f5270 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:45.192036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa314ca-c316-4791-b878-3ee6386c8a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:45.192678 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa314ca-c316-4791-b878-3ee6386c8a4c None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:45.192952 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa314ca-c316-4791-b878-3ee6386c8a4c None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:45.193220 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa314ca-c316-4791-b878-3ee6386c8a4c None admin] PATH_INFO: `/v3/groups/178b6792acd94111810fde22aff0c8cd` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:45.201278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa314ca-c316-4791-b878-3ee6386c8a4c None admin] RBAC: Authorizing `identity:get_group(group_id=178b6792acd94111810fde22aff0c8cd)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:45.202891 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa314ca-c316-4791-b878-3ee6386c8a4c None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:45.209285 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 190/378] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Aug 11 09:40:45 2022] GET /identity/v3/groups/178b6792acd94111810fde22aff0c8cd => generated 229 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:45.209407 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26e1b2-3fe7-457b-a269-5222a66c042c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:45.209407 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26e1b2-3fe7-457b-a269-5222a66c042c None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:45.209407 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26e1b2-3fe7-457b-a269-5222a66c042c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:45.209407 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26e1b2-3fe7-457b-a269-5222a66c042c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:45.209682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26e1b2-3fe7-457b-a269-5222a66c042c None admin] RBAC: Adding query filter params (group.id=649f764bc71c4fff9fabef5a0fd2bbb5, role.id=da3ceb6dfa1746f19dbaf26e2c3ef7ab, scope.project.id=99fc3f2cb288430c9a330338644185b3) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:45.209682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26e1b2-3fe7-457b-a269-5222a66c042c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:45.211115 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa314ca-c316-4791-b878-3ee6386c8a4c None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:45.212143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26e1b2-3fe7-457b-a269-5222a66c042c None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:45.222669 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:45.227641 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 189/379] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Aug 11 09:40:45 2022] GET /identity/v3/role_assignments?group.id=649f764bc71c4fff9fabef5a0fd2bbb5&scope.project.id=99fc3f2cb288430c9a330338644185b3&role.id=da3ceb6dfa1746f19dbaf26e2c3ef7ab => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:45.327440 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b29a3a-c97e-412a-a01c-52b754b4b894 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:45.327762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b29a3a-c97e-412a-a01c-52b754b4b894 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:45.327994 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b29a3a-c97e-412a-a01c-52b754b4b894 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:45.329404 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 190/380] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:40:45.334542 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955d133-5618-41f5-8d87-0194a2b8aefd None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:45.334814 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955d133-5618-41f5-8d87-0194a2b8aefd None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:45.335075 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955d133-5618-41f5-8d87-0194a2b8aefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:45.360910 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-0955d133-5618-41f5-8d87-0194a2b8aefd None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:45.362627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-0955d133-5618-41f5-8d87-0194a2b8aefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:45.366762 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa314ca-c316-4791-b878-3ee6386c8a4c None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:45.405025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421273d-3e5c-4b56-9a28-3910e22b6b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:45.405589 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421273d-3e5c-4b56-9a28-3910e22b6b67 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:45.405945 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421273d-3e5c-4b56-9a28-3910e22b6b67 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:45.406255 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421273d-3e5c-4b56-9a28-3910e22b6b67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:45.406990 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421273d-3e5c-4b56-9a28-3910e22b6b67 None admin] RBAC: Adding query filter params (group.id=178b6792acd94111810fde22aff0c8cd, role.id=6aae1c66f3f04cec80ed72c20d7e033b, scope.project.id=ba0bc4e750d24ff2b5db7519dfabe004) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:45.407307 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421273d-3e5c-4b56-9a28-3910e22b6b67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:45.408766 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421273d-3e5c-4b56-9a28-3910e22b6b67 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:45.415356 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 191/381] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Aug 11 09:40:45 2022] GET /identity/v3/role_assignments?group.id=178b6792acd94111810fde22aff0c8cd&scope.project.id=ba0bc4e750d24ff2b5db7519dfabe004&role.id=6aae1c66f3f04cec80ed72c20d7e033b => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:45.482139 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 191/382] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:45.506934 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421273d-3e5c-4b56-9a28-3910e22b6b67 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:45.581569 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:45.620432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421273d-3e5c-4b56-9a28-3910e22b6b67 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:45.666703 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561aa709-264e-4861-92f5-4ad37fff38b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:45.668172 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561aa709-264e-4861-92f5-4ad37fff38b3 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:45.668599 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561aa709-264e-4861-92f5-4ad37fff38b3 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:45.669011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561aa709-264e-4861-92f5-4ad37fff38b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:45.680604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561aa709-264e-4861-92f5-4ad37fff38b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:45.687231 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-561aa709-264e-4861-92f5-4ad37fff38b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:45.687231 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:45.687231 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:45.687231 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:45.687231 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:45.687231 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:45.687231 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:45.687231 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:45.687231 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:45.687231 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:45.687231 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:45.687231 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:45.687231 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:45.687231 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:45.687231 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:45.687231 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:45.688347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:45.688347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:45.688347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:45.688347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:45.688347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:45.688347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:45.688347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:45.688347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:45.688347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:45.688347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:45.688347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:45.688347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:45.688347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:45.688347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:45.688347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:45.688347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:45.689382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:45.689382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:45.689382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:45.689382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:45.689382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:45.689382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:45.689382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:45.689382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:45.689382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:45.689382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:45.689382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:45.689382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:45.691718 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 192/383] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:45.697751 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955d133-5618-41f5-8d87-0194a2b8aefd None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:45.771649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:45.802709 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955d133-5618-41f5-8d87-0194a2b8aefd None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:45.838749 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef55aca-c16f-47c0-98e5-630be519797a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:45.839890 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef55aca-c16f-47c0-98e5-630be519797a None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:45.840184 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef55aca-c16f-47c0-98e5-630be519797a None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:45.840456 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef55aca-c16f-47c0-98e5-630be519797a None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:45.841120 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef55aca-c16f-47c0-98e5-630be519797a None admin] RBAC: Adding query filter params (name=member) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:45.841421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef55aca-c16f-47c0-98e5-630be519797a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:45.842826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef55aca-c16f-47c0-98e5-630be519797a None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:45.851856 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 192/384] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:45.858062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561aa709-264e-4861-92f5-4ad37fff38b3 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:45.985032 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561aa709-264e-4861-92f5-4ad37fff38b3 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:46.018128 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:46.025887 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5b0a5-f834-4d3f-b03d-3b6c0480a2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:46.026547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5b0a5-f834-4d3f-b03d-3b6c0480a2da None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:46.026826 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5b0a5-f834-4d3f-b03d-3b6c0480a2da None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:46.027130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5b0a5-f834-4d3f-b03d-3b6c0480a2da None admin] PATH_INFO: `/v3/groups/649f764bc71c4fff9fabef5a0fd2bbb5` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:46.029973 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5b0a5-f834-4d3f-b03d-3b6c0480a2da None admin] RBAC: Authorizing `identity:get_group(group_id=649f764bc71c4fff9fabef5a0fd2bbb5)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:46.031519 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5b0a5-f834-4d3f-b03d-3b6c0480a2da None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:46.033347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 193/385] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Aug 11 09:40:45 2022] GET /identity/v3/groups/649f764bc71c4fff9fabef5a0fd2bbb5 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:46.039074 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef55aca-c16f-47c0-98e5-630be519797a None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:46.171794 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef55aca-c16f-47c0-98e5-630be519797a None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:46.214974 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f88875-235f-4494-9cde-00be5908143f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:46.215610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f88875-235f-4494-9cde-00be5908143f None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:46.215887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f88875-235f-4494-9cde-00be5908143f None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:46.216207 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f88875-235f-4494-9cde-00be5908143f None admin] PATH_INFO: `/v3/projects/efa1046add794b2eb629463dd092363b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:46.218938 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f88875-235f-4494-9cde-00be5908143f None admin] RBAC: Authorizing `identity:get_project(project_id=efa1046add794b2eb629463dd092363b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:46.220380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f88875-235f-4494-9cde-00be5908143f None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:46.222384 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 193/386] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:46 2022] GET /identity/v3/projects/efa1046add794b2eb629463dd092363b => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:46.227996 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5b0a5-f834-4d3f-b03d-3b6c0480a2da None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:46.341287 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e73b3-af79-4fc4-961e-58bacc543be1 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:46.341618 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e73b3-af79-4fc4-961e-58bacc543be1 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:46.341830 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e73b3-af79-4fc4-961e-58bacc543be1 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:46.343495 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 194/387] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:40:46.350444 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5b0a5-f834-4d3f-b03d-3b6c0480a2da None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:46.351492 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfbf35-ca37-48d1-9fd8-3c5dd656bcbd None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:46.351774 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfbf35-ca37-48d1-9fd8-3c5dd656bcbd None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:46.352047 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfbf35-ca37-48d1-9fd8-3c5dd656bcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:46.363464 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:46.384021 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-f5dfbf35-ca37-48d1-9fd8-3c5dd656bcbd None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:46.385235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-f5dfbf35-ca37-48d1-9fd8-3c5dd656bcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:46.398256 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51be96-971b-4cbe-87f5-41d3c6e66da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:46.399276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51be96-971b-4cbe-87f5-41d3c6e66da2 None admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:46.399759 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51be96-971b-4cbe-87f5-41d3c6e66da2 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:46.400227 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51be96-971b-4cbe-87f5-41d3c6e66da2 None admin] PATH_INFO: `/v3/projects/efa1046add794b2eb629463dd092363b/groups/649f764bc71c4fff9fabef5a0fd2bbb5/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:46.402431 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51be96-971b-4cbe-87f5-41d3c6e66da2 None admin] RBAC: Authorizing `identity:create_grant(project_id=efa1046add794b2eb629463dd092363b, group_id=649f764bc71c4fff9fabef5a0fd2bbb5, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:46.404083 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51be96-971b-4cbe-87f5-41d3c6e66da2 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:46.464582 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 195/388] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 09:40:46.472282 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 194/389] 10.222.0.13 () {58 vars in 1442 bytes} [Thu Aug 11 09:40:46 2022] PUT /identity/v3/projects/efa1046add794b2eb629463dd092363b/groups/649f764bc71c4fff9fabef5a0fd2bbb5/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:40:46.502005 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfbf35-ca37-48d1-9fd8-3c5dd656bcbd None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:46.607529 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e60d72-d816-4680-bd0c-a79b1165d272 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:46.607826 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e60d72-d816-4680-bd0c-a79b1165d272 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:46.607993 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e60d72-d816-4680-bd0c-a79b1165d272 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:46.609395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 195/390] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:46.615849 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92789ba2-d1fa-4efd-8308-d0fdc1724f94 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:46.616161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92789ba2-d1fa-4efd-8308-d0fdc1724f94 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:46.616401 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92789ba2-d1fa-4efd-8308-d0fdc1724f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:46.620507 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfbf35-ca37-48d1-9fd8-3c5dd656bcbd None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:46.658685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:46.663855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53e19f-1ae5-4cc5-ad52-432bea5798b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:46.668637 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53e19f-1ae5-4cc5-ad52-432bea5798b9 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:46.668637 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53e19f-1ae5-4cc5-ad52-432bea5798b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:46.668637 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53e19f-1ae5-4cc5-ad52-432bea5798b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:46.668888 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-92789ba2-d1fa-4efd-8308-d0fdc1724f94 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:46.669077 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-92789ba2-d1fa-4efd-8308-d0fdc1724f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:46.678559 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53e19f-1ae5-4cc5-ad52-432bea5798b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:46.684230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-bf53e19f-1ae5-4cc5-ad52-432bea5798b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:46.684230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:46.684230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:46.684230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:46.684230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:46.684230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:46.684230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:46.684230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:46.684230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:46.684230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:46.684230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:46.684230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:46.684230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:46.684230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:46.684230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:46.684230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:46.685225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:46.685225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:46.685225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:46.685225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:46.685225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:46.685225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:46.685225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:46.685225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:46.685225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:46.685225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:46.685225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:46.685225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:46.685225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:46.685225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:46.685225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:46.685225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:46.686322 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:46.686322 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:46.686322 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:46.686322 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:46.686322 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:46.686322 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:46.686322 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:46.686322 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:46.686322 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:46.686322 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:46.686322 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:46.686322 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:40:46.686322 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 196/391] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Aug 11 09:40:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:46.692421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53e19f-1ae5-4cc5-ad52-432bea5798b9 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:46.790483 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:46.807435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 196/392] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 09:40:46.830663 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53e19f-1ae5-4cc5-ad52-432bea5798b9 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:46.844647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92789ba2-d1fa-4efd-8308-d0fdc1724f94 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:46.895839 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb1ac4-fcd3-430e-80f0-e56a319015d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:46.896372 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb1ac4-fcd3-430e-80f0-e56a319015d7 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:46.896649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb1ac4-fcd3-430e-80f0-e56a319015d7 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:46.896922 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb1ac4-fcd3-430e-80f0-e56a319015d7 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:46.897589 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb1ac4-fcd3-430e-80f0-e56a319015d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:46.897891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb1ac4-fcd3-430e-80f0-e56a319015d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:46.899287 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb1ac4-fcd3-430e-80f0-e56a319015d7 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:46.908690 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 197/393] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:40:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:46.914265 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb1ac4-fcd3-430e-80f0-e56a319015d7 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:46.982114 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:47.018356 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92789ba2-d1fa-4efd-8308-d0fdc1724f94 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:47.048855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb1ac4-fcd3-430e-80f0-e56a319015d7 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:47.068868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07faa380-8908-4a53-b7c0-3808e39cb99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:47.069932 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faa380-8908-4a53-b7c0-3808e39cb99e None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:47.070462 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faa380-8908-4a53-b7c0-3808e39cb99e None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:47.070930 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faa380-8908-4a53-b7c0-3808e39cb99e None admin] PATH_INFO: `/v3/roles/member` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:47.097925 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07faa380-8908-4a53-b7c0-3808e39cb99e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:47.104442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-07faa380-8908-4a53-b7c0-3808e39cb99e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:47.104442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:47.104442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:47.104442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:47.104442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:47.104442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:47.104442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:47.104442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:47.104442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:47.104442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:47.104442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:47.104442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:47.104442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:47.104442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:47.104442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:47.104442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:47.105347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:47.105347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:47.105347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:47.105347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:47.105347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:47.105347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:47.105347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:47.105347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:47.105347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:47.105347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:47.105347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:47.105347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:47.105347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:47.105347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:47.105347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:47.105347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:47.106188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:47.106188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:47.106188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:47.106188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:47.106188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:47.106188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:47.106188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:47.106188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:47.106188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:47.106188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:47.106188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:47.106188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:47.109248 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 197/394] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:40:47.116526 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07faa380-8908-4a53-b7c0-3808e39cb99e None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:47.128062 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec941a-96e4-4d97-8bab-9bcccb4383c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:47.128754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec941a-96e4-4d97-8bab-9bcccb4383c8 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:47.129046 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec941a-96e4-4d97-8bab-9bcccb4383c8 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:47.129320 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec941a-96e4-4d97-8bab-9bcccb4383c8 None admin] PATH_INFO: `/v3/groups/649f764bc71c4fff9fabef5a0fd2bbb5` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:47.134111 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec941a-96e4-4d97-8bab-9bcccb4383c8 None admin] RBAC: Authorizing `identity:get_group(group_id=649f764bc71c4fff9fabef5a0fd2bbb5)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:47.134111 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec941a-96e4-4d97-8bab-9bcccb4383c8 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:47.137562 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 198/395] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Aug 11 09:40:46 2022] GET /identity/v3/groups/649f764bc71c4fff9fabef5a0fd2bbb5 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:47.142113 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec941a-96e4-4d97-8bab-9bcccb4383c8 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:47.219340 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:47.303547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07faa380-8908-4a53-b7c0-3808e39cb99e None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:47.323121 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec941a-96e4-4d97-8bab-9bcccb4383c8 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:47.347048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7621403-071d-4c0e-aca3-761add205204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:47.348291 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7621403-071d-4c0e-aca3-761add205204 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:47.348575 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7621403-071d-4c0e-aca3-761add205204 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:47.348847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7621403-071d-4c0e-aca3-761add205204 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:47.349664 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7621403-071d-4c0e-aca3-761add205204 None admin] RBAC: Adding query filter params (name=member) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:47.349972 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7621403-071d-4c0e-aca3-761add205204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:47.351523 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7621403-071d-4c0e-aca3-761add205204 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:47.361979 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 198/396] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:47.363996 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:47.367977 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7621403-071d-4c0e-aca3-761add205204 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:47.390474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c43ba1-5e03-4a46-a0e0-3288d4f7b67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:47.391462 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c43ba1-5e03-4a46-a0e0-3288d4f7b67f None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:47.392083 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c43ba1-5e03-4a46-a0e0-3288d4f7b67f None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:47.392557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c43ba1-5e03-4a46-a0e0-3288d4f7b67f None admin] PATH_INFO: `/v3/projects/efa1046add794b2eb629463dd092363b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:47.395230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c43ba1-5e03-4a46-a0e0-3288d4f7b67f None admin] RBAC: Authorizing `identity:get_project(project_id=efa1046add794b2eb629463dd092363b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:47.397057 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c43ba1-5e03-4a46-a0e0-3288d4f7b67f None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:47.399735 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 199/397] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:47 2022] GET /identity/v3/projects/efa1046add794b2eb629463dd092363b => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:47.405881 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c43ba1-5e03-4a46-a0e0-3288d4f7b67f None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:47.521234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c43ba1-5e03-4a46-a0e0-3288d4f7b67f None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:47.543415 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7621403-071d-4c0e-aca3-761add205204 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:47.558246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad69fc-c5d5-40bb-8694-e82891152f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:47.559188 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad69fc-c5d5-40bb-8694-e82891152f0e None admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:47.559666 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad69fc-c5d5-40bb-8694-e82891152f0e None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:47.560140 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad69fc-c5d5-40bb-8694-e82891152f0e None admin] PATH_INFO: `/v3/projects/efa1046add794b2eb629463dd092363b/groups/649f764bc71c4fff9fabef5a0fd2bbb5/roles/da3ceb6dfa1746f19dbaf26e2c3ef7ab` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:47.562575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad69fc-c5d5-40bb-8694-e82891152f0e None admin] RBAC: Authorizing `identity:create_grant(project_id=efa1046add794b2eb629463dd092363b, group_id=649f764bc71c4fff9fabef5a0fd2bbb5, role_id=da3ceb6dfa1746f19dbaf26e2c3ef7ab)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:47.564046 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:47.565269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad69fc-c5d5-40bb-8694-e82891152f0e None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:47.602936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4dfdb-ac1c-44f2-a61d-de8861201983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:47.603962 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4dfdb-ac1c-44f2-a61d-de8861201983 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:47.604444 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4dfdb-ac1c-44f2-a61d-de8861201983 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:47.604999 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4dfdb-ac1c-44f2-a61d-de8861201983 None admin] PATH_INFO: `/v3/groups/649f764bc71c4fff9fabef5a0fd2bbb5` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:47.607451 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4dfdb-ac1c-44f2-a61d-de8861201983 None admin] RBAC: Authorizing `identity:get_group(group_id=649f764bc71c4fff9fabef5a0fd2bbb5)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:47.609160 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4dfdb-ac1c-44f2-a61d-de8861201983 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:47.611421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 199/398] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Aug 11 09:40:47 2022] GET /identity/v3/groups/649f764bc71c4fff9fabef5a0fd2bbb5 => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:47.616573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4dfdb-ac1c-44f2-a61d-de8861201983 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:47.631341 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 200/399] 10.222.0.13 () {58 vars in 1442 bytes} [Thu Aug 11 09:40:47 2022] PUT /identity/v3/projects/efa1046add794b2eb629463dd092363b/groups/649f764bc71c4fff9fabef5a0fd2bbb5/roles/da3ceb6dfa1746f19dbaf26e2c3ef7ab => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 09:40:47.754668 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4dfdb-ac1c-44f2-a61d-de8861201983 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:47.797003 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f617d7-b522-4782-b7d1-46b5a5722b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:47.798122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f617d7-b522-4782-b7d1-46b5a5722b49 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:47.798639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f617d7-b522-4782-b7d1-46b5a5722b49 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:47.799143 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f617d7-b522-4782-b7d1-46b5a5722b49 None admin] PATH_INFO: `/v3/projects/99fc3f2cb288430c9a330338644185b3` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:47.800750 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f617d7-b522-4782-b7d1-46b5a5722b49 None admin] RBAC: Authorizing `identity:get_project(project_id=99fc3f2cb288430c9a330338644185b3)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:47.802484 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f617d7-b522-4782-b7d1-46b5a5722b49 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:47.804706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 200/400] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:47 2022] GET /identity/v3/projects/99fc3f2cb288430c9a330338644185b3 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:47.811870 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad69fc-c5d5-40bb-8694-e82891152f0e None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:47.882116 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:47.942679 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad69fc-c5d5-40bb-8694-e82891152f0e None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:47.987073 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6e7c0-8b3c-4aaf-8811-2379267f94f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:47.988259 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6e7c0-8b3c-4aaf-8811-2379267f94f8 None admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:47.988776 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6e7c0-8b3c-4aaf-8811-2379267f94f8 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:47.989268 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6e7c0-8b3c-4aaf-8811-2379267f94f8 None admin] PATH_INFO: `/v3/projects/99fc3f2cb288430c9a330338644185b3/groups/649f764bc71c4fff9fabef5a0fd2bbb5/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:47.991483 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6e7c0-8b3c-4aaf-8811-2379267f94f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=99fc3f2cb288430c9a330338644185b3, group_id=649f764bc71c4fff9fabef5a0fd2bbb5, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:47.993130 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6e7c0-8b3c-4aaf-8811-2379267f94f8 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:48.079017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 201/401] 10.222.0.13 () {58 vars in 1442 bytes} [Thu Aug 11 09:40:47 2022] PUT /identity/v3/projects/99fc3f2cb288430c9a330338644185b3/groups/649f764bc71c4fff9fabef5a0fd2bbb5/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:40:48.254463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29028b8-78d8-405f-9d1e-7c595cbb23c6 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:48.255366 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29028b8-78d8-405f-9d1e-7c595cbb23c6 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:48.255642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29028b8-78d8-405f-9d1e-7c595cbb23c6 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:48.257121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 201/402] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:48.263298 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3216a-3e8c-41ee-b874-5fc2091969f6 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:48.263583 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3216a-3e8c-41ee-b874-5fc2091969f6 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:48.263855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3216a-3e8c-41ee-b874-5fc2091969f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:48.287158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-95e3216a-3e8c-41ee-b874-5fc2091969f6 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:48.288557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-95e3216a-3e8c-41ee-b874-5fc2091969f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:48.368769 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 202/403] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:48.394498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29028b8-78d8-405f-9d1e-7c595cbb23c6 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:48.402285 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937cd9c-5d38-4999-b7fb-55e064f6a8f9 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:48.402625 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937cd9c-5d38-4999-b7fb-55e064f6a8f9 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:48.402898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937cd9c-5d38-4999-b7fb-55e064f6a8f9 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:48.404244 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 203/404] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:40:48.413759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bded25-acea-418f-9b59-484797e0eaed None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:48.414072 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bded25-acea-418f-9b59-484797e0eaed None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:48.414351 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bded25-acea-418f-9b59-484797e0eaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:48.444560 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-d4bded25-acea-418f-9b59-484797e0eaed None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:48.446515 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-d4bded25-acea-418f-9b59-484797e0eaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:48.463935 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:48.510128 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:48.536151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29028b8-78d8-405f-9d1e-7c595cbb23c6 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:48.570654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 204/405] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:48.576240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f885a-55fb-42fb-8c41-094fcdf18b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:48.576929 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f885a-55fb-42fb-8c41-094fcdf18b62 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:48.577207 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f885a-55fb-42fb-8c41-094fcdf18b62 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:48.577539 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f885a-55fb-42fb-8c41-094fcdf18b62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:48.588478 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f885a-55fb-42fb-8c41-094fcdf18b62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:48.593906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-ee2f885a-55fb-42fb-8c41-094fcdf18b62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:40:48.593906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:48.593906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:48.593906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:48.593906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:48.593906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:48.593906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:48.593906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:48.593906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:48.593906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:48.593906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:48.593906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:48.593906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:48.593906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:48.593906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:48.593906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:48.594829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:48.594829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:48.594829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:48.594829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:48.594829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:48.594829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:48.594829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:48.594829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:48.594829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:48.594829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:48.594829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:48.594829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:48.594829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:48.594829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:48.594829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:48.594829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:48.595660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:48.595660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:48.595660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:48.595660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:48.595660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:48.595660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:48.595660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:48.595660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:48.595660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:48.595660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:48.595660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:40:48.595660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:48.595660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 202/406] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:40:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:48.601297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bded25-acea-418f-9b59-484797e0eaed None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:48.615829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f885a-55fb-42fb-8c41-094fcdf18b62 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:48.814061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bded25-acea-418f-9b59-484797e0eaed None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:48.825650 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f885a-55fb-42fb-8c41-094fcdf18b62 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:48.831041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:48.858742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0b993-cd03-4b61-b091-f33afb5ff12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:48.859358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0b993-cd03-4b61-b091-f33afb5ff12d None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:48.860101 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0b993-cd03-4b61-b091-f33afb5ff12d None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:48.860381 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0b993-cd03-4b61-b091-f33afb5ff12d None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:48.861055 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0b993-cd03-4b61-b091-f33afb5ff12d None admin] RBAC: Adding query filter params (name=admin) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:48.861358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0b993-cd03-4b61-b091-f33afb5ff12d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:48.863048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0b993-cd03-4b61-b091-f33afb5ff12d None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:48.872733 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 205/407] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:48.878208 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0b993-cd03-4b61-b091-f33afb5ff12d None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:48.898850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3c49b-a0da-46b1-ad3c-2ddb8aa8e36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:48.899506 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3c49b-a0da-46b1-ad3c-2ddb8aa8e36c None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:48.899785 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3c49b-a0da-46b1-ad3c-2ddb8aa8e36c None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:48.900053 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3c49b-a0da-46b1-ad3c-2ddb8aa8e36c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:48.932105 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3c49b-a0da-46b1-ad3c-2ddb8aa8e36c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:48.934419 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:48.937270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-92e3c49b-a0da-46b1-ad3c-2ddb8aa8e36c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:48.937270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:48.937270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:48.937270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:48.937270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:48.937270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:48.937270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:48.937270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:48.937270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:48.937270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:48.937270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:48.937270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:48.937270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:48.937270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:48.937270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:48.937270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:48.938152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:48.938152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:48.938152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:48.938152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:48.938152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:48.938152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:48.938152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:48.938152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:48.938152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:48.938152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:48.938152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:48.938152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:48.938152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:48.938152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:48.938152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:48.938152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:48.938953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:48.938953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:48.938953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:48.938953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:48.938953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:48.938953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:48.938953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:48.938953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:48.938953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:48.938953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:48.938953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:48.938953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:48.938953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 203/408] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Aug 11 09:40:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:40:48.946065 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3c49b-a0da-46b1-ad3c-2ddb8aa8e36c None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:49.041008 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0b993-cd03-4b61-b091-f33afb5ff12d None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:49.053050 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3c49b-a0da-46b1-ad3c-2ddb8aa8e36c None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:49.089769 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96aec2-e5d9-482f-8463-bdcc40b9f7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:49.094101 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96aec2-e5d9-482f-8463-bdcc40b9f7e3 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:49.094101 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96aec2-e5d9-482f-8463-bdcc40b9f7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:49.094101 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96aec2-e5d9-482f-8463-bdcc40b9f7e3 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:49.094101 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96aec2-e5d9-482f-8463-bdcc40b9f7e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:49.094101 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96aec2-e5d9-482f-8463-bdcc40b9f7e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:49.094101 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96aec2-e5d9-482f-8463-bdcc40b9f7e3 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:49.100532 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26758722-732c-41f2-accb-fcf99c1edb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:49.101476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26758722-732c-41f2-accb-fcf99c1edb21 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:49.101958 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26758722-732c-41f2-accb-fcf99c1edb21 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:49.102460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26758722-732c-41f2-accb-fcf99c1edb21 None admin] PATH_INFO: `/v3/groups/178b6792acd94111810fde22aff0c8cd` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:49.102651 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 204/409] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:40:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:49.108167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26758722-732c-41f2-accb-fcf99c1edb21 None admin] RBAC: Authorizing `identity:get_group(group_id=178b6792acd94111810fde22aff0c8cd)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:49.112369 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26758722-732c-41f2-accb-fcf99c1edb21 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:49.112502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae43981-68fd-4ba7-85bb-d3a78174d03b None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:49.112502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae43981-68fd-4ba7-85bb-d3a78174d03b None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:49.112502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae43981-68fd-4ba7-85bb-d3a78174d03b None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:49.113613 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 206/410] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Aug 11 09:40:48 2022] GET /identity/v3/groups/178b6792acd94111810fde22aff0c8cd => generated 229 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:49.113797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 205/411] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:40:49.117887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26758722-732c-41f2-accb-fcf99c1edb21 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:49.119715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae43981-68fd-4ba7-85bb-d3a78174d03b None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:49.147906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:49.236503 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae43981-68fd-4ba7-85bb-d3a78174d03b None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:49.237206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26758722-732c-41f2-accb-fcf99c1edb21 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:49.239019 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:49.274534 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646e90b-9520-4296-a5ee-33cdd59d1903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:49.275230 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646e90b-9520-4296-a5ee-33cdd59d1903 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:49.275426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646e90b-9520-4296-a5ee-33cdd59d1903 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:49.275691 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646e90b-9520-4296-a5ee-33cdd59d1903 None admin] PATH_INFO: `/v3/projects/ba0bc4e750d24ff2b5db7519dfabe004` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:49.277714 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646e90b-9520-4296-a5ee-33cdd59d1903 None admin] RBAC: Authorizing `identity:get_project(project_id=ba0bc4e750d24ff2b5db7519dfabe004)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:49.280552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646e90b-9520-4296-a5ee-33cdd59d1903 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:49.281714 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e0648-ab04-4cb5-9137-00519d1d541f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:49.282380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e0648-ab04-4cb5-9137-00519d1d541f None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:49.282649 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 206/412] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:49 2022] GET /identity/v3/projects/ba0bc4e750d24ff2b5db7519dfabe004 => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:49.282769 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e0648-ab04-4cb5-9137-00519d1d541f None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:49.282976 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e0648-ab04-4cb5-9137-00519d1d541f None admin] PATH_INFO: `/v3/groups/649f764bc71c4fff9fabef5a0fd2bbb5` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:49.283875 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92d4cf-5783-4210-8715-0cc896dae4e5 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:49.284117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e0648-ab04-4cb5-9137-00519d1d541f None admin] RBAC: Authorizing `identity:get_group(group_id=649f764bc71c4fff9fabef5a0fd2bbb5)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:49.284219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92d4cf-5783-4210-8715-0cc896dae4e5 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:49.284461 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92d4cf-5783-4210-8715-0cc896dae4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:49.285584 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e0648-ab04-4cb5-9137-00519d1d541f None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:49.287636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 207/413] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Aug 11 09:40:49 2022] GET /identity/v3/groups/649f764bc71c4fff9fabef5a0fd2bbb5 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:49.288429 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e0648-ab04-4cb5-9137-00519d1d541f None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:49.303657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-ea92d4cf-5783-4210-8715-0cc896dae4e5 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:49.305316 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-ea92d4cf-5783-4210-8715-0cc896dae4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:49.389324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 207/414] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:49.390259 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92d4cf-5783-4210-8715-0cc896dae4e5 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:49.414925 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:49.427530 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e0648-ab04-4cb5-9137-00519d1d541f None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:49.482978 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee8b4a-89e4-4624-8ca1-627e2732d945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:49.484061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee8b4a-89e4-4624-8ca1-627e2732d945 None admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:49.484340 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee8b4a-89e4-4624-8ca1-627e2732d945 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:49.484875 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee8b4a-89e4-4624-8ca1-627e2732d945 None admin] PATH_INFO: `/v3/projects/ba0bc4e750d24ff2b5db7519dfabe004/groups/178b6792acd94111810fde22aff0c8cd/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:49.487580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee8b4a-89e4-4624-8ca1-627e2732d945 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba0bc4e750d24ff2b5db7519dfabe004, group_id=178b6792acd94111810fde22aff0c8cd, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:49.489241 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee8b4a-89e4-4624-8ca1-627e2732d945 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:49.506468 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92d4cf-5783-4210-8715-0cc896dae4e5 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:49.542505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b409663-2905-400d-901f-8517a08c2d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:49.543132 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b409663-2905-400d-901f-8517a08c2d20 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:49.543417 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b409663-2905-400d-901f-8517a08c2d20 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:49.543728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b409663-2905-400d-901f-8517a08c2d20 None admin] PATH_INFO: `/v3/projects/99fc3f2cb288430c9a330338644185b3` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:49.544903 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b409663-2905-400d-901f-8517a08c2d20 None admin] RBAC: Authorizing `identity:get_project(project_id=99fc3f2cb288430c9a330338644185b3)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:49.546360 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b409663-2905-400d-901f-8517a08c2d20 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:49.548264 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 208/415] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:49 2022] GET /identity/v3/projects/99fc3f2cb288430c9a330338644185b3 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:49.548905 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b409663-2905-400d-901f-8517a08c2d20 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:49.560196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 208/416] 10.222.0.13 () {58 vars in 1442 bytes} [Thu Aug 11 09:40:49 2022] PUT /identity/v3/projects/ba0bc4e750d24ff2b5db7519dfabe004/groups/178b6792acd94111810fde22aff0c8cd/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:40:49.563453 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee8b4a-89e4-4624-8ca1-627e2732d945 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:49.601591 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:49.701366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee8b4a-89e4-4624-8ca1-627e2732d945 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:49.726259 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:49.741250 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b409663-2905-400d-901f-8517a08c2d20 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:49.750017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac981e6b-4370-44f9-a4f3-bd938b0f7dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:49.750937 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac981e6b-4370-44f9-a4f3-bd938b0f7dec None admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:49.751281 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac981e6b-4370-44f9-a4f3-bd938b0f7dec None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:49.751629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac981e6b-4370-44f9-a4f3-bd938b0f7dec None admin] PATH_INFO: `/v3/projects/99fc3f2cb288430c9a330338644185b3/groups/649f764bc71c4fff9fabef5a0fd2bbb5/roles/da3ceb6dfa1746f19dbaf26e2c3ef7ab` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:49.754305 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac981e6b-4370-44f9-a4f3-bd938b0f7dec None admin] RBAC: Authorizing `identity:create_grant(project_id=99fc3f2cb288430c9a330338644185b3, group_id=649f764bc71c4fff9fabef5a0fd2bbb5, role_id=da3ceb6dfa1746f19dbaf26e2c3ef7ab)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:49.755815 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac981e6b-4370-44f9-a4f3-bd938b0f7dec None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:49.785864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e12299-0b0f-4ebe-b4f4-14c70ae4621c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:49.786543 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e12299-0b0f-4ebe-b4f4-14c70ae4621c None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:49.786819 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e12299-0b0f-4ebe-b4f4-14c70ae4621c None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:49.787196 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e12299-0b0f-4ebe-b4f4-14c70ae4621c None admin] PATH_INFO: `/v3/roles/member` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:49.798972 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e12299-0b0f-4ebe-b4f4-14c70ae4621c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:49.802926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-d0e12299-0b0f-4ebe-b4f4-14c70ae4621c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:49.802926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:49.802926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:49.802926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:49.802926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:49.802926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:49.802926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:49.802926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:49.802926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:49.802926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:49.802926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:49.802926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:49.802926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:49.802926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:49.802926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:49.802926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:49.803815 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:49.803815 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:49.803815 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:49.803815 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:49.803815 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:49.803815 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:49.803815 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:49.803815 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:49.803815 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:49.803815 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:49.803815 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:49.803815 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:49.803815 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:49.803815 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:49.803815 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:49.803815 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:49.804604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:49.804604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:49.804604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:49.804604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:49.804604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:49.804604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:49.804604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:49.804604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:49.804604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:49.804604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:49.804604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:49.804604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:49.804604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 209/417] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:49.812023 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e12299-0b0f-4ebe-b4f4-14c70ae4621c None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:49.815317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 209/418] 10.222.0.13 () {58 vars in 1442 bytes} [Thu Aug 11 09:40:49 2022] PUT /identity/v3/projects/99fc3f2cb288430c9a330338644185b3/groups/649f764bc71c4fff9fabef5a0fd2bbb5/roles/da3ceb6dfa1746f19dbaf26e2c3ef7ab => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:40:49.960618 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e12299-0b0f-4ebe-b4f4-14c70ae4621c None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:50.009047 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925063d-a5b5-4317-ae38-35b16bbc60e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:50.009584 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925063d-a5b5-4317-ae38-35b16bbc60e0 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:50.009859 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925063d-a5b5-4317-ae38-35b16bbc60e0 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:50.010154 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925063d-a5b5-4317-ae38-35b16bbc60e0 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:50.010825 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925063d-a5b5-4317-ae38-35b16bbc60e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:50.011162 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925063d-a5b5-4317-ae38-35b16bbc60e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:50.012548 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925063d-a5b5-4317-ae38-35b16bbc60e0 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:50.025647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 210/419] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:50.032082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac981e6b-4370-44f9-a4f3-bd938b0f7dec None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:50.147750 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:50.160915 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac981e6b-4370-44f9-a4f3-bd938b0f7dec None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:50.196239 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62245d36-27a0-4c70-aa14-281ecbc63f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:50.196855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62245d36-27a0-4c70-aa14-281ecbc63f6c None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:50.197136 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62245d36-27a0-4c70-aa14-281ecbc63f6c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:50.197413 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62245d36-27a0-4c70-aa14-281ecbc63f6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:50.269057 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62245d36-27a0-4c70-aa14-281ecbc63f6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:50.270522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62245d36-27a0-4c70-aa14-281ecbc63f6c None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:50.359879 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:50.373446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 210/420] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:40:50.378915 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925063d-a5b5-4317-ae38-35b16bbc60e0 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:50.395882 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:50.502679 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925063d-a5b5-4317-ae38-35b16bbc60e0 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:50.504811 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d910bd-538c-4841-bc42-109bda6cfa51 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:50.505091 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d910bd-538c-4841-bc42-109bda6cfa51 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:50.505362 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d910bd-538c-4841-bc42-109bda6cfa51 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:50.506717 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 211/421] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:40:50.512116 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac5852-0749-433f-b4bc-80ae953fcaff None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:50.512395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac5852-0749-433f-b4bc-80ae953fcaff None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:50.512726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac5852-0749-433f-b4bc-80ae953fcaff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:50.537411 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-b5ac5852-0749-433f-b4bc-80ae953fcaff None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:50.540276 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-b5ac5852-0749-433f-b4bc-80ae953fcaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:50.582071 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0193bf-4cc5-4b5b-8690-f021c67ae1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:50.582724 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0193bf-4cc5-4b5b-8690-f021c67ae1cb None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:50.583001 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0193bf-4cc5-4b5b-8690-f021c67ae1cb None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:50.583333 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0193bf-4cc5-4b5b-8690-f021c67ae1cb None admin] PATH_INFO: `/v3/projects/efa1046add794b2eb629463dd092363b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:50.585394 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0193bf-4cc5-4b5b-8690-f021c67ae1cb None admin] RBAC: Authorizing `identity:get_project(project_id=efa1046add794b2eb629463dd092363b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:50.586868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0193bf-4cc5-4b5b-8690-f021c67ae1cb None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:50.590245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 211/422] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:50 2022] GET /identity/v3/projects/efa1046add794b2eb629463dd092363b => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:50.596159 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0193bf-4cc5-4b5b-8690-f021c67ae1cb None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:50.648855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 212/423] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 09:40:50.698128 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac5852-0749-433f-b4bc-80ae953fcaff None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:50.757809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:50.778711 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0193bf-4cc5-4b5b-8690-f021c67ae1cb None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:50.845516 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f76a5-eb3d-4da1-bf9f-8b95cfd616e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:50.846334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f76a5-eb3d-4da1-bf9f-8b95cfd616e3 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:50.846681 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f76a5-eb3d-4da1-bf9f-8b95cfd616e3 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:50.847022 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f76a5-eb3d-4da1-bf9f-8b95cfd616e3 None admin] PATH_INFO: `/v3/groups/649f764bc71c4fff9fabef5a0fd2bbb5` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:50.848343 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f76a5-eb3d-4da1-bf9f-8b95cfd616e3 None admin] RBAC: Authorizing `identity:get_group(group_id=649f764bc71c4fff9fabef5a0fd2bbb5)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:50.854098 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f76a5-eb3d-4da1-bf9f-8b95cfd616e3 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:50.854098 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 212/424] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Aug 11 09:40:50 2022] GET /identity/v3/groups/649f764bc71c4fff9fabef5a0fd2bbb5 => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:50.859371 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f76a5-eb3d-4da1-bf9f-8b95cfd616e3 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:50.898244 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac5852-0749-433f-b4bc-80ae953fcaff None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:50.941188 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:50.967986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a5f2c-7dae-4690-af96-49f0513686af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:50.968625 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a5f2c-7dae-4690-af96-49f0513686af None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:50.969062 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a5f2c-7dae-4690-af96-49f0513686af None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:50.969337 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a5f2c-7dae-4690-af96-49f0513686af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:50.976913 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f76a5-eb3d-4da1-bf9f-8b95cfd616e3 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:50.983254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a5f2c-7dae-4690-af96-49f0513686af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:50.988826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-c73a5f2c-7dae-4690-af96-49f0513686af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:50.988826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:50.988826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:50.988826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:50.988826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:50.988826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:50.988826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:50.988826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:50.988826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:50.988826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:50.988826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:50.988826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:50.988826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:50.988826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:50.988826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:50.988826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:50.989891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:50.989891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:50.989891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:50.989891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:50.989891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:50.989891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:50.989891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:50.989891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:50.989891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:50.989891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:50.989891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:50.989891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:50.989891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:50.989891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:50.989891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:50.989891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:50.990728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:50.990728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:50.990728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:50.990728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:50.990728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:50.990728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:50.990728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:50.990728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:50.990728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:50.990728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:50.990728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:50.990728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:40:50.991344 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 213/425] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Aug 11 09:40:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:40:50.994734 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2458ceb-d6b5-4327-b69c-a3839534ebaa None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:50.995020 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2458ceb-d6b5-4327-b69c-a3839534ebaa None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:50.995319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2458ceb-d6b5-4327-b69c-a3839534ebaa None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:50.997200 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 214/426] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:50.998508 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2458ceb-d6b5-4327-b69c-a3839534ebaa None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:51.027912 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb28b9-dbed-457a-8342-913fb260c010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:51.028944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb28b9-dbed-457a-8342-913fb260c010 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:51.029459 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb28b9-dbed-457a-8342-913fb260c010 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:51.029942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb28b9-dbed-457a-8342-913fb260c010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:51.031208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb28b9-dbed-457a-8342-913fb260c010 None admin] RBAC: Adding query filter params (group.id=649f764bc71c4fff9fabef5a0fd2bbb5, role.id=9b9c9f22f65c459bacd757d5de4d5b8e, scope.project.id=efa1046add794b2eb629463dd092363b) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:51.031856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb28b9-dbed-457a-8342-913fb260c010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:51.033543 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb28b9-dbed-457a-8342-913fb260c010 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:51.040474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 213/427] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Aug 11 09:40:50 2022] GET /identity/v3/role_assignments?group.id=649f764bc71c4fff9fabef5a0fd2bbb5&scope.project.id=efa1046add794b2eb629463dd092363b&role.id=9b9c9f22f65c459bacd757d5de4d5b8e => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:51.041991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33a2a7-0779-44c5-9787-6f144ab8bae0 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:51.043049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33a2a7-0779-44c5-9787-6f144ab8bae0 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:51.043526 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33a2a7-0779-44c5-9787-6f144ab8bae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:51.064461 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-ba33a2a7-0779-44c5-9787-6f144ab8bae0 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:51.066392 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-ba33a2a7-0779-44c5-9787-6f144ab8bae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:51.082478 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:51.113576 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2458ceb-d6b5-4327-b69c-a3839534ebaa None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:51.151263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3baad6-d4b7-4716-afb4-c63cfc7652b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:51.152333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3baad6-d4b7-4716-afb4-c63cfc7652b0 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:51.152602 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3baad6-d4b7-4716-afb4-c63cfc7652b0 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:51.152871 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3baad6-d4b7-4716-afb4-c63cfc7652b0 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:51.153536 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3baad6-d4b7-4716-afb4-c63cfc7652b0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:51.153834 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3baad6-d4b7-4716-afb4-c63cfc7652b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:51.155455 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3baad6-d4b7-4716-afb4-c63cfc7652b0 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:51.164305 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 215/428] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:40:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:51.166842 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 214/429] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:51.181877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3baad6-d4b7-4716-afb4-c63cfc7652b0 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:51.200087 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33a2a7-0779-44c5-9787-6f144ab8bae0 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:51.280301 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:51.351546 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33a2a7-0779-44c5-9787-6f144ab8bae0 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:51.355914 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3baad6-d4b7-4716-afb4-c63cfc7652b0 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:51.398854 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428bd9d2-05dd-49e0-8fa0-9ec1047b5e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:51.399525 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bd9d2-05dd-49e0-8fa0-9ec1047b5e24 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:51.399899 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bd9d2-05dd-49e0-8fa0-9ec1047b5e24 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:51.400260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bd9d2-05dd-49e0-8fa0-9ec1047b5e24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:51.402478 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762981e2-4188-41fb-b654-1f7446ef2864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:51.403276 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762981e2-4188-41fb-b654-1f7446ef2864 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:51.403973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762981e2-4188-41fb-b654-1f7446ef2864 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:51.404401 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762981e2-4188-41fb-b654-1f7446ef2864 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:51.413132 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428bd9d2-05dd-49e0-8fa0-9ec1047b5e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:51.418728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-428bd9d2-05dd-49e0-8fa0-9ec1047b5e24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:51.418728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:51.418728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:51.418728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:51.418728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:51.418728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:51.418728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:51.418728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:51.418728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:51.418728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:51.418728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:51.418728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:51.418728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:51.418728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:51.418728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:51.418728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:51.419858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:51.419858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:51.419858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:51.419858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:51.419858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:51.419858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:51.419858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:51.419858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:51.419858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:51.419858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:51.419858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:51.419858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:51.419858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:51.419858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:51.419858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:51.419858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:51.420924 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:51.420924 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:51.420924 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:51.420924 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:51.420924 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:51.420924 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:51.420924 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:51.420924 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:51.420924 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:51.420924 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:51.420924 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 09:40:51.420924 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:51.427983 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 215/430] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:51.428943 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428bd9d2-05dd-49e0-8fa0-9ec1047b5e24 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:51.434448 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:51.497834 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762981e2-4188-41fb-b654-1f7446ef2864 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:51.500974 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762981e2-4188-41fb-b654-1f7446ef2864 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:51.557542 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:51.570204 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428bd9d2-05dd-49e0-8fa0-9ec1047b5e24 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:51.619078 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0e4ee-d7c0-496e-9acb-c84d14a024ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:51.620000 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0e4ee-d7c0-496e-9acb-c84d14a024ac None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:51.620512 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0e4ee-d7c0-496e-9acb-c84d14a024ac None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:51.620939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0e4ee-d7c0-496e-9acb-c84d14a024ac None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:51.622335 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0e4ee-d7c0-496e-9acb-c84d14a024ac None admin] RBAC: Adding query filter params (name=member) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:51.622849 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0e4ee-d7c0-496e-9acb-c84d14a024ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:51.625522 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0e4ee-d7c0-496e-9acb-c84d14a024ac None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:51.638108 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 216/431] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:40:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:51.645769 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 216/432] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:40:51.646506 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0e4ee-d7c0-496e-9acb-c84d14a024ac None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:51.657828 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762981e2-4188-41fb-b654-1f7446ef2864 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:51.723677 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:51.770778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0e4ee-d7c0-496e-9acb-c84d14a024ac None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:51.795142 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762981e2-4188-41fb-b654-1f7446ef2864 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:51.817646 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741fc85-db8d-4764-9a18-fa9671a08363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:51.818549 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741fc85-db8d-4764-9a18-fa9671a08363 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:51.818987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741fc85-db8d-4764-9a18-fa9671a08363 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:51.819978 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741fc85-db8d-4764-9a18-fa9671a08363 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:51.838236 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30ab36-4603-465a-bb35-134c002406a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:51.839608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30ab36-4603-465a-bb35-134c002406a5 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:51.840739 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30ab36-4603-465a-bb35-134c002406a5 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:51.841208 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30ab36-4603-465a-bb35-134c002406a5 None admin] PATH_INFO: `/v3/projects/efa1046add794b2eb629463dd092363b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:51.844495 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30ab36-4603-465a-bb35-134c002406a5 None admin] RBAC: Authorizing `identity:get_project(project_id=efa1046add794b2eb629463dd092363b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:51.846159 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30ab36-4603-465a-bb35-134c002406a5 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:51.848867 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 217/433] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:51 2022] GET /identity/v3/projects/efa1046add794b2eb629463dd092363b => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:51.853935 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30ab36-4603-465a-bb35-134c002406a5 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:51.868266 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:51.912966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741fc85-db8d-4764-9a18-fa9671a08363 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:51.914480 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741fc85-db8d-4764-9a18-fa9671a08363 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:51.985001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30ab36-4603-465a-bb35-134c002406a5 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:51.990048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:52.024051 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b3d80-1f7e-4a94-8fec-78b32b9f4713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:52.024745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b3d80-1f7e-4a94-8fec-78b32b9f4713 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:52.025029 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b3d80-1f7e-4a94-8fec-78b32b9f4713 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:52.025286 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b3d80-1f7e-4a94-8fec-78b32b9f4713 None admin] PATH_INFO: `/v3/groups/649f764bc71c4fff9fabef5a0fd2bbb5` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:52.026417 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b3d80-1f7e-4a94-8fec-78b32b9f4713 None admin] RBAC: Authorizing `identity:get_group(group_id=649f764bc71c4fff9fabef5a0fd2bbb5)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:52.027875 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b3d80-1f7e-4a94-8fec-78b32b9f4713 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:52.029496 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 217/434] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:40:52.034266 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 218/435] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Aug 11 09:40:51 2022] GET /identity/v3/groups/649f764bc71c4fff9fabef5a0fd2bbb5 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:52.034378 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b118c-7a44-4c5d-8eb8-851cca2a194b None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:52.034378 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b118c-7a44-4c5d-8eb8-851cca2a194b None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:52.034378 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b118c-7a44-4c5d-8eb8-851cca2a194b None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:52.037477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 218/436] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:52.038451 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b118c-7a44-4c5d-8eb8-851cca2a194b None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:52.038567 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b3d80-1f7e-4a94-8fec-78b32b9f4713 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:52.118562 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:52.142701 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b3d80-1f7e-4a94-8fec-78b32b9f4713 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:52.147562 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b118c-7a44-4c5d-8eb8-851cca2a194b None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:52.180626 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4249c-c3e7-43e4-8a9d-cc44609a7b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:52.181780 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4249c-c3e7-43e4-8a9d-cc44609a7b2a None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:52.182292 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4249c-c3e7-43e4-8a9d-cc44609a7b2a None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:52.182812 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4249c-c3e7-43e4-8a9d-cc44609a7b2a None admin] PATH_INFO: `/v3/projects/99fc3f2cb288430c9a330338644185b3` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:52.183711 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe1b26-900f-4ffe-90c0-dfbec2e8584e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:52.184311 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe1b26-900f-4ffe-90c0-dfbec2e8584e None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:52.184587 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe1b26-900f-4ffe-90c0-dfbec2e8584e None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:52.184851 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe1b26-900f-4ffe-90c0-dfbec2e8584e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:52.185395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4249c-c3e7-43e4-8a9d-cc44609a7b2a None admin] RBAC: Authorizing `identity:get_project(project_id=99fc3f2cb288430c9a330338644185b3)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:52.185561 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe1b26-900f-4ffe-90c0-dfbec2e8584e None admin] RBAC: Adding query filter params (group.id=649f764bc71c4fff9fabef5a0fd2bbb5, role.id=da3ceb6dfa1746f19dbaf26e2c3ef7ab, scope.project.id=efa1046add794b2eb629463dd092363b) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:52.185858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe1b26-900f-4ffe-90c0-dfbec2e8584e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:52.187327 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe1b26-900f-4ffe-90c0-dfbec2e8584e None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:52.187681 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4249c-c3e7-43e4-8a9d-cc44609a7b2a None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:52.189832 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 219/437] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:52 2022] GET /identity/v3/projects/99fc3f2cb288430c9a330338644185b3 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:52.191251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada57b86-454d-46b4-aa33-2aabc85e42d3 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:52.191535 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada57b86-454d-46b4-aa33-2aabc85e42d3 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:52.191808 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada57b86-454d-46b4-aa33-2aabc85e42d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:52.198125 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 219/438] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Aug 11 09:40:52 2022] GET /identity/v3/role_assignments?group.id=649f764bc71c4fff9fabef5a0fd2bbb5&scope.project.id=efa1046add794b2eb629463dd092363b&role.id=da3ceb6dfa1746f19dbaf26e2c3ef7ab => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:52.198125 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6674ea9-d638-4ce9-864d-5c5d4d092d50 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:52.198967 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6674ea9-d638-4ce9-864d-5c5d4d092d50 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:52.199243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6674ea9-d638-4ce9-864d-5c5d4d092d50 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:52.200609 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 220/439] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:52.201217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6674ea9-d638-4ce9-864d-5c5d4d092d50 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:52.213409 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-ada57b86-454d-46b4-aa33-2aabc85e42d3 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:52.215611 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ada57b86-454d-46b4-aa33-2aabc85e42d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:52.239838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:52.306160 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 220/440] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:52.306160 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23efe3-c059-477d-846f-288e0021adc9 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:52.306160 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23efe3-c059-477d-846f-288e0021adc9 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:52.306160 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23efe3-c059-477d-846f-288e0021adc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:52.324501 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-8f23efe3-c059-477d-846f-288e0021adc9 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:52.325927 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-8f23efe3-c059-477d-846f-288e0021adc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:52.344742 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6674ea9-d638-4ce9-864d-5c5d4d092d50 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:52.387424 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626917f5-0f8d-486a-b758-690dd8384c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:52.388295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626917f5-0f8d-486a-b758-690dd8384c1d None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:52.388576 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626917f5-0f8d-486a-b758-690dd8384c1d None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:52.388923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626917f5-0f8d-486a-b758-690dd8384c1d None admin] PATH_INFO: `/v3/groups/649f764bc71c4fff9fabef5a0fd2bbb5` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:52.390029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626917f5-0f8d-486a-b758-690dd8384c1d None admin] RBAC: Authorizing `identity:get_group(group_id=649f764bc71c4fff9fabef5a0fd2bbb5)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:52.391505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626917f5-0f8d-486a-b758-690dd8384c1d None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:52.393359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 221/441] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Aug 11 09:40:52 2022] GET /identity/v3/groups/649f764bc71c4fff9fabef5a0fd2bbb5 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:52.398187 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626917f5-0f8d-486a-b758-690dd8384c1d None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:52.417461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 221/442] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:52.418194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23efe3-c059-477d-846f-288e0021adc9 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:52.421589 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:52.512775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:52.518877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626917f5-0f8d-486a-b758-690dd8384c1d None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:52.536463 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23efe3-c059-477d-846f-288e0021adc9 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:52.560932 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85838cc8-355c-4e26-9688-d89fab433fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:52.561587 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85838cc8-355c-4e26-9688-d89fab433fc1 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:52.561838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85838cc8-355c-4e26-9688-d89fab433fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:52.562130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85838cc8-355c-4e26-9688-d89fab433fc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:52.575747 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85838cc8-355c-4e26-9688-d89fab433fc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:52.576594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029a24c-b2bb-45e4-83fe-0ebb4a9c3fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:52.577190 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029a24c-b2bb-45e4-83fe-0ebb4a9c3fed None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:52.577463 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029a24c-b2bb-45e4-83fe-0ebb4a9c3fed None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:52.577728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029a24c-b2bb-45e4-83fe-0ebb4a9c3fed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:52.578545 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029a24c-b2bb-45e4-83fe-0ebb4a9c3fed None admin] RBAC: Adding query filter params (group.id=649f764bc71c4fff9fabef5a0fd2bbb5, role.id=9b9c9f22f65c459bacd757d5de4d5b8e, scope.project.id=99fc3f2cb288430c9a330338644185b3) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:52.578860 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029a24c-b2bb-45e4-83fe-0ebb4a9c3fed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:52.580268 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029a24c-b2bb-45e4-83fe-0ebb4a9c3fed None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:52.580829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-85838cc8-355c-4e26-9688-d89fab433fc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:40:52.580829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:52.580829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:52.580829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:52.580829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:52.580829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:52.580829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:52.580829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:52.580829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:52.580829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:52.580829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:52.580829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:52.580829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:52.580829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:52.580829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:52.580829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:52.581690 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:52.581690 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:52.581690 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:52.581690 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:52.581690 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:52.581690 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:52.581690 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:52.581690 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:52.581690 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:52.581690 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:52.581690 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:52.581690 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:52.581690 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:52.581690 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:52.581690 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:52.581690 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:52.582500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:52.582500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:52.582500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:52.582500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:52.582500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:52.582500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:52.582500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:52.582500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:52.582500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:52.582500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:52.582500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:40:52.582500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:52.582500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 222/443] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:40:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:52.583421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85838cc8-355c-4e26-9688-d89fab433fc1 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:52.589007 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 222/444] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Aug 11 09:40:52 2022] GET /identity/v3/role_assignments?group.id=649f764bc71c4fff9fabef5a0fd2bbb5&scope.project.id=99fc3f2cb288430c9a330338644185b3&role.id=9b9c9f22f65c459bacd757d5de4d5b8e => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:52.589795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029a24c-b2bb-45e4-83fe-0ebb4a9c3fed None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:52.678776 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:52.695188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85838cc8-355c-4e26-9688-d89fab433fc1 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:52.715453 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029a24c-b2bb-45e4-83fe-0ebb4a9c3fed None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:52.732097 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad7a88-33cc-442a-8008-6f01dbefb473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:52.732725 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad7a88-33cc-442a-8008-6f01dbefb473 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:52.733005 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad7a88-33cc-442a-8008-6f01dbefb473 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:52.733275 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad7a88-33cc-442a-8008-6f01dbefb473 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:52.744081 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad7a88-33cc-442a-8008-6f01dbefb473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:52.749777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-86ad7a88-33cc-442a-8008-6f01dbefb473 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:52.749777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:52.749777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:52.749777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:52.749777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:52.749777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:52.749777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:52.749777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:52.749777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:52.749777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:52.749777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:52.749777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:52.749777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:52.749777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:52.749777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:52.749777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:52.751020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:52.751020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:52.751020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:52.751020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:52.751020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:52.751020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:52.751020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:52.751020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:52.751020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:52.751020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:52.751020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:52.751020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:52.751020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:52.751020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:52.751020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:52.751020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:52.751986 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:52.751986 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:52.751986 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:52.751986 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:52.751986 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:52.751986 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:52.751986 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:52.751986 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:52.751986 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:52.751986 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:52.751986 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:52.751986 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:52.751986 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 223/445] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Aug 11 09:40:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:52.756953 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9abdd7-2733-4244-9ec0-52b69c9457c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:52.757563 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9abdd7-2733-4244-9ec0-52b69c9457c1 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:52.757841 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9abdd7-2733-4244-9ec0-52b69c9457c1 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:52.758199 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9abdd7-2733-4244-9ec0-52b69c9457c1 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:52.758848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad7a88-33cc-442a-8008-6f01dbefb473 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:52.758996 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9abdd7-2733-4244-9ec0-52b69c9457c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:52.759176 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9abdd7-2733-4244-9ec0-52b69c9457c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:52.760520 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9abdd7-2733-4244-9ec0-52b69c9457c1 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:52.770652 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 223/446] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:40:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:52.776515 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9abdd7-2733-4244-9ec0-52b69c9457c1 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:52.781501 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:52.894923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad7a88-33cc-442a-8008-6f01dbefb473 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:52.902866 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9abdd7-2733-4244-9ec0-52b69c9457c1 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:52.935385 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9186b0-ba0d-4978-90d2-80f5dc15aef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:52.935999 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9186b0-ba0d-4978-90d2-80f5dc15aef9 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:52.936275 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9186b0-ba0d-4978-90d2-80f5dc15aef9 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:52.936774 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9186b0-ba0d-4978-90d2-80f5dc15aef9 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:52.937201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9186b0-ba0d-4978-90d2-80f5dc15aef9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:52.937502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9186b0-ba0d-4978-90d2-80f5dc15aef9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:52.938970 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9186b0-ba0d-4978-90d2-80f5dc15aef9 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:52.939094 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:52.945697 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374fbfa-2708-457b-9a9a-6aff746dd14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:52.946682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374fbfa-2708-457b-9a9a-6aff746dd14a None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:52.946926 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374fbfa-2708-457b-9a9a-6aff746dd14a None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:52.947186 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374fbfa-2708-457b-9a9a-6aff746dd14a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:52.948115 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 224/447] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:40:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:52.954365 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9186b0-ba0d-4978-90d2-80f5dc15aef9 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:53.017303 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374fbfa-2708-457b-9a9a-6aff746dd14a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:53.018776 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374fbfa-2708-457b-9a9a-6aff746dd14a None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:53.033953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:53.052878 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9186b0-ba0d-4978-90d2-80f5dc15aef9 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:53.086265 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d03f38-4fbe-4a71-9e19-8a55d205edb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:53.086866 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d03f38-4fbe-4a71-9e19-8a55d205edb0 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:53.087142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d03f38-4fbe-4a71-9e19-8a55d205edb0 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:53.087410 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d03f38-4fbe-4a71-9e19-8a55d205edb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:53.114755 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 224/448] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 09:40:53.120321 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374fbfa-2708-457b-9a9a-6aff746dd14a None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:53.153333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:53.158805 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d03f38-4fbe-4a71-9e19-8a55d205edb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:53.160327 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d03f38-4fbe-4a71-9e19-8a55d205edb0 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:53.221928 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374fbfa-2708-457b-9a9a-6aff746dd14a None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:53.239643 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:53.261337 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca785e-486c-4c27-8c60-6ecd6826480a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:53.261916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 225/449] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:40:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:40:53.262048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca785e-486c-4c27-8c60-6ecd6826480a None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:53.262268 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca785e-486c-4c27-8c60-6ecd6826480a None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:53.262541 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca785e-486c-4c27-8c60-6ecd6826480a None admin] PATH_INFO: `/v3/projects/ba0bc4e750d24ff2b5db7519dfabe004` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:53.263673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca785e-486c-4c27-8c60-6ecd6826480a None admin] RBAC: Authorizing `identity:get_project(project_id=ba0bc4e750d24ff2b5db7519dfabe004)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:53.265103 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca785e-486c-4c27-8c60-6ecd6826480a None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:53.267258 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 225/450] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:53 2022] GET /identity/v3/projects/ba0bc4e750d24ff2b5db7519dfabe004 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:53.267392 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d03f38-4fbe-4a71-9e19-8a55d205edb0 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:53.272078 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca785e-486c-4c27-8c60-6ecd6826480a None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:53.363151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d03f38-4fbe-4a71-9e19-8a55d205edb0 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:53.365704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:53.369386 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca785e-486c-4c27-8c60-6ecd6826480a None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:53.397372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e6b0c-3460-45a3-9ec8-25d7d9c81d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:53.397984 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e6b0c-3460-45a3-9ec8-25d7d9c81d96 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:53.398287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e6b0c-3460-45a3-9ec8-25d7d9c81d96 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:53.398568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e6b0c-3460-45a3-9ec8-25d7d9c81d96 None admin] PATH_INFO: `/v3/projects/99fc3f2cb288430c9a330338644185b3` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:53.399671 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e6b0c-3460-45a3-9ec8-25d7d9c81d96 None admin] RBAC: Authorizing `identity:get_project(project_id=99fc3f2cb288430c9a330338644185b3)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:53.401118 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e6b0c-3460-45a3-9ec8-25d7d9c81d96 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:53.402766 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 226/451] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:40:53 2022] GET /identity/v3/projects/99fc3f2cb288430c9a330338644185b3 => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:53.403604 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f61f15-bc85-40cb-bf85-95269219dcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:53.404232 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f61f15-bc85-40cb-bf85-95269219dcb6 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:53.404509 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f61f15-bc85-40cb-bf85-95269219dcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:53.404780 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f61f15-bc85-40cb-bf85-95269219dcb6 None admin] PATH_INFO: `/v3/groups/178b6792acd94111810fde22aff0c8cd` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:53.405883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f61f15-bc85-40cb-bf85-95269219dcb6 None admin] RBAC: Authorizing `identity:get_group(group_id=178b6792acd94111810fde22aff0c8cd)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:53.407374 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f61f15-bc85-40cb-bf85-95269219dcb6 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:53.408115 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e6b0c-3460-45a3-9ec8-25d7d9c81d96 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:53.409000 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 226/452] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Aug 11 09:40:53 2022] GET /identity/v3/groups/178b6792acd94111810fde22aff0c8cd => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:53.414289 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f61f15-bc85-40cb-bf85-95269219dcb6 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:53.456155 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:53.506176 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e6b0c-3460-45a3-9ec8-25d7d9c81d96 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:53.512569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f61f15-bc85-40cb-bf85-95269219dcb6 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:53.539565 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080eb316-b2ef-43d6-b5c5-be892df3ffda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:53.540177 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080eb316-b2ef-43d6-b5c5-be892df3ffda None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:53.540462 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080eb316-b2ef-43d6-b5c5-be892df3ffda None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:53.540714 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080eb316-b2ef-43d6-b5c5-be892df3ffda None admin] PATH_INFO: `/v3/groups/649f764bc71c4fff9fabef5a0fd2bbb5` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:53.541812 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080eb316-b2ef-43d6-b5c5-be892df3ffda None admin] RBAC: Authorizing `identity:get_group(group_id=649f764bc71c4fff9fabef5a0fd2bbb5)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:53.543332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080eb316-b2ef-43d6-b5c5-be892df3ffda None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:53.544810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1135b54-5326-482b-994a-19b6882b5bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:53.544921 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 227/453] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Aug 11 09:40:53 2022] GET /identity/v3/groups/649f764bc71c4fff9fabef5a0fd2bbb5 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:53.545487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1135b54-5326-482b-994a-19b6882b5bac None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:53.545770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1135b54-5326-482b-994a-19b6882b5bac None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:53.546137 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1135b54-5326-482b-994a-19b6882b5bac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:53.546856 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1135b54-5326-482b-994a-19b6882b5bac None admin] RBAC: Adding query filter params (group.id=178b6792acd94111810fde22aff0c8cd, role.id=6aae1c66f3f04cec80ed72c20d7e033b, scope.project.id=ba0bc4e750d24ff2b5db7519dfabe004) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:53.547165 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1135b54-5326-482b-994a-19b6882b5bac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:53.548566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1135b54-5326-482b-994a-19b6882b5bac None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:53.550599 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080eb316-b2ef-43d6-b5c5-be892df3ffda None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:53.570111 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 227/454] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Aug 11 09:40:53 2022] GET /identity/v3/role_assignments?group.id=178b6792acd94111810fde22aff0c8cd&scope.project.id=ba0bc4e750d24ff2b5db7519dfabe004&role.id=6aae1c66f3f04cec80ed72c20d7e033b => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:53.653591 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080eb316-b2ef-43d6-b5c5-be892df3ffda None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:53.672095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:53.690927 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7258c3-df55-4d7c-8f44-a6b51386fb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:53.691548 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7258c3-df55-4d7c-8f44-a6b51386fb1f None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:53.691875 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7258c3-df55-4d7c-8f44-a6b51386fb1f None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:53.692146 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7258c3-df55-4d7c-8f44-a6b51386fb1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:53.692871 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7258c3-df55-4d7c-8f44-a6b51386fb1f None admin] RBAC: Adding query filter params (group.id=649f764bc71c4fff9fabef5a0fd2bbb5, role.id=da3ceb6dfa1746f19dbaf26e2c3ef7ab, scope.project.id=99fc3f2cb288430c9a330338644185b3) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:53.693176 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7258c3-df55-4d7c-8f44-a6b51386fb1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:53.694663 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7258c3-df55-4d7c-8f44-a6b51386fb1f None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:53.701259 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 228/455] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Aug 11 09:40:53 2022] GET /identity/v3/role_assignments?group.id=649f764bc71c4fff9fabef5a0fd2bbb5&scope.project.id=99fc3f2cb288430c9a330338644185b3&role.id=da3ceb6dfa1746f19dbaf26e2c3ef7ab => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:56.253188 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c1cb1-653b-4587-a8e4-bc5a994d5bee None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:56.253732 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c1cb1-653b-4587-a8e4-bc5a994d5bee None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:56.253732 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c1cb1-653b-4587-a8e4-bc5a994d5bee None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:56.255294 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 228/456] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:56.260545 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228871d-b3d6-4ed8-8ca4-bdbaaee702d3 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:56.260994 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228871d-b3d6-4ed8-8ca4-bdbaaee702d3 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:56.261159 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228871d-b3d6-4ed8-8ca4-bdbaaee702d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:56.287112 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-2228871d-b3d6-4ed8-8ca4-bdbaaee702d3 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:56.288318 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-2228871d-b3d6-4ed8-8ca4-bdbaaee702d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:56.387022 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 229/457] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 09:40:56.426519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c1cb1-653b-4587-a8e4-bc5a994d5bee None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:56.463182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:56.567328 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c1cb1-653b-4587-a8e4-bc5a994d5bee None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:56.616173 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44276434-dca5-4c52-a08e-eda87310ebfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:56.616813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44276434-dca5-4c52-a08e-eda87310ebfa None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:56.617089 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44276434-dca5-4c52-a08e-eda87310ebfa None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:56.617360 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44276434-dca5-4c52-a08e-eda87310ebfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:56.636024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44276434-dca5-4c52-a08e-eda87310ebfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:56.636024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44276434-dca5-4c52-a08e-eda87310ebfa None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:56.659380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-44276434-dca5-4c52-a08e-eda87310ebfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:40:56.659380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:56.659380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:56.659380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:56.659380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:56.659380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:56.659380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:56.659380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:56.659380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:56.659380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:56.659380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:56.659380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:56.659380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:40:56.659380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:40:56.659380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:40:56.659380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:40:56.660284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:56.660284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:56.660284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:56.660284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:56.660284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:56.660284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:56.660284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:56.660284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:56.660284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:56.660284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:56.660284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:56.660284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:56.660284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:56.660284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:56.660284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:56.660284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:56.660284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:40:56.661127 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:40:56.661127 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:40:56.661127 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:40:56.661127 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 229/458] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:56.666439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228871d-b3d6-4ed8-8ca4-bdbaaee702d3 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:56.731421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578eb6a-544e-4b3b-a1b9-bd0b5ced929c None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:56.731791 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578eb6a-544e-4b3b-a1b9-bd0b5ced929c None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:56.731967 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578eb6a-544e-4b3b-a1b9-bd0b5ced929c None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:56.733555 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 230/459] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:56.739330 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049cdaf-19b3-444a-bc30-0456f4421bc3 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:56.739616 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049cdaf-19b3-444a-bc30-0456f4421bc3 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:56.739891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049cdaf-19b3-444a-bc30-0456f4421bc3 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:56.741386 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 231/460] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:40:56.746206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58252c5-6840-4a5a-bf9e-5323c1eff901 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:56.746491 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58252c5-6840-4a5a-bf9e-5323c1eff901 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:56.746767 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58252c5-6840-4a5a-bf9e-5323c1eff901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:56.765532 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-a58252c5-6840-4a5a-bf9e-5323c1eff901 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:56.766865 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-a58252c5-6840-4a5a-bf9e-5323c1eff901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:56.806970 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228871d-b3d6-4ed8-8ca4-bdbaaee702d3 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:56.818265 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:56.842629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 232/461] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:56.843799 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93f90f-c1a2-4cb2-b9fe-926cbe734cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:56.844378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c39d0-b837-4dd5-a455-faf2db2811f1 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:56.844492 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93f90f-c1a2-4cb2-b9fe-926cbe734cf8 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:56.844879 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93f90f-c1a2-4cb2-b9fe-926cbe734cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:56.845021 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c39d0-b837-4dd5-a455-faf2db2811f1 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:56.845268 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93f90f-c1a2-4cb2-b9fe-926cbe734cf8 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:56.845617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c39d0-b837-4dd5-a455-faf2db2811f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:56.846035 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93f90f-c1a2-4cb2-b9fe-926cbe734cf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:56.846564 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93f90f-c1a2-4cb2-b9fe-926cbe734cf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:56.847996 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93f90f-c1a2-4cb2-b9fe-926cbe734cf8 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:56.861435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 230/462] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:56.870265 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93f90f-c1a2-4cb2-b9fe-926cbe734cf8 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:56.875469 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-973c39d0-b837-4dd5-a455-faf2db2811f1 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:56.876842 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-973c39d0-b837-4dd5-a455-faf2db2811f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:56.891641 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:56.957850 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 233/463] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:56.958951 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c39d0-b837-4dd5-a455-faf2db2811f1 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:56.983655 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93f90f-c1a2-4cb2-b9fe-926cbe734cf8 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:57.022750 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae719d-a0d8-4586-95a7-84a7d59ce44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:57.023490 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae719d-a0d8-4586-95a7-84a7d59ce44e None admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:57.023850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae719d-a0d8-4586-95a7-84a7d59ce44e None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:57.024417 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae719d-a0d8-4586-95a7-84a7d59ce44e None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:57.024948 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae719d-a0d8-4586-95a7-84a7d59ce44e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:57.027171 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae719d-a0d8-4586-95a7-84a7d59ce44e None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:57.068802 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c39d0-b837-4dd5-a455-faf2db2811f1 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:57.104748 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d4f8f-a515-432c-af3e-da805f81effc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:57.105652 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d4f8f-a515-432c-af3e-da805f81effc None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:57.106106 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d4f8f-a515-432c-af3e-da805f81effc None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:57.106525 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d4f8f-a515-432c-af3e-da805f81effc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:57.120933 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 231/464] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Aug 11 09:40:56 2022] POST /identity/v3/users => generated 246 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:40:57.120933 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae719d-a0d8-4586-95a7-84a7d59ce44e None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:57.122641 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d4f8f-a515-432c-af3e-da805f81effc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:57.124261 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d4f8f-a515-432c-af3e-da805f81effc None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:57.130952 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:57.153691 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:57.159661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-ea2d4f8f-a515-432c-af3e-da805f81effc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:40:57.159661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:57.159661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:57.159661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:57.159661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:57.159661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:57.159661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:57.159661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:57.159661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:57.159661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:57.159661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:57.159661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:57.159661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:40:57.159661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:40:57.159661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:40:57.159661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:40:57.160770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:57.160770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:57.160770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:57.160770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:57.160770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:57.160770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:57.160770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:57.160770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:57.160770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:57.160770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:57.160770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:57.160770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:57.160770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:57.160770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:57.160770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:57.160770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:57.160770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:40:57.161603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:40:57.161603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:40:57.161603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:40:57.163819 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 234/465] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:57.177301 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d4f8f-a515-432c-af3e-da805f81effc None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:57.285168 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae719d-a0d8-4586-95a7-84a7d59ce44e None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:57.316620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d4f8f-a515-432c-af3e-da805f81effc None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:57.328699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727af00-a349-4209-bb69-fd7293d3a46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:57.329274 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727af00-a349-4209-bb69-fd7293d3a46b None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:57.329547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727af00-a349-4209-bb69-fd7293d3a46b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:57.329817 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727af00-a349-4209-bb69-fd7293d3a46b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:57.344088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727af00-a349-4209-bb69-fd7293d3a46b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:57.346701 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727af00-a349-4209-bb69-fd7293d3a46b None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:57.356257 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7e2ae-c79e-4f24-9201-c4cf8a0972fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:57.356868 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7e2ae-c79e-4f24-9201-c4cf8a0972fd None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:57.357144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7e2ae-c79e-4f24-9201-c4cf8a0972fd None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:57.357413 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7e2ae-c79e-4f24-9201-c4cf8a0972fd None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:57.358056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7e2ae-c79e-4f24-9201-c4cf8a0972fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:57.358388 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7e2ae-c79e-4f24-9201-c4cf8a0972fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:57.359746 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7e2ae-c79e-4f24-9201-c4cf8a0972fd None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:57.362144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-8727af00-a349-4209-bb69-fd7293d3a46b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:40:57.362144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:57.362144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:57.362144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:57.362144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:57.362144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:57.362144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:57.362144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:57.362144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:57.362144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:57.362144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:57.362144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:57.362144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:40:57.362144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:40:57.362144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:40:57.362144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:40:57.363016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:57.363016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:57.363016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:57.363016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:57.363016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:57.363016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:57.363016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:57.363016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:57.363016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:57.363016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:57.363016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:57.363016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:57.363016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:57.363016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:57.363016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:57.363016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:57.363016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:40:57.365715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:40:57.365715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:40:57.365715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:57.365715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 232/466] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:57.365715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0b797-ade2-43bc-b182-a0e209da4117 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:57.365715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0b797-ade2-43bc-b182-a0e209da4117 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:57.365715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0b797-ade2-43bc-b182-a0e209da4117 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:57.371435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 233/467] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:57.372689 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d17790-e1ff-4d29-a232-0f585a6417f3 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:57.372974 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d17790-e1ff-4d29-a232-0f585a6417f3 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:57.373246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d17790-e1ff-4d29-a232-0f585a6417f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:57.381654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 235/468] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:40:57.383354 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7e2ae-c79e-4f24-9201-c4cf8a0972fd None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:57.394316 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-c9d17790-e1ff-4d29-a232-0f585a6417f3 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:57.395506 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-c9d17790-e1ff-4d29-a232-0f585a6417f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:57.458205 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:57.477302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 234/469] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:57.478187 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d17790-e1ff-4d29-a232-0f585a6417f3 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:57.492963 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:57.531205 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7e2ae-c79e-4f24-9201-c4cf8a0972fd None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:57.575448 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f7aa7-c2b6-44d8-87ab-d19d5a8d43b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:57.576193 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f7aa7-c2b6-44d8-87ab-d19d5a8d43b1 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:57.576474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f7aa7-c2b6-44d8-87ab-d19d5a8d43b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:57.576760 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f7aa7-c2b6-44d8-87ab-d19d5a8d43b1 None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:57.577402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f7aa7-c2b6-44d8-87ab-d19d5a8d43b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:57.577706 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f7aa7-c2b6-44d8-87ab-d19d5a8d43b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:57.579184 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f7aa7-c2b6-44d8-87ab-d19d5a8d43b1 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:57.591433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 236/470] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:57.592052 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f7aa7-c2b6-44d8-87ab-d19d5a8d43b1 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:57.600862 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d17790-e1ff-4d29-a232-0f585a6417f3 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:57.640654 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb261d9b-25c1-44b5-a560-c89f3e215c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:57.642178 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb261d9b-25c1-44b5-a560-c89f3e215c87 None admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:57.642707 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb261d9b-25c1-44b5-a560-c89f3e215c87 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:57.643124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb261d9b-25c1-44b5-a560-c89f3e215c87 None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:57.644195 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb261d9b-25c1-44b5-a560-c89f3e215c87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:57.646616 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb261d9b-25c1-44b5-a560-c89f3e215c87 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:57.699662 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f7aa7-c2b6-44d8-87ab-d19d5a8d43b1 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:57.713964 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:57.733444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52acd43d-f448-46d2-a1bf-512b964248e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:57.734065 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acd43d-f448-46d2-a1bf-512b964248e5 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:57.734370 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acd43d-f448-46d2-a1bf-512b964248e5 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:57.734640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acd43d-f448-46d2-a1bf-512b964248e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:57.744272 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52acd43d-f448-46d2-a1bf-512b964248e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:57.746291 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52acd43d-f448-46d2-a1bf-512b964248e5 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:57.760431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-52acd43d-f448-46d2-a1bf-512b964248e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:40:57.760431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:57.760431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:57.760431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:57.760431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:57.760431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:57.760431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:57.760431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:57.760431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:57.760431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:57.760431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:57.760431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:57.760431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:40:57.760431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:40:57.760431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:40:57.760431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:40:57.761547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:57.761547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:57.761547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:57.761547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:57.761547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:57.761547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:57.761547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:57.761547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:57.761547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:57.761547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:57.761547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:57.761547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:57.761547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:57.761547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:57.761547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:57.761547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:57.761547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:40:57.762870 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:40:57.762870 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:40:57.762870 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:40:57.762870 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 237/471] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:57.762870 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731037d-639b-4383-bdd2-566962f08964 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:57.763141 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731037d-639b-4383-bdd2-566962f08964 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:57.763338 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731037d-639b-4383-bdd2-566962f08964 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:57.766128 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 238/472] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:57.766128 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731037d-639b-4383-bdd2-566962f08964 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:57.825537 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 235/473] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Aug 11 09:40:57 2022] POST /identity/v3/users => generated 248 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:40:57.826670 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb261d9b-25c1-44b5-a560-c89f3e215c87 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:57.901787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731037d-639b-4383-bdd2-566962f08964 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:57.911348 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:57.954330 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb261d9b-25c1-44b5-a560-c89f3e215c87 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:57.964669 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a35106-8598-4f80-9d70-654fc2914b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:57.965664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a35106-8598-4f80-9d70-654fc2914b4c None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:57.966169 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a35106-8598-4f80-9d70-654fc2914b4c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:57.966615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a35106-8598-4f80-9d70-654fc2914b4c None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:57.967988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a35106-8598-4f80-9d70-654fc2914b4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:57.970504 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a35106-8598-4f80-9d70-654fc2914b4c None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:57.995723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68699839-bd2a-4533-a293-98ffa01e6715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:57.996424 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68699839-bd2a-4533-a293-98ffa01e6715 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:57.996696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68699839-bd2a-4533-a293-98ffa01e6715 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:57.996966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68699839-bd2a-4533-a293-98ffa01e6715 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:57.997620 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68699839-bd2a-4533-a293-98ffa01e6715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:57.997923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68699839-bd2a-4533-a293-98ffa01e6715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:57.999453 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68699839-bd2a-4533-a293-98ffa01e6715 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:58.013976 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 236/474] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:58.015170 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3c9f7-c2ad-40ac-ab62-8a53c2ac2d12 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:58.015501 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3c9f7-c2ad-40ac-ab62-8a53c2ac2d12 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:58.015725 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3c9f7-c2ad-40ac-ab62-8a53c2ac2d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:58.034038 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-e5d3c9f7-c2ad-40ac-ab62-8a53c2ac2d12 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:58.035419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-e5d3c9f7-c2ad-40ac-ab62-8a53c2ac2d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:58.055283 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 239/475] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Aug 11 09:40:57 2022] POST /identity/v3/users => generated 248 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:40:58.063070 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a35106-8598-4f80-9d70-654fc2914b4c None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:58.094227 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:58.127955 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 237/476] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:58.166534 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3c9f7-c2ad-40ac-ab62-8a53c2ac2d12 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:58.182400 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a35106-8598-4f80-9d70-654fc2914b4c None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:58.224927 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1143e-cc88-41be-a308-272f5767f009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:58.225577 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1143e-cc88-41be-a308-272f5767f009 None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:58.225862 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1143e-cc88-41be-a308-272f5767f009 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:58.226160 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1143e-cc88-41be-a308-272f5767f009 None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:58.226826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1143e-cc88-41be-a308-272f5767f009 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:58.228636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1143e-cc88-41be-a308-272f5767f009 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:58.240229 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:58.290247 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3c9f7-c2ad-40ac-ab62-8a53c2ac2d12 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:58.325852 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0fa23-d86c-467f-8763-dab1cc9d6022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:58.326492 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0fa23-d86c-467f-8763-dab1cc9d6022 None admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:58.326777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0fa23-d86c-467f-8763-dab1cc9d6022 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:58.327048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0fa23-d86c-467f-8763-dab1cc9d6022 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:58.327717 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0fa23-d86c-467f-8763-dab1cc9d6022 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:58.329100 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0fa23-d86c-467f-8763-dab1cc9d6022 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:58.338242 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 240/477] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Aug 11 09:40:58 2022] POST /identity/v3/users => generated 249 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:40:58.368196 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.sql.core [None req-2bd0fa23-d86c-467f-8763-dab1cc9d6022 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 11 09:40:58.368196 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 11 09:40:58.368196 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [parameters: {'id': 'dbe3805e93df46dea1ee82186ae19796', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 11 09:40:58.368196 dv-cinder-815660-9-smb devstack@keystone.service[98479]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98479) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 11 09:40:58.385031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-2bd0fa23-d86c-467f-8763-dab1cc9d6022 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 11 09:40:58.385031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:58.385031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 11 09:40:58.385031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 11 09:40:58.385031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 11 09:40:58.385031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 11 09:40:58.385031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 11 09:40:58.385031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application result = self._query(query) Aug 11 09:40:58.385031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 11 09:40:58.385031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application conn.query(q) Aug 11 09:40:58.385031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 11 09:40:58.385031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 11 09:40:58.385031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 11 09:40:58.385031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application result.read() Aug 11 09:40:58.385031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 11 09:40:58.386752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 11 09:40:58.386752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 11 09:40:58.386752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 11 09:40:58.386752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 11 09:40:58.386752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 11 09:40:58.386752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 11 09:40:58.386752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 11 09:40:58.386752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 11 09:40:58.386752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:58.386752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 11 09:40:58.386752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:58.386752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:58.386752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 11 09:40:58.386752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 11 09:40:58.386752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 11 09:40:58.386752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return ref.to_dict() Aug 11 09:40:58.386752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 11 09:40:58.386752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application next(self.gen) Aug 11 09:40:58.387850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 11 09:40:58.387850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application yield resource Aug 11 09:40:58.387850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 11 09:40:58.387850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application next(self.gen) Aug 11 09:40:58.387850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 11 09:40:58.387850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self.session.rollback() Aug 11 09:40:58.387850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 11 09:40:58.387850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self.force_reraise() Aug 11 09:40:58.387850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 11 09:40:58.387850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise self.value Aug 11 09:40:58.387850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 11 09:40:58.387850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 11 09:40:58.387850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 11 09:40:58.387850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application session.commit() Aug 11 09:40:58.387850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 11 09:40:58.387850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 11 09:40:58.387850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 11 09:40:58.388748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._prepare_impl() Aug 11 09:40:58.388748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 11 09:40:58.388748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self.session.flush() Aug 11 09:40:58.388748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 11 09:40:58.388748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._flush(objects) Aug 11 09:40:58.388748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 11 09:40:58.388748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 11 09:40:58.388748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 11 09:40:58.388748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application compat.raise_( Aug 11 09:40:58.388748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 11 09:40:58.388748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception Aug 11 09:40:58.388748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 11 09:40:58.388748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application flush_context.execute() Aug 11 09:40:58.388748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 11 09:40:58.388748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rec.execute(self) Aug 11 09:40:58.388748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 11 09:40:58.388748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 11 09:40:58.389593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 11 09:40:58.389593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 11 09:40:58.389593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 11 09:40:58.389593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 11 09:40:58.389593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 11 09:40:58.389593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 11 09:40:58.389593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 11 09:40:58.389593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 11 09:40:58.389593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 11 09:40:58.389593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 11 09:40:58.389593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 11 09:40:58.389593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 11 09:40:58.389593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 11 09:40:58.389593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 11 09:40:58.389593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 11 09:40:58.389593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception Aug 11 09:40:58.391657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 11 09:40:58.391657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 11 09:40:58.391657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 11 09:40:58.391657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 11 09:40:58.391657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 11 09:40:58.391657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application result = self._query(query) Aug 11 09:40:58.391657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 11 09:40:58.391657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application conn.query(q) Aug 11 09:40:58.391657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 11 09:40:58.391657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 11 09:40:58.391657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 11 09:40:58.391657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application result.read() Aug 11 09:40:58.391657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 11 09:40:58.391657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 11 09:40:58.391657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 11 09:40:58.391657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 11 09:40:58.393573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 11 09:40:58.393573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 11 09:40:58.393573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 11 09:40:58.393573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 11 09:40:58.393573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 11 09:40:58.393573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 11 09:40:58.393573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [parameters: {'id': 'dbe3805e93df46dea1ee82186ae19796', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 11 09:40:58.393573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 11 09:40:58.393573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:58.393573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:40:58.393573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:58.393573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:58.393573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:58.393573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:58.393573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:58.393573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:58.396480 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:58.396480 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:58.396480 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:58.396480 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:58.396480 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:58.396480 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:58.396480 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 11 09:40:58.396480 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 11 09:40:58.396480 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:58.396480 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:58.396480 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 11 09:40:58.396480 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 11 09:40:58.396480 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 11 09:40:58.396480 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 11 09:40:58.396480 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 11 09:40:58.396480 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:40:58.398575 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 238/478] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Aug 11 09:40:58 2022] POST /identity/v3/roles => generated 144 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:40:58.398712 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1143e-cc88-41be-a308-272f5767f009 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:58.499202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:58.521854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1143e-cc88-41be-a308-272f5767f009 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:58.564901 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fa057-4fa1-4e0b-a762-84c851c0eb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:58.565552 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fa057-4fa1-4e0b-a762-84c851c0eb31 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:58.565830 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fa057-4fa1-4e0b-a762-84c851c0eb31 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:58.566228 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fa057-4fa1-4e0b-a762-84c851c0eb31 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:58.579515 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3fa057-4fa1-4e0b-a762-84c851c0eb31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:58.584754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-da3fa057-4fa1-4e0b-a762-84c851c0eb31 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:58.584754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:58.584754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:58.584754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:58.584754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:58.584754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:58.584754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:58.584754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:58.584754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:58.584754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:58.584754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:58.584754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:58.584754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:58.584754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:58.584754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:58.584754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:58.587629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:58.587629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:58.587629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:58.587629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:58.587629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:58.587629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:58.587629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:58.587629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:58.587629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:58.587629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:58.587629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:58.587629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:58.587629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:58.587629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:58.587629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:58.587629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:58.590378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:58.590378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:58.590378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:58.590378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:58.590378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:58.590378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:58.590378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:58.590378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:58.590378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:58.590378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:58.590378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 09:40:58.590378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:40:58.590378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 241/479] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Aug 11 09:40:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:58.599325 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0fa23-d86c-467f-8763-dab1cc9d6022 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:58.716032 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0fa23-d86c-467f-8763-dab1cc9d6022 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:58.736254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:58.755053 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0a6cb-9a1c-44ee-a2ab-28a692f11fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:58.755732 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0a6cb-9a1c-44ee-a2ab-28a692f11fac None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:58.756064 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0a6cb-9a1c-44ee-a2ab-28a692f11fac None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:58.756426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0a6cb-9a1c-44ee-a2ab-28a692f11fac None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:58.757090 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0a6cb-9a1c-44ee-a2ab-28a692f11fac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:40:58.757386 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0a6cb-9a1c-44ee-a2ab-28a692f11fac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:40:58.758867 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0a6cb-9a1c-44ee-a2ab-28a692f11fac None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:40:58.767870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 239/480] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:40:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:40:59.438244 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952185e0-de93-4f00-bcee-44b19e890347 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:59.438816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952185e0-de93-4f00-bcee-44b19e890347 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:59.438816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952185e0-de93-4f00-bcee-44b19e890347 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:59.440328 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 242/481] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:40:59.445629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb76743-2437-4a2b-aafc-cafb6ea45551 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:59.446036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb76743-2437-4a2b-aafc-cafb6ea45551 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:59.446201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb76743-2437-4a2b-aafc-cafb6ea45551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:59.471017 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-dbb76743-2437-4a2b-aafc-cafb6ea45551 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:40:59.472206 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-dbb76743-2437-4a2b-aafc-cafb6ea45551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:40:59.568680 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 240/482] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:40:59.603308 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952185e0-de93-4f00-bcee-44b19e890347 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:59.779289 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952185e0-de93-4f00-bcee-44b19e890347 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:40:59.824639 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae777dd-67f3-4e73-a755-28fd3b8c57b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:40:59.825269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae777dd-67f3-4e73-a755-28fd3b8c57b4 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:40:59.825544 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae777dd-67f3-4e73-a755-28fd3b8c57b4 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:40:59.825810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae777dd-67f3-4e73-a755-28fd3b8c57b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:40:59.839176 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:40:59.844070 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae777dd-67f3-4e73-a755-28fd3b8c57b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:40:59.848682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-5ae777dd-67f3-4e73-a755-28fd3b8c57b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:40:59.848682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:40:59.848682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:40:59.848682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:40:59.848682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:40:59.848682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:40:59.848682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:40:59.848682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:40:59.848682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:40:59.848682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:40:59.848682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:40:59.848682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:40:59.848682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:40:59.848682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:40:59.848682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:40:59.848682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:40:59.854450 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:40:59.854450 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:40:59.854450 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:40:59.854450 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:40:59.854450 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:40:59.854450 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:40:59.854450 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:40:59.854450 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:40:59.854450 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:40:59.854450 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:40:59.854450 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:40:59.854450 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:40:59.854450 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:40:59.854450 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:40:59.854450 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:40:59.854450 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:40:59.855619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:40:59.855619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:40:59.855619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:40:59.855619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:40:59.855619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:40:59.855619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:40:59.855619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:40:59.855619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:40:59.855619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:40:59.855619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:40:59.855619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:40:59.855619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:40:59.855619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 243/483] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Aug 11 09:40:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:40:59.856296 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb76743-2437-4a2b-aafc-cafb6ea45551 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:40:59.994228 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb76743-2437-4a2b-aafc-cafb6ea45551 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:00.012272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:00.044241 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e935ca-e93e-4feb-999f-1c1d674d1fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:00.044771 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e935ca-e93e-4feb-999f-1c1d674d1fa2 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:00.045053 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e935ca-e93e-4feb-999f-1c1d674d1fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:00.045324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e935ca-e93e-4feb-999f-1c1d674d1fa2 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:00.045994 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e935ca-e93e-4feb-999f-1c1d674d1fa2 None admin] RBAC: Adding query filter params (name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:00.046330 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e935ca-e93e-4feb-999f-1c1d674d1fa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:00.047993 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e935ca-e93e-4feb-999f-1c1d674d1fa2 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:00.062422 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 241/484] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Aug 11 09:40:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:00.071173 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae777dd-67f3-4e73-a755-28fd3b8c57b4 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:00.230388 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae777dd-67f3-4e73-a755-28fd3b8c57b4 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:00.276613 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537fe8c-9092-4638-b518-73741cdea4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:00.277257 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537fe8c-9092-4638-b518-73741cdea4ad None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:00.277534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537fe8c-9092-4638-b518-73741cdea4ad None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:00.277805 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537fe8c-9092-4638-b518-73741cdea4ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:00.294216 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537fe8c-9092-4638-b518-73741cdea4ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:00.295733 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537fe8c-9092-4638-b518-73741cdea4ad None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:00.314454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-b537fe8c-9092-4638-b518-73741cdea4ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:00.314454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:00.314454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:00.314454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:00.314454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:00.314454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:00.314454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:00.314454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:00.314454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:00.314454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:00.314454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:00.314454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:00.314454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:00.314454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:00.314454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:00.314454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:00.316771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:00.316771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:00.316771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:00.316771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:00.316771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:00.316771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:00.316771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:00.316771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:00.316771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:00.316771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:00.316771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:00.316771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:00.316771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:00.316771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:00.316771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:00.316771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:00.316771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:00.318859 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:00.318859 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:00.318859 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:00.318859 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 244/485] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:00.327192 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e935ca-e93e-4feb-999f-1c1d674d1fa2 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:00.494223 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83446d4c-3e83-4045-a838-d1764bd0fb2d None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:00.495516 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83446d4c-3e83-4045-a838-d1764bd0fb2d None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:00.495516 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83446d4c-3e83-4045-a838-d1764bd0fb2d None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:00.496879 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 245/486] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:00.511374 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c92030-3c15-44d7-a8fe-8d3e4dd53a09 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:00.511656 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c92030-3c15-44d7-a8fe-8d3e4dd53a09 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:00.511930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c92030-3c15-44d7-a8fe-8d3e4dd53a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:00.521755 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e935ca-e93e-4feb-999f-1c1d674d1fa2 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:00.551133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-51c92030-3c15-44d7-a8fe-8d3e4dd53a09 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:00.552630 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-51c92030-3c15-44d7-a8fe-8d3e4dd53a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:00.567809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7515ba-6a5a-4642-b73e-7897881ef507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:00.568425 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7515ba-6a5a-4642-b73e-7897881ef507 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:00.568708 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7515ba-6a5a-4642-b73e-7897881ef507 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:00.568975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7515ba-6a5a-4642-b73e-7897881ef507 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:00.569606 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7515ba-6a5a-4642-b73e-7897881ef507 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:00.569902 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7515ba-6a5a-4642-b73e-7897881ef507 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:00.571299 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7515ba-6a5a-4642-b73e-7897881ef507 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:00.601179 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 242/487] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:00.607424 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7515ba-6a5a-4642-b73e-7897881ef507 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:00.651053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:00.656083 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:00.679866 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 246/488] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:41:00.686493 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e03189-bbf2-44c2-9d15-953886eb1d9a None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:00.686493 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e03189-bbf2-44c2-9d15-953886eb1d9a None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:00.686493 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e03189-bbf2-44c2-9d15-953886eb1d9a None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:00.686493 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 247/489] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:00.692047 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c703b5-d6ec-4bb5-95dc-f9f83f19f176 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:00.692329 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c703b5-d6ec-4bb5-95dc-f9f83f19f176 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:00.692602 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c703b5-d6ec-4bb5-95dc-f9f83f19f176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:00.719270 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-f9c703b5-d6ec-4bb5-95dc-f9f83f19f176 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:00.720458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-f9c703b5-d6ec-4bb5-95dc-f9f83f19f176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:00.759728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7515ba-6a5a-4642-b73e-7897881ef507 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:00.800611 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 248/490] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:41:00.801564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c703b5-d6ec-4bb5-95dc-f9f83f19f176 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:00.804734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b693bb-9742-44d5-915c-f54669cf39c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:00.805918 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b693bb-9742-44d5-915c-f54669cf39c7 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:00.806441 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b693bb-9742-44d5-915c-f54669cf39c7 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:00.806910 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b693bb-9742-44d5-915c-f54669cf39c7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:00.816771 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b693bb-9742-44d5-915c-f54669cf39c7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:00.818528 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b693bb-9742-44d5-915c-f54669cf39c7 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:00.835909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-62b693bb-9742-44d5-915c-f54669cf39c7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 09:41:00.835909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:00.835909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:00.835909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:00.835909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:00.835909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:00.835909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:00.835909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:00.835909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:00.835909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:00.835909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:00.835909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:00.835909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:00.835909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:00.835909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:00.835909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:00.836857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:00.836857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:00.836857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:00.836857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:00.836857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:00.836857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:00.836857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:00.836857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:00.836857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:00.836857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:00.836857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:00.836857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:00.836857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:00.836857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:00.836857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:00.836857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:00.836857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:00.836857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:00.837756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:00.837756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:00.837756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:00.837756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:00.837756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:00.837756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:00.837756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:00.837756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:00.837756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 09:41:00.837756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:00.839998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 243/491] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Aug 11 09:41:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:00.840699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b693bb-9742-44d5-915c-f54669cf39c7 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:00.931382 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c703b5-d6ec-4bb5-95dc-f9f83f19f176 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:00.945894 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:00.970315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:00.974695 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0201b-7fa4-430c-b7d1-108688cbc230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:00.975329 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0201b-7fa4-430c-b7d1-108688cbc230 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:00.975603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0201b-7fa4-430c-b7d1-108688cbc230 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:00.975928 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0201b-7fa4-430c-b7d1-108688cbc230 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:00.981271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b693bb-9742-44d5-915c-f54669cf39c7 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:00.989234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0201b-7fa4-430c-b7d1-108688cbc230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:00.994588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-00a0201b-7fa4-430c-b7d1-108688cbc230 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:00.994588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:00.994588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:00.994588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:00.994588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:00.994588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:00.994588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:00.994588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:00.994588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:00.994588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:00.994588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:00.994588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:00.994588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:00.994588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:00.994588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:00.994588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:00.995523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:00.995523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:00.995523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:00.995523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:00.995523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:00.995523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:00.995523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:00.995523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:00.995523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:00.995523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:00.995523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:00.995523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:00.995523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:00.995523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:00.995523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:00.995523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:00.996358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:00.996358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:00.996358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:00.996358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:00.996358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:00.996358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:00.996358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:00.996358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:00.996358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:00.996358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:00.996358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:00.996358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:00.996358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 249/492] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Aug 11 09:41:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:00.997032 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0201b-7fa4-430c-b7d1-108688cbc230 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:01.023624 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb626316-6532-45ac-983c-07d951fab393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:01.024580 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb626316-6532-45ac-983c-07d951fab393 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:01.025109 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb626316-6532-45ac-983c-07d951fab393 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:01.025396 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb626316-6532-45ac-983c-07d951fab393 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:01.039436 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb626316-6532-45ac-983c-07d951fab393 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:01.047201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-fb626316-6532-45ac-983c-07d951fab393 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:01.047201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:01.047201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:01.047201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:01.047201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:01.047201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:01.047201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:01.047201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:01.047201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:01.047201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:01.047201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:01.047201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:01.047201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:01.047201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:01.047201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:01.047201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:01.049254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:01.049254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:01.049254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:01.049254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:01.049254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:01.049254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:01.049254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:01.049254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:01.049254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:01.049254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:01.049254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:01.049254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:01.049254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:01.049254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:01.049254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:01.049254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:01.051338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:01.051338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:01.051338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:01.051338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:01.051338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:01.051338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:01.051338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:01.051338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:01.051338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:01.051338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:01.051338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:01.051338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:01.051338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 244/493] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Aug 11 09:41:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:01.051338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb626316-6532-45ac-983c-07d951fab393 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:01.121327 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0201b-7fa4-430c-b7d1-108688cbc230 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:01.158288 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb626316-6532-45ac-983c-07d951fab393 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:01.158693 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fbb5d-6496-44e5-a42e-ca5439d6c47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:01.159309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fbb5d-6496-44e5-a42e-ca5439d6c47a None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:01.159682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fbb5d-6496-44e5-a42e-ca5439d6c47a None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:01.159959 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fbb5d-6496-44e5-a42e-ca5439d6c47a None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:01.160792 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518fbb5d-6496-44e5-a42e-ca5439d6c47a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:01.161095 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518fbb5d-6496-44e5-a42e-ca5439d6c47a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:01.162567 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518fbb5d-6496-44e5-a42e-ca5439d6c47a None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:01.193469 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b21c4-5948-4967-bee9-663f2a56a3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:01.194091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b21c4-5948-4967-bee9-663f2a56a3b9 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:01.194388 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b21c4-5948-4967-bee9-663f2a56a3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:01.194657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b21c4-5948-4967-bee9-663f2a56a3b9 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:01.195309 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b21c4-5948-4967-bee9-663f2a56a3b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:01.195604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b21c4-5948-4967-bee9-663f2a56a3b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:01.196989 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b21c4-5948-4967-bee9-663f2a56a3b9 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:01.207758 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 250/494] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Aug 11 09:41:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:01.208817 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fbb5d-6496-44e5-a42e-ca5439d6c47a None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:01.210022 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 245/495] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Aug 11 09:41:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:01.211359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa60de7-c51c-41ed-b43a-40ee427805bd None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:01.211635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa60de7-c51c-41ed-b43a-40ee427805bd None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:01.211890 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa60de7-c51c-41ed-b43a-40ee427805bd None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:01.213271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 246/496] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:01.214629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa60de7-c51c-41ed-b43a-40ee427805bd None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:01.230999 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:01.241119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:01.326226 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa60de7-c51c-41ed-b43a-40ee427805bd None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:01.327445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fbb5d-6496-44e5-a42e-ca5439d6c47a None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:01.361365 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812c1f3-cbe9-42f0-8ead-dbb07ea7cfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:01.361980 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812c1f3-cbe9-42f0-8ead-dbb07ea7cfd7 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:01.362287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812c1f3-cbe9-42f0-8ead-dbb07ea7cfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:01.362578 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812c1f3-cbe9-42f0-8ead-dbb07ea7cfd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:01.363937 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb834df5-1467-4bd2-8337-56acc6f3a445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:01.364689 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb834df5-1467-4bd2-8337-56acc6f3a445 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:01.365200 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb834df5-1467-4bd2-8337-56acc6f3a445 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:01.365623 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb834df5-1467-4bd2-8337-56acc6f3a445 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:01.366496 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb834df5-1467-4bd2-8337-56acc6f3a445 None admin] RBAC: Adding query filter params (name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:01.366930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb834df5-1467-4bd2-8337-56acc6f3a445 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:01.368441 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb834df5-1467-4bd2-8337-56acc6f3a445 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:01.377052 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 251/497] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Aug 11 09:41:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:01.378209 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb834df5-1467-4bd2-8337-56acc6f3a445 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:01.436050 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812c1f3-cbe9-42f0-8ead-dbb07ea7cfd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:01.437549 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812c1f3-cbe9-42f0-8ead-dbb07ea7cfd7 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:01.452057 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:01.468989 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:01.478936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb834df5-1467-4bd2-8337-56acc6f3a445 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:01.511584 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41634ace-870e-4a88-9e44-a1f7ee0284b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:01.512208 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41634ace-870e-4a88-9e44-a1f7ee0284b3 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:01.512459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41634ace-870e-4a88-9e44-a1f7ee0284b3 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:01.512722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41634ace-870e-4a88-9e44-a1f7ee0284b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:01.523371 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41634ace-870e-4a88-9e44-a1f7ee0284b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:01.524794 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41634ace-870e-4a88-9e44-a1f7ee0284b3 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:01.534231 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 247/498] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:41:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:41:01.535449 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac4b12-d76a-4c79-9a41-1d8e4e328c42 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:01.535734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac4b12-d76a-4c79-9a41-1d8e4e328c42 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:01.536007 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac4b12-d76a-4c79-9a41-1d8e4e328c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:01.539944 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-41634ace-870e-4a88-9e44-a1f7ee0284b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:01.539944 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:01.539944 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:01.539944 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:01.539944 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:01.539944 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:01.539944 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:01.539944 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:01.539944 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:01.539944 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:01.539944 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:01.539944 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:01.539944 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:01.539944 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:01.539944 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:01.539944 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:01.540857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:01.540857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:01.540857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:01.540857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:01.540857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:01.540857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:01.540857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:01.540857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:01.540857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:01.540857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:01.540857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:01.540857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:01.540857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:01.540857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:01.540857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:01.540857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:01.540857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:01.541762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:01.541762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:01.541762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:01.541762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 252/499] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:01.541981 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41634ace-870e-4a88-9e44-a1f7ee0284b3 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:01.558291 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-a0ac4b12-d76a-4c79-9a41-1d8e4e328c42 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:01.559458 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-a0ac4b12-d76a-4c79-9a41-1d8e4e328c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:01.624032 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 248/500] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:41:01.625260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1000e4-cbf5-45f8-b0e6-a9f9a3936be6 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:01.625539 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1000e4-cbf5-45f8-b0e6-a9f9a3936be6 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:01.625797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1000e4-cbf5-45f8-b0e6-a9f9a3936be6 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:01.627132 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 249/501] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:01.627704 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1000e4-cbf5-45f8-b0e6-a9f9a3936be6 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:01.658794 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41634ace-870e-4a88-9e44-a1f7ee0284b3 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:01.675523 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:01.691558 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a7f74-a79a-4e8b-8980-6c6cbab7dcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:01.692230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a7f74-a79a-4e8b-8980-6c6cbab7dcad None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:01.692490 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a7f74-a79a-4e8b-8980-6c6cbab7dcad None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:01.692751 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a7f74-a79a-4e8b-8980-6c6cbab7dcad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:01.703668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a7f74-a79a-4e8b-8980-6c6cbab7dcad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:01.705154 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a7f74-a79a-4e8b-8980-6c6cbab7dcad None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:01.706895 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:01.720174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-533a7f74-a79a-4e8b-8980-6c6cbab7dcad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:01.720174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:01.720174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:01.720174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:01.720174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:01.720174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:01.720174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:01.720174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:01.720174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:01.720174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:01.720174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:01.720174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:01.720174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:01.720174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:01.720174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:01.720174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:01.721247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:01.721247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:01.721247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:01.721247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:01.721247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:01.721247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:01.721247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:01.721247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:01.721247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:01.721247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:01.721247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:01.721247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:01.721247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:01.721247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:01.721247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:01.721247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:01.721247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:01.722314 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:01.722314 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:01.722314 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:01.722314 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 253/502] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:01.722314 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a7f74-a79a-4e8b-8980-6c6cbab7dcad None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:01.734337 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1000e4-cbf5-45f8-b0e6-a9f9a3936be6 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:01.767994 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d013f2e-5684-48eb-b35c-e4ff3b013512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:01.768807 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d013f2e-5684-48eb-b35c-e4ff3b013512 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:01.769072 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d013f2e-5684-48eb-b35c-e4ff3b013512 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:01.769333 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d013f2e-5684-48eb-b35c-e4ff3b013512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:01.779026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d013f2e-5684-48eb-b35c-e4ff3b013512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:01.780471 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d013f2e-5684-48eb-b35c-e4ff3b013512 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:01.794136 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-1d013f2e-5684-48eb-b35c-e4ff3b013512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:01.794136 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:01.794136 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:01.794136 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:01.794136 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:01.794136 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:01.794136 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:01.794136 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:01.794136 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:01.794136 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:01.794136 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:01.794136 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:01.794136 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:01.794136 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:01.794136 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:01.794136 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:01.795203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:01.795203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:01.795203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:01.795203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:01.795203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:01.795203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:01.795203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:01.795203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:01.795203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:01.795203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:01.795203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:01.795203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:01.795203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:01.795203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:01.795203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:01.795203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:01.795203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:01.796036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:01.796036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:01.796036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:01.796036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 250/503] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:01.796504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ca8a5-fcad-414d-b5cd-bf28a4fed031 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:01.796570 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ca8a5-fcad-414d-b5cd-bf28a4fed031 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:01.796783 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ca8a5-fcad-414d-b5cd-bf28a4fed031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:01.814471 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-c32ca8a5-fcad-414d-b5cd-bf28a4fed031 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:01.815708 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-c32ca8a5-fcad-414d-b5cd-bf28a4fed031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:01.823680 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a7f74-a79a-4e8b-8980-6c6cbab7dcad None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:01.855454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e936998-9d61-4223-be83-4c8c79c862bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:01.856056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e936998-9d61-4223-be83-4c8c79c862bc None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:01.856332 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e936998-9d61-4223-be83-4c8c79c862bc None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:01.856663 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e936998-9d61-4223-be83-4c8c79c862bc None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:01.857298 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e936998-9d61-4223-be83-4c8c79c862bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:01.857594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e936998-9d61-4223-be83-4c8c79c862bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:01.858988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e936998-9d61-4223-be83-4c8c79c862bc None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:01.870577 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 254/504] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:01.871340 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e936998-9d61-4223-be83-4c8c79c862bc None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:01.883504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 251/505] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:41:01.884252 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ca8a5-fcad-414d-b5cd-bf28a4fed031 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:01.922599 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:01.926710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:01.969157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e936998-9d61-4223-be83-4c8c79c862bc None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:01.991837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ca8a5-fcad-414d-b5cd-bf28a4fed031 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:02.002948 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1de302-e447-47d1-9c78-fc43713cfeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:02.003572 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1de302-e447-47d1-9c78-fc43713cfeee None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:02.003847 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1de302-e447-47d1-9c78-fc43713cfeee None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:02.004108 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1de302-e447-47d1-9c78-fc43713cfeee None admin] PATH_INFO: `/v3/roles/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:02.013592 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1de302-e447-47d1-9c78-fc43713cfeee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:02.018837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-1a1de302-e447-47d1-9c78-fc43713cfeee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:02.018837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:02.018837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:02.018837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:02.018837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:02.018837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:02.018837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:02.018837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:02.018837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:02.018837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:02.018837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:02.018837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:02.018837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:02.018837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:02.018837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:02.018837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:02.019703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:02.019703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:02.019703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:02.019703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:02.019703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:02.019703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:02.019703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:02.019703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:02.019703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:02.019703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:02.019703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:02.019703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:02.019703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:02.019703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:02.019703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:02.019703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:02.020500 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:02.020500 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:02.020500 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:02.020500 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:02.020500 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:02.020500 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:02.020500 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:02.020500 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:02.020500 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:02.020500 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:02.020500 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:02.020500 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:02.020500 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 255/506] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Aug 11 09:41:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:02.021161 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1de302-e447-47d1-9c78-fc43713cfeee None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:02.029995 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8e2bb-4587-420f-a0be-18747110a25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:02.030621 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8e2bb-4587-420f-a0be-18747110a25b None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:02.030898 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8e2bb-4587-420f-a0be-18747110a25b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:02.031514 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8e2bb-4587-420f-a0be-18747110a25b None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:02.032154 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8e2bb-4587-420f-a0be-18747110a25b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:02.032761 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8e2bb-4587-420f-a0be-18747110a25b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:02.034145 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8e2bb-4587-420f-a0be-18747110a25b None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:02.045443 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 252/507] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:02.046221 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8e2bb-4587-420f-a0be-18747110a25b None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:02.117846 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1de302-e447-47d1-9c78-fc43713cfeee None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:02.126665 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:02.131704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:02.141870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8e2bb-4587-420f-a0be-18747110a25b None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:02.150931 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d51ef6-5dee-4a17-b1b2-e4594cc1ed01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:02.152228 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d51ef6-5dee-4a17-b1b2-e4594cc1ed01 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:02.152228 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d51ef6-5dee-4a17-b1b2-e4594cc1ed01 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:02.152228 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d51ef6-5dee-4a17-b1b2-e4594cc1ed01 None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:02.152729 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d51ef6-5dee-4a17-b1b2-e4594cc1ed01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:02.153027 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d51ef6-5dee-4a17-b1b2-e4594cc1ed01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:02.154417 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d51ef6-5dee-4a17-b1b2-e4594cc1ed01 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:02.166365 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 256/508] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:02.167637 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d51ef6-5dee-4a17-b1b2-e4594cc1ed01 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:02.175889 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f75cc-3172-4e4c-9e9e-5601d1f4858d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:02.176507 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f75cc-3172-4e4c-9e9e-5601d1f4858d None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:02.176779 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f75cc-3172-4e4c-9e9e-5601d1f4858d None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:02.177042 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f75cc-3172-4e4c-9e9e-5601d1f4858d None admin] PATH_INFO: `/v3/users/glance` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:02.185434 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f75cc-3172-4e4c-9e9e-5601d1f4858d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:02.186912 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f75cc-3172-4e4c-9e9e-5601d1f4858d None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:02.197676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-e54f75cc-3172-4e4c-9e9e-5601d1f4858d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 11 09:41:02.197676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:02.197676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:02.197676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:02.197676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:02.197676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:02.197676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:02.197676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:02.197676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:02.197676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:02.197676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:02.197676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:02.197676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:02.197676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:02.197676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:02.197676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:02.198592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:02.198592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:02.198592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:02.198592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:02.198592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:02.198592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:02.198592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:02.198592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:02.198592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:02.198592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:02.198592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:02.198592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:02.198592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:02.198592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:02.198592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:02.198592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:02.198592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:02.198592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:02.199475 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:02.199475 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:02.199475 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:02.199475 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:02.199475 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:02.199475 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:02.199475 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:02.199475 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:02.199475 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 11 09:41:02.199475 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:02.199475 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 253/509] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:41:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:02.200042 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f75cc-3172-4e4c-9e9e-5601d1f4858d None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:02.267249 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d51ef6-5dee-4a17-b1b2-e4594cc1ed01 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:02.298288 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f75cc-3172-4e4c-9e9e-5601d1f4858d None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:02.299879 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44e47e-8928-4f67-93c6-6ebae3133966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:02.300496 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44e47e-8928-4f67-93c6-6ebae3133966 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:02.300770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44e47e-8928-4f67-93c6-6ebae3133966 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:02.301034 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44e47e-8928-4f67-93c6-6ebae3133966 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:02.311481 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44e47e-8928-4f67-93c6-6ebae3133966 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:02.312916 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44e47e-8928-4f67-93c6-6ebae3133966 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:02.327323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-7d44e47e-8928-4f67-93c6-6ebae3133966 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:02.327323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:02.327323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:02.327323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:02.327323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:02.327323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:02.327323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:02.327323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:02.327323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:02.327323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:02.327323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:02.327323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:02.327323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:02.327323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:02.327323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:02.327323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:02.328211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:02.328211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:02.328211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:02.328211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:02.328211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:02.328211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:02.328211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:02.328211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:02.328211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:02.328211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:02.328211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:02.328211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:02.328211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:02.328211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:02.328211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:02.328211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:02.328211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:02.329095 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:02.329095 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:02.329095 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:02.329095 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 257/510] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:02.329095 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44e47e-8928-4f67-93c6-6ebae3133966 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:02.331640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d14ff0-466c-4e76-b67f-7f3760787c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:02.332142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d14ff0-466c-4e76-b67f-7f3760787c8f None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:02.333021 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d14ff0-466c-4e76-b67f-7f3760787c8f None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:02.333021 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d14ff0-466c-4e76-b67f-7f3760787c8f None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:02.333505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d14ff0-466c-4e76-b67f-7f3760787c8f None admin] RBAC: Adding query filter params (name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:02.333630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d14ff0-466c-4e76-b67f-7f3760787c8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:02.334982 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d14ff0-466c-4e76-b67f-7f3760787c8f None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:02.343642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 254/511] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Aug 11 09:41:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:02.344417 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d14ff0-466c-4e76-b67f-7f3760787c8f None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:02.357616 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:02.360829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:02.432220 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44e47e-8928-4f67-93c6-6ebae3133966 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:02.442292 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d14ff0-466c-4e76-b67f-7f3760787c8f None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:02.465945 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d6b4d-2f1f-4caf-9ede-6533096f7c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:02.466589 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d6b4d-2f1f-4caf-9ede-6533096f7c02 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:02.466868 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d6b4d-2f1f-4caf-9ede-6533096f7c02 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:02.467137 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d6b4d-2f1f-4caf-9ede-6533096f7c02 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:02.474269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d6b4d-2f1f-4caf-9ede-6533096f7c02 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:02.474942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d2d54-98a6-492c-b95c-ac2bb4010de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:02.475614 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d2d54-98a6-492c-b95c-ac2bb4010de8 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:02.475721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d6b4d-2f1f-4caf-9ede-6533096f7c02 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:02.475886 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d2d54-98a6-492c-b95c-ac2bb4010de8 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:02.476149 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d2d54-98a6-492c-b95c-ac2bb4010de8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:02.483018 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d2d54-98a6-492c-b95c-ac2bb4010de8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:02.484427 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d2d54-98a6-492c-b95c-ac2bb4010de8 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:02.488235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-477d6b4d-2f1f-4caf-9ede-6533096f7c02 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 09:41:02.488235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:02.488235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:02.488235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:02.488235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:02.488235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:02.488235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:02.488235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:02.488235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:02.488235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:02.488235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:02.488235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:02.488235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:02.488235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:02.488235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:02.488235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:02.489269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:02.489269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:02.489269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:02.489269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:02.489269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:02.489269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:02.489269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:02.489269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:02.489269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:02.489269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:02.489269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:02.489269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:02.489269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:02.489269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:02.489269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:02.489269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:02.489269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:02.489269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:02.490438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:02.490438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:02.490438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:02.490438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:02.490438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:02.490438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:02.490438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:02.490438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:02.490438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 09:41:02.490438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:02.490438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 258/512] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:41:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:02.490438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d6b4d-2f1f-4caf-9ede-6533096f7c02 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:02.497151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-c54d2d54-98a6-492c-b95c-ac2bb4010de8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:02.497151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:02.497151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:02.497151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:02.497151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:02.497151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:02.497151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:02.497151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:02.497151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:02.497151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:02.497151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:02.497151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:02.497151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:02.497151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:02.497151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:02.498640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:02.498640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:02.498640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:02.498640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:02.498640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:02.498640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:02.498640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:02.498640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:02.498640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:02.498640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:02.498640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:02.498640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:02.498640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:02.498640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:02.498640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:02.498640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:02.498640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:02.499808 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:02.499808 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:02.499808 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:02.499808 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:02.499808 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:02.499808 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:02.499808 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:02.499808 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:02.499808 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 255/513] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:02.501527 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d2d54-98a6-492c-b95c-ac2bb4010de8 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:02.565715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:02.573344 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:02.587252 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d6b4d-2f1f-4caf-9ede-6533096f7c02 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:02.600189 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d2d54-98a6-492c-b95c-ac2bb4010de8 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:02.621717 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395831fa-afd6-48d8-a247-55d2603f07bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:02.622355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395831fa-afd6-48d8-a247-55d2603f07bf None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:02.622633 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395831fa-afd6-48d8-a247-55d2603f07bf None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:02.622904 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395831fa-afd6-48d8-a247-55d2603f07bf None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:02.623619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395831fa-afd6-48d8-a247-55d2603f07bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:02.623923 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395831fa-afd6-48d8-a247-55d2603f07bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:02.625377 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395831fa-afd6-48d8-a247-55d2603f07bf None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:02.632576 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e8dbb-84bf-4d1f-873f-6c45253113e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:02.633169 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e8dbb-84bf-4d1f-873f-6c45253113e8 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:02.636081 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e8dbb-84bf-4d1f-873f-6c45253113e8 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:02.636081 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e8dbb-84bf-4d1f-873f-6c45253113e8 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:02.636081 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e8dbb-84bf-4d1f-873f-6c45253113e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:02.636081 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e8dbb-84bf-4d1f-873f-6c45253113e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:02.636081 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e8dbb-84bf-4d1f-873f-6c45253113e8 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:02.645698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 259/514] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Aug 11 09:41:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:02.646543 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395831fa-afd6-48d8-a247-55d2603f07bf None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:02.658288 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 256/515] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:02.659121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e8dbb-84bf-4d1f-873f-6c45253113e8 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:02.747847 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395831fa-afd6-48d8-a247-55d2603f07bf None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:02.758812 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e8dbb-84bf-4d1f-873f-6c45253113e8 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:02.780578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cce9b-5d05-482f-89ad-7f772b5b7274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:02.781187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cce9b-5d05-482f-89ad-7f772b5b7274 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:02.781549 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cce9b-5d05-482f-89ad-7f772b5b7274 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:02.781814 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cce9b-5d05-482f-89ad-7f772b5b7274 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:02.785463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:02.791434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635cce9b-5d05-482f-89ad-7f772b5b7274 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:02.792844 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635cce9b-5d05-482f-89ad-7f772b5b7274 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:02.792984 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763d82a-1529-448b-87cf-5480fe5584f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:02.814013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763d82a-1529-448b-87cf-5480fe5584f7 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:02.814013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763d82a-1529-448b-87cf-5480fe5584f7 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:02.814013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763d82a-1529-448b-87cf-5480fe5584f7 None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:02.814013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763d82a-1529-448b-87cf-5480fe5584f7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:02.814013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763d82a-1529-448b-87cf-5480fe5584f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:02.814495 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:02.814573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763d82a-1529-448b-87cf-5480fe5584f7 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:02.814640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-635cce9b-5d05-482f-89ad-7f772b5b7274 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:02.814640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:02.814640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:02.814640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:02.814640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:02.814640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:02.814640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:02.814640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:02.814640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:02.814640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:02.814640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:02.814640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:02.814640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:02.814640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:02.814640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:02.814640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:02.815445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:02.815445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:02.815445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:02.815445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:02.815445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:02.815445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:02.815445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:02.815445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:02.815445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:02.815445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:02.815445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:02.815445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:02.815445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:02.815445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:02.815445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:02.815445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:02.815445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:02.816309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:02.816309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:02.816309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:02.816309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 260/516] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:02.816309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cce9b-5d05-482f-89ad-7f772b5b7274 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:02.832819 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 257/517] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Aug 11 09:41:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:02.833608 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763d82a-1529-448b-87cf-5480fe5584f7 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:02.910285 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cce9b-5d05-482f-89ad-7f772b5b7274 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:02.930513 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763d82a-1529-448b-87cf-5480fe5584f7 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:02.942355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a0de8-a2a8-4e84-8e0a-d41c6b9b1883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:02.942949 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a0de8-a2a8-4e84-8e0a-d41c6b9b1883 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:02.943233 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a0de8-a2a8-4e84-8e0a-d41c6b9b1883 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:02.943501 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a0de8-a2a8-4e84-8e0a-d41c6b9b1883 None admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:02.944191 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a0de8-a2a8-4e84-8e0a-d41c6b9b1883 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:02.944493 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a0de8-a2a8-4e84-8e0a-d41c6b9b1883 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:02.945929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a0de8-a2a8-4e84-8e0a-d41c6b9b1883 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:02.964270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950ced2-0c69-43e4-a9d5-c4a9df9030d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:02.964568 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 261/518] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:02.964868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950ced2-0c69-43e4-a9d5-c4a9df9030d1 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:02.965146 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950ced2-0c69-43e4-a9d5-c4a9df9030d1 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:02.965335 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a0de8-a2a8-4e84-8e0a-d41c6b9b1883 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:02.965431 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950ced2-0c69-43e4-a9d5-c4a9df9030d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:03.018357 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:03.025062 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:03.031564 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950ced2-0c69-43e4-a9d5-c4a9df9030d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:03.033062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950ced2-0c69-43e4-a9d5-c4a9df9030d1 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:03.068756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a0de8-a2a8-4e84-8e0a-d41c6b9b1883 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:03.101234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d5065-f70e-4e2b-9ba2-50e3431dc61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:03.101833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d5065-f70e-4e2b-9ba2-50e3431dc61d None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:03.102129 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d5065-f70e-4e2b-9ba2-50e3431dc61d None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:03.102403 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d5065-f70e-4e2b-9ba2-50e3431dc61d None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:03.103024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d5065-f70e-4e2b-9ba2-50e3431dc61d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:03.104461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d5065-f70e-4e2b-9ba2-50e3431dc61d None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:03.130180 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 258/519] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:41:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:41:03.131116 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950ced2-0c69-43e4-a9d5-c4a9df9030d1 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:03.167065 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 262/520] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Aug 11 09:41:02 2022] POST /identity/v3/users => generated 247 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:41:03.167875 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d5065-f70e-4e2b-9ba2-50e3431dc61d None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:03.234431 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:03.251623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950ced2-0c69-43e4-a9d5-c4a9df9030d1 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:03.293547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25a3ab-1691-41c8-b051-b3e05c2254fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:03.294216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25a3ab-1691-41c8-b051-b3e05c2254fc None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:03.294492 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25a3ab-1691-41c8-b051-b3e05c2254fc None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:03.294761 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25a3ab-1691-41c8-b051-b3e05c2254fc None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:03.294857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d5065-f70e-4e2b-9ba2-50e3431dc61d None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:03.295429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25a3ab-1691-41c8-b051-b3e05c2254fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:03.295728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25a3ab-1691-41c8-b051-b3e05c2254fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:03.297130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25a3ab-1691-41c8-b051-b3e05c2254fc None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:03.310167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:03.312452 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 259/521] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:03.313387 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25a3ab-1691-41c8-b051-b3e05c2254fc None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:03.340884 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf440a9-eb6e-42c4-b88e-044bde677c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:03.341502 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf440a9-eb6e-42c4-b88e-044bde677c2b None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:03.341911 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf440a9-eb6e-42c4-b88e-044bde677c2b None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:03.342129 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf440a9-eb6e-42c4-b88e-044bde677c2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:03.417318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf440a9-eb6e-42c4-b88e-044bde677c2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:03.418788 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf440a9-eb6e-42c4-b88e-044bde677c2b None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:03.434801 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25a3ab-1691-41c8-b051-b3e05c2254fc None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:03.470678 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4a400-afbd-4c85-a6f8-ee7400c9a42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:03.471289 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4a400-afbd-4c85-a6f8-ee7400c9a42a None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:03.471559 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4a400-afbd-4c85-a6f8-ee7400c9a42a None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:03.471822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4a400-afbd-4c85-a6f8-ee7400c9a42a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:03.472532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4a400-afbd-4c85-a6f8-ee7400c9a42a None admin] RBAC: Adding query filter params (role.id=b8d32893edf5475791d4c3b9aea5a3f6, scope.project.id=a0211f5c0b174c8c998e3ad29f96baab, user.id=4c1dc8e0d9454ad98894ed1e8d31f931) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:03.472834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4a400-afbd-4c85-a6f8-ee7400c9a42a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:03.474490 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4a400-afbd-4c85-a6f8-ee7400c9a42a None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:03.490113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 260/522] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:41:03 2022] GET /identity/v3/role_assignments?user.id=4c1dc8e0d9454ad98894ed1e8d31f931&scope.project.id=a0211f5c0b174c8c998e3ad29f96baab&role.id=b8d32893edf5475791d4c3b9aea5a3f6 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:03.490113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4a400-afbd-4c85-a6f8-ee7400c9a42a None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:03.505046 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:03.545129 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 263/523] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:41:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:41:03.547045 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf440a9-eb6e-42c4-b88e-044bde677c2b None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:03.571493 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:03.613438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4a400-afbd-4c85-a6f8-ee7400c9a42a None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:03.674070 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3e76d-9c10-4af2-add1-d8adce06150e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:03.674749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3e76d-9c10-4af2-add1-d8adce06150e None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:03.678038 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3e76d-9c10-4af2-add1-d8adce06150e None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:03.678038 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3e76d-9c10-4af2-add1-d8adce06150e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:03.688796 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf440a9-eb6e-42c4-b88e-044bde677c2b None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:03.692336 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3e76d-9c10-4af2-add1-d8adce06150e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:03.693996 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3e76d-9c10-4af2-add1-d8adce06150e None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:03.708778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-37b3e76d-9c10-4af2-add1-d8adce06150e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:03.708778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:03.708778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:03.708778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:03.708778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:03.708778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:03.708778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:03.708778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:03.708778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:03.708778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:03.708778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:03.708778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:03.708778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:03.708778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:03.708778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:03.708778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:03.709715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:03.709715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:03.709715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:03.709715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:03.709715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:03.709715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:03.709715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:03.709715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:03.709715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:03.709715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:03.709715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:03.709715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:03.709715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:03.709715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:03.709715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:03.709715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:03.709715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:03.710603 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:03.710603 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:03.710603 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:03.710603 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 261/524] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:03.711245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3e76d-9c10-4af2-add1-d8adce06150e None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:03.725738 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ee9fd-b46f-424e-94c9-6edaa5e91b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:03.726416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ee9fd-b46f-424e-94c9-6edaa5e91b1a None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:03.726693 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ee9fd-b46f-424e-94c9-6edaa5e91b1a None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:03.727063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ee9fd-b46f-424e-94c9-6edaa5e91b1a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:03.736354 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ee9fd-b46f-424e-94c9-6edaa5e91b1a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:03.737933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ee9fd-b46f-424e-94c9-6edaa5e91b1a None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:03.751742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-c97ee9fd-b46f-424e-94c9-6edaa5e91b1a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 11 09:41:03.751742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:03.751742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:03.751742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:03.751742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:03.751742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:03.751742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:03.751742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:03.751742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:03.751742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:03.751742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:03.751742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:03.751742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:03.751742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:03.751742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:03.751742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:03.753930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:03.753930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:03.753930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:03.753930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:03.753930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:03.753930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:03.753930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:03.753930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:03.753930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:03.753930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:03.753930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:03.753930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:03.753930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:03.753930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:03.753930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:03.753930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:03.753930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:03.753930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:03.756081 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:03.756081 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:03.756081 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:03.756081 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:03.756081 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:03.756081 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:03.756081 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:03.756081 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:03.756081 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 11 09:41:03.756081 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:03.762126 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 264/525] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Aug 11 09:41:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:03.762126 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ee9fd-b46f-424e-94c9-6edaa5e91b1a None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:03.778441 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:03.825609 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3e76d-9c10-4af2-add1-d8adce06150e None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:03.842187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:03.863889 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038e45b-d917-4087-8369-c7e714e2b35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:03.864892 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038e45b-d917-4087-8369-c7e714e2b35c None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:03.865367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038e45b-d917-4087-8369-c7e714e2b35c None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:03.865835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038e45b-d917-4087-8369-c7e714e2b35c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:03.875917 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ee9fd-b46f-424e-94c9-6edaa5e91b1a None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:03.878936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038e45b-d917-4087-8369-c7e714e2b35c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:03.880627 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038e45b-d917-4087-8369-c7e714e2b35c None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:03.895966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-f038e45b-d917-4087-8369-c7e714e2b35c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:03.895966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:03.895966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:03.895966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:03.895966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:03.895966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:03.895966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:03.895966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:03.895966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:03.895966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:03.895966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:03.895966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:03.895966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:03.895966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:03.895966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:03.895966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:03.896906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:03.896906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:03.896906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:03.896906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:03.896906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:03.896906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:03.896906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:03.896906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:03.896906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:03.896906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:03.896906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:03.896906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:03.896906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:03.896906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:03.896906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:03.896906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:03.896906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:03.897857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:03.897857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:03.897857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:03.900130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 262/526] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:03.901884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038e45b-d917-4087-8369-c7e714e2b35c None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:03.912775 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4a242-61cc-4230-96be-95ec783ac7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:03.913407 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4a242-61cc-4230-96be-95ec783ac7e8 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:03.913726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4a242-61cc-4230-96be-95ec783ac7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:03.913997 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4a242-61cc-4230-96be-95ec783ac7e8 None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:03.914778 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4a242-61cc-4230-96be-95ec783ac7e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:03.915083 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4a242-61cc-4230-96be-95ec783ac7e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:03.917130 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4a242-61cc-4230-96be-95ec783ac7e8 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:03.931275 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 265/527] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:03.932210 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4a242-61cc-4230-96be-95ec783ac7e8 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:04.015255 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038e45b-d917-4087-8369-c7e714e2b35c None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:04.030375 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:04.048254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4a242-61cc-4230-96be-95ec783ac7e8 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:04.051724 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b25669-2e7e-42dd-b876-0b5f6d869801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:04.052713 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b25669-2e7e-42dd-b876-0b5f6d869801 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:04.053188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b25669-2e7e-42dd-b876-0b5f6d869801 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:04.053651 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b25669-2e7e-42dd-b876-0b5f6d869801 None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:04.054634 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b25669-2e7e-42dd-b876-0b5f6d869801 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:04.055267 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b25669-2e7e-42dd-b876-0b5f6d869801 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:04.057288 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b25669-2e7e-42dd-b876-0b5f6d869801 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:04.075035 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 263/528] 10.222.0.13 () {56 vars in 1139 bytes} [Thu Aug 11 09:41:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:04.076263 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b25669-2e7e-42dd-b876-0b5f6d869801 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:04.087626 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:04.095904 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a25e5e-ba0e-4f0f-a1ae-c212bd9ad50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:04.096881 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a25e5e-ba0e-4f0f-a1ae-c212bd9ad50b None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:04.097161 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a25e5e-ba0e-4f0f-a1ae-c212bd9ad50b None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:04.097433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a25e5e-ba0e-4f0f-a1ae-c212bd9ad50b None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:04.101424 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a25e5e-ba0e-4f0f-a1ae-c212bd9ad50b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:04.101424 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a25e5e-ba0e-4f0f-a1ae-c212bd9ad50b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:04.101424 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a25e5e-ba0e-4f0f-a1ae-c212bd9ad50b None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:04.122404 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 266/529] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:04.123525 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a25e5e-ba0e-4f0f-a1ae-c212bd9ad50b None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:04.188691 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b25669-2e7e-42dd-b876-0b5f6d869801 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:04.224555 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26033992-c7d9-45fc-961a-9ddf4bb5d7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:04.225535 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26033992-c7d9-45fc-961a-9ddf4bb5d7f9 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:04.226011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26033992-c7d9-45fc-961a-9ddf4bb5d7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:04.226528 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26033992-c7d9-45fc-961a-9ddf4bb5d7f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:04.235866 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26033992-c7d9-45fc-961a-9ddf4bb5d7f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:04.237683 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26033992-c7d9-45fc-961a-9ddf4bb5d7f9 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:04.250219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-26033992-c7d9-45fc-961a-9ddf4bb5d7f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:04.250219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:04.250219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:04.250219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:04.250219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:04.250219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:04.250219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:04.250219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:04.250219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:04.250219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:04.250219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:04.250219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:04.250219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:04.250219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:04.250219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:04.251099 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:04.251099 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:04.251099 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:04.251099 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:04.251099 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:04.251099 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:04.251099 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:04.251099 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:04.251099 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:04.251099 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:04.251099 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:04.251099 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:04.251099 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:04.251099 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:04.251099 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:04.251099 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:04.251099 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:04.251949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:04.251949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:04.251949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:04.251949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:04.251949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:04.251949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:04.251949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:04.251949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:04.254409 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 264/530] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:04.255484 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26033992-c7d9-45fc-961a-9ddf4bb5d7f9 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:04.267693 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a25e5e-ba0e-4f0f-a1ae-c212bd9ad50b None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:04.288732 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:04.311628 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126a7d9-2565-4865-b562-b62d45c1724c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:04.312578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126a7d9-2565-4865-b562-b62d45c1724c None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:04.313051 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126a7d9-2565-4865-b562-b62d45c1724c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:04.313564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126a7d9-2565-4865-b562-b62d45c1724c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:04.374050 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26033992-c7d9-45fc-961a-9ddf4bb5d7f9 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:04.381073 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:04.395356 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126a7d9-2565-4865-b562-b62d45c1724c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:04.396810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126a7d9-2565-4865-b562-b62d45c1724c None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:04.412910 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69dc77-6b6b-47c9-9654-09c1dec4ddad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:04.413934 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69dc77-6b6b-47c9-9654-09c1dec4ddad None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:04.414496 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69dc77-6b6b-47c9-9654-09c1dec4ddad None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:04.414986 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69dc77-6b6b-47c9-9654-09c1dec4ddad None admin] PATH_INFO: `/v3/projects/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:04.423130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69dc77-6b6b-47c9-9654-09c1dec4ddad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:04.424849 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69dc77-6b6b-47c9-9654-09c1dec4ddad None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:04.438260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-cf69dc77-6b6b-47c9-9654-09c1dec4ddad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:04.438260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:04.438260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:04.438260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:04.438260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:04.438260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:04.438260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:04.438260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:04.438260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:04.438260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:04.438260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:04.438260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:04.438260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:04.438260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:04.438260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:04.439088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:04.439088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:04.439088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:04.439088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:04.439088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:04.439088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:04.439088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:04.439088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:04.439088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:04.439088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:04.439088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:04.439088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:04.439088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:04.439088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:04.439088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:04.439088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:04.439088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:04.439936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:04.439936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:04.439936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:04.439936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:04.439936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:04.439936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:04.439936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:04.439936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:04.442233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 265/531] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:04.443324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69dc77-6b6b-47c9-9654-09c1dec4ddad None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:04.530167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 267/532] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:41:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:41:04.531453 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126a7d9-2565-4865-b562-b62d45c1724c None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:04.547882 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:04.557884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69dc77-6b6b-47c9-9654-09c1dec4ddad None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:04.594778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fd83d-0e83-44fd-b5bc-da8c2c2880ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:04.595885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fd83d-0e83-44fd-b5bc-da8c2c2880ed None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:04.596306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fd83d-0e83-44fd-b5bc-da8c2c2880ed None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:04.596876 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fd83d-0e83-44fd-b5bc-da8c2c2880ed None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:04.597996 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fd83d-0e83-44fd-b5bc-da8c2c2880ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:04.598490 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fd83d-0e83-44fd-b5bc-da8c2c2880ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:04.600076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fd83d-0e83-44fd-b5bc-da8c2c2880ed None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:04.623409 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 266/533] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:04.625060 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fd83d-0e83-44fd-b5bc-da8c2c2880ed None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:04.663511 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:04.680976 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126a7d9-2565-4865-b562-b62d45c1724c None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:04.732160 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058c153-34ff-4252-9e1e-7554a8e6df63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:04.733282 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058c153-34ff-4252-9e1e-7554a8e6df63 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:04.733657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058c153-34ff-4252-9e1e-7554a8e6df63 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:04.734023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058c153-34ff-4252-9e1e-7554a8e6df63 None admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:04.734841 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058c153-34ff-4252-9e1e-7554a8e6df63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:04.735246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058c153-34ff-4252-9e1e-7554a8e6df63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:04.737510 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058c153-34ff-4252-9e1e-7554a8e6df63 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:04.750029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fd83d-0e83-44fd-b5bc-da8c2c2880ed None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:04.758162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 268/534] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:04.759232 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058c153-34ff-4252-9e1e-7554a8e6df63 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:04.788344 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13a869-26ca-42f6-92c2-56b304879281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:04.789198 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13a869-26ca-42f6-92c2-56b304879281 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:04.789715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13a869-26ca-42f6-92c2-56b304879281 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:04.790253 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13a869-26ca-42f6-92c2-56b304879281 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:04.801428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13a869-26ca-42f6-92c2-56b304879281 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:04.803125 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13a869-26ca-42f6-92c2-56b304879281 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:04.822416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-ea13a869-26ca-42f6-92c2-56b304879281 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:04.822416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:04.822416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:04.822416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:04.822416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:04.822416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:04.822416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:04.822416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:04.822416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:04.822416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:04.822416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:04.822416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:04.822416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:04.822416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:04.822416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:04.822416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:04.823895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:04.823895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:04.823895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:04.823895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:04.823895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:04.823895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:04.823895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:04.823895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:04.823895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:04.823895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:04.823895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:04.823895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:04.823895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:04.823895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:04.823895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:04.823895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:04.823895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:04.824744 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:04.824744 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:04.824744 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:04.829070 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 267/535] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:04.830030 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13a869-26ca-42f6-92c2-56b304879281 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:04.834835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:04.879287 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058c153-34ff-4252-9e1e-7554a8e6df63 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:04.914524 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57dcd5-f1c3-4f92-85ce-a4a42f86a5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:04.915577 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57dcd5-f1c3-4f92-85ce-a4a42f86a5eb None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:04.916048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57dcd5-f1c3-4f92-85ce-a4a42f86a5eb None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:04.917034 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57dcd5-f1c3-4f92-85ce-a4a42f86a5eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:04.917940 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57dcd5-f1c3-4f92-85ce-a4a42f86a5eb None admin] RBAC: Adding query filter params (role.id=b8d32893edf5475791d4c3b9aea5a3f6, scope.project.id=a0211f5c0b174c8c998e3ad29f96baab, user.id=a7791be968594cea9c32b51a7b3454b6) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:04.918458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57dcd5-f1c3-4f92-85ce-a4a42f86a5eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:04.920090 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57dcd5-f1c3-4f92-85ce-a4a42f86a5eb None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:04.926481 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 269/536] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:41:04 2022] GET /identity/v3/role_assignments?user.id=a7791be968594cea9c32b51a7b3454b6&scope.project.id=a0211f5c0b174c8c998e3ad29f96baab&role.id=b8d32893edf5475791d4c3b9aea5a3f6 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:04.927099 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57dcd5-f1c3-4f92-85ce-a4a42f86a5eb None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:04.970166 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:04.982717 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13a869-26ca-42f6-92c2-56b304879281 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:05.029335 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca074ef-740e-48a7-bdce-3e125d265354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:05.030379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca074ef-740e-48a7-bdce-3e125d265354 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:05.032265 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca074ef-740e-48a7-bdce-3e125d265354 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:05.032760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca074ef-740e-48a7-bdce-3e125d265354 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:05.033711 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca074ef-740e-48a7-bdce-3e125d265354 None admin] RBAC: Adding query filter params (role.id=b8d32893edf5475791d4c3b9aea5a3f6, scope.project.id=a0211f5c0b174c8c998e3ad29f96baab, user.id=740fc24dc2134f5ca2fba8caa9abb3cf) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:05.035325 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca074ef-740e-48a7-bdce-3e125d265354 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:05.037266 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca074ef-740e-48a7-bdce-3e125d265354 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:05.054069 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 268/537] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:41:04 2022] GET /identity/v3/role_assignments?user.id=740fc24dc2134f5ca2fba8caa9abb3cf&scope.project.id=a0211f5c0b174c8c998e3ad29f96baab&role.id=b8d32893edf5475791d4c3b9aea5a3f6 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:05.121139 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57dcd5-f1c3-4f92-85ce-a4a42f86a5eb None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:05.170053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd57138-e60b-4ac6-b1c0-8008ba7594af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:05.171074 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd57138-e60b-4ac6-b1c0-8008ba7594af None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:05.171547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd57138-e60b-4ac6-b1c0-8008ba7594af None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:05.172008 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd57138-e60b-4ac6-b1c0-8008ba7594af None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:05.172871 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd57138-e60b-4ac6-b1c0-8008ba7594af None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:05.173408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd57138-e60b-4ac6-b1c0-8008ba7594af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:05.175051 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd57138-e60b-4ac6-b1c0-8008ba7594af None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:05.193901 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 270/538] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:05.200123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca074ef-740e-48a7-bdce-3e125d265354 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:05.285274 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:05.321808 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca074ef-740e-48a7-bdce-3e125d265354 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:05.353465 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ded6a-935b-4216-9677-ab7fa7ac9eab None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:05.354685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ded6a-935b-4216-9677-ab7fa7ac9eab None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:05.355317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ded6a-935b-4216-9677-ab7fa7ac9eab None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:05.357655 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 271/539] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:41:05.362853 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0d197-4e7d-49bd-bb63-600cf1891bcb None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:05.363136 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0d197-4e7d-49bd-bb63-600cf1891bcb None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:05.363442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0d197-4e7d-49bd-bb63-600cf1891bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:05.364048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dee785-55b5-4122-bb0f-7c70714c4711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:05.364679 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dee785-55b5-4122-bb0f-7c70714c4711 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:05.364954 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dee785-55b5-4122-bb0f-7c70714c4711 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:05.365221 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dee785-55b5-4122-bb0f-7c70714c4711 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:05.372042 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dee785-55b5-4122-bb0f-7c70714c4711 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:05.373479 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dee785-55b5-4122-bb0f-7c70714c4711 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:05.384872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-33dee785-55b5-4122-bb0f-7c70714c4711 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:05.384872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:05.384872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:05.384872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:05.384872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:05.384872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:05.384872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:05.384872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:05.384872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:05.384872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:05.384872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:05.384872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:05.384872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:05.384872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:05.384872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:05.385787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:05.385787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:05.385787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:05.385787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:05.385787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:05.385787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:05.385787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:05.385787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:05.385787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:05.385787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:05.385787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:05.385787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:05.385787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:05.385787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:05.385787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:05.385787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:05.385787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:05.386647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:05.386647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:05.386647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:05.386647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:05.386647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:05.386647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:05.386647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:05.386647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:05.386647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 269/540] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:05.395507 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dee785-55b5-4122-bb0f-7c70714c4711 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:05.407090 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-04a0d197-4e7d-49bd-bb63-600cf1891bcb None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:05.408281 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-04a0d197-4e7d-49bd-bb63-600cf1891bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:05.528309 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dee785-55b5-4122-bb0f-7c70714c4711 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:05.562716 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 272/541] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:41:05.573130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:05.582658 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0b3e8-c36d-486e-88a0-ca490cbc445e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:05.587029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0b3e8-c36d-486e-88a0-ca490cbc445e None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:05.587029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0b3e8-c36d-486e-88a0-ca490cbc445e None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:05.587029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0b3e8-c36d-486e-88a0-ca490cbc445e None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:05.587029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0b3e8-c36d-486e-88a0-ca490cbc445e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:05.587029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0b3e8-c36d-486e-88a0-ca490cbc445e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:05.587029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0b3e8-c36d-486e-88a0-ca490cbc445e None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:05.606384 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 270/542] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:05.612428 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0d197-4e7d-49bd-bb63-600cf1891bcb None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:05.624834 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:05.628773 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0b3e8-c36d-486e-88a0-ca490cbc445e None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:05.757994 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0d197-4e7d-49bd-bb63-600cf1891bcb None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:05.775650 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0b3e8-c36d-486e-88a0-ca490cbc445e None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:05.803657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77319865-6e98-4dd3-9a3f-f5ac7cb25e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:05.804185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77319865-6e98-4dd3-9a3f-f5ac7cb25e07 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:05.804460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77319865-6e98-4dd3-9a3f-f5ac7cb25e07 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:05.804732 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77319865-6e98-4dd3-9a3f-f5ac7cb25e07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:05.805451 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77319865-6e98-4dd3-9a3f-f5ac7cb25e07 None admin] RBAC: Adding query filter params (role.id=b8d32893edf5475791d4c3b9aea5a3f6, scope.project.id=a0211f5c0b174c8c998e3ad29f96baab, user.id=4ac6ca32b5144c59b2bb5086fbd53ea4) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:05.806017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77319865-6e98-4dd3-9a3f-f5ac7cb25e07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:05.808541 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77319865-6e98-4dd3-9a3f-f5ac7cb25e07 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:05.816575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 273/543] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:41:05 2022] GET /identity/v3/role_assignments?user.id=4ac6ca32b5144c59b2bb5086fbd53ea4&scope.project.id=a0211f5c0b174c8c998e3ad29f96baab&role.id=b8d32893edf5475791d4c3b9aea5a3f6 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:05.817984 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f68b45-8847-4ad4-8fd8-99e4274a2c7d None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:05.818291 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f68b45-8847-4ad4-8fd8-99e4274a2c7d None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:05.818562 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f68b45-8847-4ad4-8fd8-99e4274a2c7d None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:05.824384 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0d207-29c1-4b78-afc5-7cf798bb57ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:05.824976 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 274/544] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:05.825703 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0d207-29c1-4b78-afc5-7cf798bb57ea None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:05.826232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0d207-29c1-4b78-afc5-7cf798bb57ea None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:05.826514 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bed235-dc16-4329-9ee0-58a776131c22 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:05.826799 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bed235-dc16-4329-9ee0-58a776131c22 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:05.827074 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bed235-dc16-4329-9ee0-58a776131c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:05.827329 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0d207-29c1-4b78-afc5-7cf798bb57ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:05.850731 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0d207-29c1-4b78-afc5-7cf798bb57ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:05.857622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-34c0d207-29c1-4b78-afc5-7cf798bb57ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:05.857622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:05.857622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:05.857622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:05.857622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:05.857622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:05.857622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:05.857622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:05.857622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:05.857622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:05.857622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:05.857622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:05.857622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:05.857622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:05.857622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:05.857622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:05.858639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:05.858639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:05.858639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:05.858639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:05.858639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:05.858639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:05.858639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:05.858639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:05.858639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:05.858639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:05.858639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:05.858639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:05.858639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:05.858639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:05.858639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:05.858639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:05.859442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:05.859442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:05.859442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:05.859442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:05.859442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:05.859442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:05.859442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:05.859442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:05.859442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:05.859442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:05.859442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:05.859442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:05.859442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 271/545] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Aug 11 09:41:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:05.866316 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-31bed235-dc16-4329-9ee0-58a776131c22 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:05.867087 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0d207-29c1-4b78-afc5-7cf798bb57ea None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:05.868094 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-31bed235-dc16-4329-9ee0-58a776131c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:05.940563 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:05.947061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 275/546] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 09:41:05.969646 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:05.988932 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bed235-dc16-4329-9ee0-58a776131c22 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:06.055847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0d207-29c1-4b78-afc5-7cf798bb57ea None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:06.094128 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009624a-5568-4dfb-a103-9fb88d01f46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:06.094128 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009624a-5568-4dfb-a103-9fb88d01f46a None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:06.094128 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009624a-5568-4dfb-a103-9fb88d01f46a None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:06.094488 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009624a-5568-4dfb-a103-9fb88d01f46a None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:06.096511 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009624a-5568-4dfb-a103-9fb88d01f46a None admin] RBAC: Adding query filter params (name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:06.096511 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009624a-5568-4dfb-a103-9fb88d01f46a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:06.096511 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009624a-5568-4dfb-a103-9fb88d01f46a None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:06.110361 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 272/547] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Aug 11 09:41:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:06.123057 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009624a-5568-4dfb-a103-9fb88d01f46a None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:06.147320 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bed235-dc16-4329-9ee0-58a776131c22 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:06.189440 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211d7f6-34c4-4b03-afc8-04261fa8b1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:06.190242 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211d7f6-34c4-4b03-afc8-04261fa8b1dd None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:06.190616 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211d7f6-34c4-4b03-afc8-04261fa8b1dd None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:06.191235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211d7f6-34c4-4b03-afc8-04261fa8b1dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:06.204260 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211d7f6-34c4-4b03-afc8-04261fa8b1dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:06.210194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-3211d7f6-34c4-4b03-afc8-04261fa8b1dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:06.210194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:06.210194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:06.210194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:06.210194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:06.210194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:06.210194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:06.210194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:06.210194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:06.210194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:06.210194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:06.210194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:06.210194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:06.210194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:06.210194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:06.210194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:06.211182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:06.211182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:06.211182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:06.211182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:06.211182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:06.211182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:06.211182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:06.211182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:06.211182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:06.211182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:06.211182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:06.211182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:06.211182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:06.211182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:06.211182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:06.211182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:06.212234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:06.212234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:06.212234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:06.212234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:06.212234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:06.212234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:06.212234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:06.212234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:06.212234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:06.212234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:06.212234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:06.212234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:06.212234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 276/548] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Aug 11 09:41:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:41:06.220477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211d7f6-34c4-4b03-afc8-04261fa8b1dd None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:06.319182 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009624a-5568-4dfb-a103-9fb88d01f46a None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:06.331816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:06.335601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:06.379677 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a964a26-d11d-47c0-98ad-c8d83fd7469f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:06.380310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a964a26-d11d-47c0-98ad-c8d83fd7469f None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:06.380592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a964a26-d11d-47c0-98ad-c8d83fd7469f None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:06.380862 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a964a26-d11d-47c0-98ad-c8d83fd7469f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:06.396065 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a964a26-d11d-47c0-98ad-c8d83fd7469f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:06.397538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a964a26-d11d-47c0-98ad-c8d83fd7469f None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:06.401559 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211d7f6-34c4-4b03-afc8-04261fa8b1dd None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:06.424216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-2a964a26-d11d-47c0-98ad-c8d83fd7469f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:06.424216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:06.424216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:06.424216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:06.424216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:06.424216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:06.424216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:06.424216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:06.424216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:06.424216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:06.424216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:06.424216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:06.424216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:06.424216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:06.424216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:06.424216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:06.425439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:06.425439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:06.425439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:06.425439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:06.425439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:06.425439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:06.425439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:06.425439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:06.425439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:06.425439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:06.425439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:06.425439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:06.425439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:06.425439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:06.425439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:06.425439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:06.425439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:06.426930 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:06.426930 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:06.426930 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:06.426930 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 273/549] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:06.435122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a964a26-d11d-47c0-98ad-c8d83fd7469f None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:06.444034 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79368084-86d1-4b0e-9fea-2b75711aabd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:06.444666 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79368084-86d1-4b0e-9fea-2b75711aabd8 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:06.444951 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79368084-86d1-4b0e-9fea-2b75711aabd8 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:06.445231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79368084-86d1-4b0e-9fea-2b75711aabd8 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:06.445908 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79368084-86d1-4b0e-9fea-2b75711aabd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:06.446245 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79368084-86d1-4b0e-9fea-2b75711aabd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:06.447713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79368084-86d1-4b0e-9fea-2b75711aabd8 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:06.456868 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 277/550] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Aug 11 09:41:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:06.462255 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79368084-86d1-4b0e-9fea-2b75711aabd8 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:06.564958 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79368084-86d1-4b0e-9fea-2b75711aabd8 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:06.587005 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a964a26-d11d-47c0-98ad-c8d83fd7469f None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:06.612894 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78fe45-7a03-42f3-aab9-8fea9425e5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:06.613528 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78fe45-7a03-42f3-aab9-8fea9425e5c2 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:06.613853 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78fe45-7a03-42f3-aab9-8fea9425e5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:06.614153 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78fe45-7a03-42f3-aab9-8fea9425e5c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:06.623591 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861185e-d7a4-4a81-878f-a48c6c136238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:06.624310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861185e-d7a4-4a81-878f-a48c6c136238 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:06.624706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861185e-d7a4-4a81-878f-a48c6c136238 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:06.624899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:06.625082 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861185e-d7a4-4a81-878f-a48c6c136238 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:06.625783 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861185e-d7a4-4a81-878f-a48c6c136238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:06.626162 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861185e-d7a4-4a81-878f-a48c6c136238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:06.626324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78fe45-7a03-42f3-aab9-8fea9425e5c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:06.627672 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861185e-d7a4-4a81-878f-a48c6c136238 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:06.627908 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78fe45-7a03-42f3-aab9-8fea9425e5c2 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:06.642599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-9f78fe45-7a03-42f3-aab9-8fea9425e5c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:06.642599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:06.642599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:06.642599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:06.642599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:06.642599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:06.642599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:06.642599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:06.642599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:06.642599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:06.642599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:06.642599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:06.642599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:06.642599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:06.642599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:06.642599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:06.643924 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:06.643924 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:06.643924 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:06.643924 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:06.643924 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:06.643924 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:06.643924 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:06.643924 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:06.643924 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:06.643924 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:06.643924 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:06.643924 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:06.643924 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:06.643924 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:06.643924 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:06.643924 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:06.643924 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:06.645018 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:06.645018 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:06.645018 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:06.645870 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 278/551] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:41:06.647149 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 274/552] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:06.651293 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78fe45-7a03-42f3-aab9-8fea9425e5c2 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:06.657919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861185e-d7a4-4a81-878f-a48c6c136238 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:06.706766 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:06.755778 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78fe45-7a03-42f3-aab9-8fea9425e5c2 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:06.795750 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2978c84-e858-4b3b-b556-82b6b8a3aa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:06.796570 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2978c84-e858-4b3b-b556-82b6b8a3aa9e None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:06.796950 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2978c84-e858-4b3b-b556-82b6b8a3aa9e None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:06.797352 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2978c84-e858-4b3b-b556-82b6b8a3aa9e None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:06.798106 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2978c84-e858-4b3b-b556-82b6b8a3aa9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:06.798570 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2978c84-e858-4b3b-b556-82b6b8a3aa9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:06.800027 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2978c84-e858-4b3b-b556-82b6b8a3aa9e None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:06.813310 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 279/553] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:06.819808 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2978c84-e858-4b3b-b556-82b6b8a3aa9e None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:06.865941 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:06.896025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861185e-d7a4-4a81-878f-a48c6c136238 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:06.939148 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2978c84-e858-4b3b-b556-82b6b8a3aa9e None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:06.976405 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaee74-5044-4a70-9e20-2743dd5cd272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:06.977189 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaee74-5044-4a70-9e20-2743dd5cd272 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:06.977600 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaee74-5044-4a70-9e20-2743dd5cd272 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:06.977974 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaee74-5044-4a70-9e20-2743dd5cd272 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:06.986671 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faaee74-5044-4a70-9e20-2743dd5cd272 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:06.990057 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faaee74-5044-4a70-9e20-2743dd5cd272 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:07.005858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1084a7-a65e-4b3d-9e78-4190e2866ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:07.006522 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1084a7-a65e-4b3d-9e78-4190e2866ce5 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:07.006799 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1084a7-a65e-4b3d-9e78-4190e2866ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:07.007070 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1084a7-a65e-4b3d-9e78-4190e2866ce5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:07.016444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-2faaee74-5044-4a70-9e20-2743dd5cd272 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 09:41:07.016444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:07.016444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:07.016444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:07.016444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:07.016444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:07.016444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:07.016444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:07.016444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:07.016444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:07.016444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:07.016444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:07.016444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:07.016444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:07.016444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:07.016444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:07.017355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:07.017355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:07.017355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:07.017355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:07.017355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:07.017355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:07.017355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:07.017355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:07.017355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:07.017355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:07.017355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:07.017355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:07.017355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:07.017355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:07.017355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:07.017355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:07.017355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:07.017355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:07.018319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:07.018319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:07.018319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:07.018319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:07.018319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:07.018319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:07.018319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:07.018319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:07.018319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 09:41:07.018319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:07.019870 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 280/554] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Aug 11 09:41:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:07.025366 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1084a7-a65e-4b3d-9e78-4190e2866ce5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:07.026518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaee74-5044-4a70-9e20-2743dd5cd272 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:07.030488 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1084a7-a65e-4b3d-9e78-4190e2866ce5 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:07.056095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-2f1084a7-a65e-4b3d-9e78-4190e2866ce5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 11 09:41:07.056095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:07.056095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:07.056095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:07.056095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:07.056095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:07.056095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:07.056095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:07.056095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:07.056095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:07.056095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:07.056095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:07.056095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:07.056095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:07.056095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:07.056095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:07.057699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:07.057699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:07.057699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:07.057699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:07.057699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:07.057699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:07.057699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:07.057699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:07.057699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:07.057699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:07.057699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:07.057699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:07.057699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:07.057699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:07.057699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:07.057699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:07.057699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:07.057699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:07.059147 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:07.059147 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:07.059147 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:07.059147 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:07.059147 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:07.059147 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:07.059147 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:07.059147 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:07.059147 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 11 09:41:07.059147 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:07.066477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 275/555] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:41:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:41:07.067403 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1084a7-a65e-4b3d-9e78-4190e2866ce5 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:07.167054 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:07.173686 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaee74-5044-4a70-9e20-2743dd5cd272 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:07.213818 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f67326-87d0-4921-9b2b-6ab96951b770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:07.214602 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f67326-87d0-4921-9b2b-6ab96951b770 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:07.214883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f67326-87d0-4921-9b2b-6ab96951b770 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:07.215154 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f67326-87d0-4921-9b2b-6ab96951b770 None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:07.215874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f67326-87d0-4921-9b2b-6ab96951b770 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:07.216179 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f67326-87d0-4921-9b2b-6ab96951b770 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:07.217745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f67326-87d0-4921-9b2b-6ab96951b770 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:07.243857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 281/556] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Aug 11 09:41:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:07.250562 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f67326-87d0-4921-9b2b-6ab96951b770 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:07.275590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:07.344030 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1084a7-a65e-4b3d-9e78-4190e2866ce5 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:07.367639 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f67326-87d0-4921-9b2b-6ab96951b770 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:07.391817 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c80c9-b073-4cf2-a1ff-c307dd82289b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:07.392506 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c80c9-b073-4cf2-a1ff-c307dd82289b None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:07.392790 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c80c9-b073-4cf2-a1ff-c307dd82289b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:07.393114 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c80c9-b073-4cf2-a1ff-c307dd82289b None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:07.393847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c80c9-b073-4cf2-a1ff-c307dd82289b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:07.394187 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c80c9-b073-4cf2-a1ff-c307dd82289b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:07.396451 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c80c9-b073-4cf2-a1ff-c307dd82289b None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:07.409207 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109b4a9-dc49-4cf6-ba99-af2e9f0707d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:07.409951 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109b4a9-dc49-4cf6-ba99-af2e9f0707d8 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:07.410338 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109b4a9-dc49-4cf6-ba99-af2e9f0707d8 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:07.410692 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109b4a9-dc49-4cf6-ba99-af2e9f0707d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:07.420401 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 276/557] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Aug 11 09:41:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:07.421835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52235ab-df5b-4b44-9dd0-87efc13a9cec None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:07.422140 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52235ab-df5b-4b44-9dd0-87efc13a9cec None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:07.422416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52235ab-df5b-4b44-9dd0-87efc13a9cec None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:07.423872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 277/558] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:07.425936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52235ab-df5b-4b44-9dd0-87efc13a9cec None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:07.426073 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109b4a9-dc49-4cf6-ba99-af2e9f0707d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:07.427677 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109b4a9-dc49-4cf6-ba99-af2e9f0707d8 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:07.444143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-1109b4a9-dc49-4cf6-ba99-af2e9f0707d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:07.444143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:07.444143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:07.444143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:07.444143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:07.444143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:07.444143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:07.444143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:07.444143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:07.444143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:07.444143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:07.444143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:07.444143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:07.444143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:07.444143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:07.444143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:07.445297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:07.445297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:07.445297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:07.445297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:07.445297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:07.445297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:07.445297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:07.445297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:07.445297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:07.445297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:07.445297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:07.445297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:07.445297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:07.445297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:07.445297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:07.445297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:07.445297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:07.446441 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:07.446441 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:07.446441 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:07.450103 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 282/559] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:07.450103 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77230462-8db1-4b6b-b4bd-d48681b2bef6 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:07.450103 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77230462-8db1-4b6b-b4bd-d48681b2bef6 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:07.450103 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77230462-8db1-4b6b-b4bd-d48681b2bef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:07.457309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:07.467764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-77230462-8db1-4b6b-b4bd-d48681b2bef6 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:07.469105 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-77230462-8db1-4b6b-b4bd-d48681b2bef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:07.545979 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 283/560] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:41:07.546919 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77230462-8db1-4b6b-b4bd-d48681b2bef6 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:07.554831 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52235ab-df5b-4b44-9dd0-87efc13a9cec None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:07.593682 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83a248-d920-40d6-8700-0a65360ba5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:07.594306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83a248-d920-40d6-8700-0a65360ba5b5 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:07.594581 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83a248-d920-40d6-8700-0a65360ba5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:07.594843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83a248-d920-40d6-8700-0a65360ba5b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:07.606065 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:07.662742 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83a248-d920-40d6-8700-0a65360ba5b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:07.664199 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83a248-d920-40d6-8700-0a65360ba5b5 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:07.670832 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77230462-8db1-4b6b-b4bd-d48681b2bef6 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:07.706361 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd8a56-64e5-4283-bf9e-48539b3615be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:07.707399 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd8a56-64e5-4283-bf9e-48539b3615be None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:07.707884 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd8a56-64e5-4283-bf9e-48539b3615be None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:07.708358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd8a56-64e5-4283-bf9e-48539b3615be None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:07.709166 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd8a56-64e5-4283-bf9e-48539b3615be None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:07.709640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd8a56-64e5-4283-bf9e-48539b3615be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:07.711189 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd8a56-64e5-4283-bf9e-48539b3615be None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:07.716478 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:07.725032 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 284/561] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:07.726306 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a0712-6e0a-4bbc-a957-c72847d97028 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:07.726747 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a0712-6e0a-4bbc-a957-c72847d97028 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:07.726856 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a0712-6e0a-4bbc-a957-c72847d97028 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:07.730190 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 285/562] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:07.730190 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a0712-6e0a-4bbc-a957-c72847d97028 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:07.776551 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 278/563] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:41:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:41:07.777622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83a248-d920-40d6-8700-0a65360ba5b5 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:07.820620 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:07.836521 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a0712-6e0a-4bbc-a957-c72847d97028 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:07.873403 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f73d18-ea85-4476-adfc-d5804666157b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:07.874296 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f73d18-ea85-4476-adfc-d5804666157b None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:07.874746 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f73d18-ea85-4476-adfc-d5804666157b None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:07.875158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f73d18-ea85-4476-adfc-d5804666157b None admin] PATH_INFO: `/v3/roles/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:07.881749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83a248-d920-40d6-8700-0a65360ba5b5 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:07.885938 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f73d18-ea85-4476-adfc-d5804666157b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:07.891263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-b3f73d18-ea85-4476-adfc-d5804666157b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:07.891263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:07.891263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:07.891263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:07.891263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:07.891263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:07.891263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:07.891263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:07.891263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:07.891263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:07.891263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:07.891263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:07.891263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:07.891263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:07.891263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:07.891263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:07.892197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:07.892197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:07.892197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:07.892197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:07.892197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:07.892197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:07.892197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:07.892197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:07.892197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:07.892197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:07.892197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:07.892197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:07.892197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:07.892197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:07.892197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:07.892197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:07.893035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:07.893035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:07.893035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:07.893035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:07.893035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:07.893035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:07.893035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:07.893035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:07.893035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:07.893035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:07.893035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:07.893035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:07.893035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 286/564] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Aug 11 09:41:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:07.894047 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82548db6-4c09-4fed-b579-6436ee153f01 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:07.894244 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82548db6-4c09-4fed-b579-6436ee153f01 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:07.894526 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82548db6-4c09-4fed-b579-6436ee153f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:07.914937 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-82548db6-4c09-4fed-b579-6436ee153f01 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:07.916188 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-82548db6-4c09-4fed-b579-6436ee153f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:07.921973 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316482d-73da-417a-8fdc-c8200baab10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:07.922574 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316482d-73da-417a-8fdc-c8200baab10d None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:07.922846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316482d-73da-417a-8fdc-c8200baab10d None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:07.923107 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316482d-73da-417a-8fdc-c8200baab10d None admin] PATH_INFO: `/v3/projects/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:07.929917 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316482d-73da-417a-8fdc-c8200baab10d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:07.931674 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316482d-73da-417a-8fdc-c8200baab10d None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:07.942557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-b316482d-73da-417a-8fdc-c8200baab10d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:07.942557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:07.942557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:07.942557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:07.942557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:07.942557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:07.942557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:07.942557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:07.942557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:07.942557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:07.942557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:07.942557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:07.942557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:07.942557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:07.942557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:07.943407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:07.943407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:07.943407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:07.943407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:07.943407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:07.943407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:07.943407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:07.943407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:07.943407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:07.943407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:07.943407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:07.943407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:07.943407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:07.943407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:07.943407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:07.943407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:07.943407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:07.944297 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:07.944297 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:07.944297 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:07.944297 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:07.944297 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:07.944297 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:07.944297 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:07.944297 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:07.944297 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 279/565] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:07.944297 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316482d-73da-417a-8fdc-c8200baab10d None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:07.975577 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:07.993095 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 287/566] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:41:07.994053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82548db6-4c09-4fed-b579-6436ee153f01 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:08.060739 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:08.064226 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316482d-73da-417a-8fdc-c8200baab10d None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:08.098904 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaa3aa-04e6-453a-9edf-455f8fcede64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:08.099529 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaa3aa-04e6-453a-9edf-455f8fcede64 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:08.099805 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaa3aa-04e6-453a-9edf-455f8fcede64 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:08.100068 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaa3aa-04e6-453a-9edf-455f8fcede64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:08.109555 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82548db6-4c09-4fed-b579-6436ee153f01 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:08.109793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaaa3aa-04e6-453a-9edf-455f8fcede64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:08.111294 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaaa3aa-04e6-453a-9edf-455f8fcede64 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:08.126161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-4aaaa3aa-04e6-453a-9edf-455f8fcede64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:08.126161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:08.126161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:08.126161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:08.126161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:08.126161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:08.126161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:08.126161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:08.126161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:08.126161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:08.126161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:08.126161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:08.126161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:08.126161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:08.126161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:08.126161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:08.132737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:08.132737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:08.132737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:08.132737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:08.132737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:08.132737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:08.132737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:08.132737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:08.132737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:08.132737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:08.132737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:08.132737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:08.132737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:08.132737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:08.132737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:08.132737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:08.132737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:08.133664 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:08.133664 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:08.133664 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:08.133664 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 280/567] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:08.133664 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaa3aa-04e6-453a-9edf-455f8fcede64 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:08.150063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd82693-c937-4be7-97e1-61cc1f6736d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:08.151251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd82693-c937-4be7-97e1-61cc1f6736d4 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:08.151523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd82693-c937-4be7-97e1-61cc1f6736d4 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:08.151788 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd82693-c937-4be7-97e1-61cc1f6736d4 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:08.152459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd82693-c937-4be7-97e1-61cc1f6736d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:08.152750 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd82693-c937-4be7-97e1-61cc1f6736d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:08.154116 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd82693-c937-4be7-97e1-61cc1f6736d4 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:08.166464 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 288/568] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Aug 11 09:41:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:08.166464 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd82693-c937-4be7-97e1-61cc1f6736d4 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:08.209357 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:08.230379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaa3aa-04e6-453a-9edf-455f8fcede64 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:08.260588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd82693-c937-4be7-97e1-61cc1f6736d4 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:08.262624 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f1c86-23ea-42b1-b83f-6ff1add62148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:08.263224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f1c86-23ea-42b1-b83f-6ff1add62148 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:08.263497 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f1c86-23ea-42b1-b83f-6ff1add62148 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:08.263768 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f1c86-23ea-42b1-b83f-6ff1add62148 None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:08.264445 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f1c86-23ea-42b1-b83f-6ff1add62148 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:08.264746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f1c86-23ea-42b1-b83f-6ff1add62148 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:08.266205 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f1c86-23ea-42b1-b83f-6ff1add62148 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:08.278343 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 281/569] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:08.279119 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f1c86-23ea-42b1-b83f-6ff1add62148 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:08.293037 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8fd0c-c2f8-4340-8163-5ec02a61cf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:08.293653 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8fd0c-c2f8-4340-8163-5ec02a61cf26 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:08.293926 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8fd0c-c2f8-4340-8163-5ec02a61cf26 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:08.294222 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8fd0c-c2f8-4340-8163-5ec02a61cf26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:08.297072 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:08.304005 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8fd0c-c2f8-4340-8163-5ec02a61cf26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:08.309775 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-a7c8fd0c-c2f8-4340-8163-5ec02a61cf26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:08.309775 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:08.309775 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:08.309775 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:08.309775 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:08.309775 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:08.309775 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:08.309775 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:08.309775 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:08.309775 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:08.309775 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:08.309775 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:08.309775 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:08.309775 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:08.309775 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:08.309775 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:08.310933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:08.310933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:08.310933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:08.310933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:08.310933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:08.310933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:08.310933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:08.310933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:08.310933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:08.310933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:08.310933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:08.310933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:08.310933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:08.310933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:08.310933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:08.310933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:08.311909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:08.311909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:08.311909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:08.311909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:08.311909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:08.311909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:08.311909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:08.311909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:08.311909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:08.311909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:08.311909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:08.311909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:08.311909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 289/570] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Aug 11 09:41:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:08.312597 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f038da-e790-45f4-bf2b-944894588982 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:08.312597 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f038da-e790-45f4-bf2b-944894588982 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:08.312597 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f038da-e790-45f4-bf2b-944894588982 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:08.313788 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 290/571] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:08.314330 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f038da-e790-45f4-bf2b-944894588982 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:08.387713 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f1c86-23ea-42b1-b83f-6ff1add62148 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:08.420261 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9136f-e0c8-42da-aa74-39fb2ccbe935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:08.420860 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9136f-e0c8-42da-aa74-39fb2ccbe935 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:08.421140 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9136f-e0c8-42da-aa74-39fb2ccbe935 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:08.421409 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9136f-e0c8-42da-aa74-39fb2ccbe935 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:08.422047 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9136f-e0c8-42da-aa74-39fb2ccbe935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:08.422377 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9136f-e0c8-42da-aa74-39fb2ccbe935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:08.423750 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9136f-e0c8-42da-aa74-39fb2ccbe935 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:08.425408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f038da-e790-45f4-bf2b-944894588982 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:08.432947 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:08.435568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 282/572] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:08.436328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9136f-e0c8-42da-aa74-39fb2ccbe935 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:08.464839 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846017ee-82c9-41ee-99fd-7180c46a3895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:08.465393 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846017ee-82c9-41ee-99fd-7180c46a3895 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:08.465668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846017ee-82c9-41ee-99fd-7180c46a3895 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:08.465941 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846017ee-82c9-41ee-99fd-7180c46a3895 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:08.475715 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846017ee-82c9-41ee-99fd-7180c46a3895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:08.477144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846017ee-82c9-41ee-99fd-7180c46a3895 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:08.491131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-846017ee-82c9-41ee-99fd-7180c46a3895 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:08.491131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:08.491131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:08.491131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:08.491131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:08.491131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:08.491131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:08.491131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:08.491131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:08.491131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:08.491131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:08.491131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:08.491131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:08.491131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:08.491131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:08.491131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:08.492231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:08.492231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:08.492231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:08.492231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:08.492231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:08.492231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:08.492231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:08.492231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:08.492231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:08.492231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:08.492231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:08.492231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:08.492231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:08.492231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:08.492231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:08.492231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:08.492231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:08.493415 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:08.493415 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:08.493415 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:08.493415 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 291/573] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:08.493415 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846017ee-82c9-41ee-99fd-7180c46a3895 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:08.511274 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:08.539441 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9136f-e0c8-42da-aa74-39fb2ccbe935 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:08.573030 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee40d6-07a0-49ba-b5f7-f395fc89716e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:08.573673 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee40d6-07a0-49ba-b5f7-f395fc89716e None admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:08.573946 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee40d6-07a0-49ba-b5f7-f395fc89716e None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:08.574250 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee40d6-07a0-49ba-b5f7-f395fc89716e None admin] PATH_INFO: `/v3/projects/a0211f5c0b174c8c998e3ad29f96baab/users/4c1dc8e0d9454ad98894ed1e8d31f931/roles/b8d32893edf5475791d4c3b9aea5a3f6` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:08.588119 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee40d6-07a0-49ba-b5f7-f395fc89716e None admin] RBAC: Authorizing `identity:create_grant(project_id=a0211f5c0b174c8c998e3ad29f96baab, user_id=4c1dc8e0d9454ad98894ed1e8d31f931, role_id=b8d32893edf5475791d4c3b9aea5a3f6)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:08.589539 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee40d6-07a0-49ba-b5f7-f395fc89716e None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:08.592764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846017ee-82c9-41ee-99fd-7180c46a3895 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:08.625094 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fba129-1caf-41b3-8e44-69e2f4cbf7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:08.625687 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fba129-1caf-41b3-8e44-69e2f4cbf7de None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:08.625963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fba129-1caf-41b3-8e44-69e2f4cbf7de None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:08.626261 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fba129-1caf-41b3-8e44-69e2f4cbf7de None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:08.626925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fba129-1caf-41b3-8e44-69e2f4cbf7de None admin] RBAC: Adding query filter params (name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:08.627205 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fba129-1caf-41b3-8e44-69e2f4cbf7de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:08.628537 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fba129-1caf-41b3-8e44-69e2f4cbf7de None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:08.636889 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 292/574] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Aug 11 09:41:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:08.638146 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214441da-a9a0-44dc-a1a3-b82dd112a24e None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:08.638429 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214441da-a9a0-44dc-a1a3-b82dd112a24e None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:08.638698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214441da-a9a0-44dc-a1a3-b82dd112a24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:08.648083 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 283/575] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Aug 11 09:41:08 2022] PUT /identity/v3/projects/a0211f5c0b174c8c998e3ad29f96baab/users/4c1dc8e0d9454ad98894ed1e8d31f931/roles/b8d32893edf5475791d4c3b9aea5a3f6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:41:08.648897 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee40d6-07a0-49ba-b5f7-f395fc89716e None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:08.656565 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-214441da-a9a0-44dc-a1a3-b82dd112a24e None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:08.657830 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-214441da-a9a0-44dc-a1a3-b82dd112a24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:08.675733 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:08.733613 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 293/576] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:41:08.734442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214441da-a9a0-44dc-a1a3-b82dd112a24e None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:08.826497 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee40d6-07a0-49ba-b5f7-f395fc89716e None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:08.850265 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:08.854968 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214441da-a9a0-44dc-a1a3-b82dd112a24e None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:08.864455 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c949fd-0201-40cf-9602-6bdb49e0a7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:08.864455 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c949fd-0201-40cf-9602-6bdb49e0a7e0 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:08.864657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c949fd-0201-40cf-9602-6bdb49e0a7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:08.865192 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c949fd-0201-40cf-9602-6bdb49e0a7e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:08.872825 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c949fd-0201-40cf-9602-6bdb49e0a7e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:08.874308 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c949fd-0201-40cf-9602-6bdb49e0a7e0 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:08.885216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-e4c949fd-0201-40cf-9602-6bdb49e0a7e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:08.885216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:08.885216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:08.885216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:08.885216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:08.885216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:08.885216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:08.885216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:08.885216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:08.885216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:08.885216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:08.885216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:08.885216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:08.885216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:08.885216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:08.886148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:08.886148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:08.886148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:08.886148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:08.886148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:08.886148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:08.886148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:08.886148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:08.886148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:08.886148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:08.886148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:08.886148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:08.886148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:08.886148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:08.886148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:08.886148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:08.886148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:08.887045 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:08.887045 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:08.887045 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:08.887045 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:08.887045 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:08.887045 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:08.887045 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:08.887045 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:08.887045 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 284/577] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:08.887551 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c949fd-0201-40cf-9602-6bdb49e0a7e0 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:08.896020 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9396f8-647a-4913-b9c1-2a5ba03c0932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:08.896655 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9396f8-647a-4913-b9c1-2a5ba03c0932 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:08.897082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9396f8-647a-4913-b9c1-2a5ba03c0932 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:08.897376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9396f8-647a-4913-b9c1-2a5ba03c0932 None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:08.898047 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9396f8-647a-4913-b9c1-2a5ba03c0932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:08.898374 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9396f8-647a-4913-b9c1-2a5ba03c0932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:08.899890 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9396f8-647a-4913-b9c1-2a5ba03c0932 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:08.916886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 294/578] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:08.916886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9396f8-647a-4913-b9c1-2a5ba03c0932 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:08.926912 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:09.000764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c949fd-0201-40cf-9602-6bdb49e0a7e0 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:09.015846 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9396f8-647a-4913-b9c1-2a5ba03c0932 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:09.034907 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb206d-3e09-485b-afbc-20daff0e8497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:09.035670 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb206d-3e09-485b-afbc-20daff0e8497 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:09.036053 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb206d-3e09-485b-afbc-20daff0e8497 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:09.036421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb206d-3e09-485b-afbc-20daff0e8497 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:09.047785 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb206d-3e09-485b-afbc-20daff0e8497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:09.049304 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb206d-3e09-485b-afbc-20daff0e8497 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:09.050393 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb5cf8-e448-4415-90a5-feeea9039306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:09.051088 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb5cf8-e448-4415-90a5-feeea9039306 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:09.051365 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb5cf8-e448-4415-90a5-feeea9039306 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:09.051628 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb5cf8-e448-4415-90a5-feeea9039306 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:09.062826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb5cf8-e448-4415-90a5-feeea9039306 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:09.064381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-debb206d-3e09-485b-afbc-20daff0e8497 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:09.064381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:09.064381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:09.064381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:09.064381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:09.064381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:09.064381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:09.064381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:09.064381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:09.064381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:09.064381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:09.064381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:09.064381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:09.064381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:09.064381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:09.064381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:09.065310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:09.065310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:09.065310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:09.065310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:09.065310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:09.065310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:09.065310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:09.065310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:09.065310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:09.065310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:09.065310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:09.065310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:09.065310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:09.065310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:09.065310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:09.065310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:09.065310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:09.070951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:09.070951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:09.070951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:09.070951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 285/579] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:09.070951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb206d-3e09-485b-afbc-20daff0e8497 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:09.071251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-46bb5cf8-e448-4415-90a5-feeea9039306 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:09.071251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:09.071251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:09.071251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:09.071251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:09.071251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:09.071251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:09.071251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:09.071251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:09.071251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:09.071251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:09.071251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:09.071251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:09.071251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:09.071251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:09.071251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:09.072087 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:09.072087 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:09.072087 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:09.072087 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:09.072087 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:09.072087 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:09.072087 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:09.072087 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:09.072087 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:09.072087 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:09.072087 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:09.072087 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:09.072087 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:09.072087 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:09.072087 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:09.072087 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:09.072983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:09.072983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:09.072983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:09.072983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:09.072983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:09.072983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:09.072983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:09.072983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:09.072983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:09.072983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:09.072983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:09.072983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:09.072983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 295/580] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Aug 11 09:41:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:09.072983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb5cf8-e448-4415-90a5-feeea9039306 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:09.112106 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:09.144079 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:09.175498 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb5cf8-e448-4415-90a5-feeea9039306 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:09.184989 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb206d-3e09-485b-afbc-20daff0e8497 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:09.210952 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef5fdf-eff0-47c9-91b9-c1d6d8f62c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:09.211574 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef5fdf-eff0-47c9-91b9-c1d6d8f62c79 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:09.211867 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef5fdf-eff0-47c9-91b9-c1d6d8f62c79 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:09.212136 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef5fdf-eff0-47c9-91b9-c1d6d8f62c79 None admin] PATH_INFO: `/v3/users/glance` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:09.219741 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef5fdf-eff0-47c9-91b9-c1d6d8f62c79 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:09.221165 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef5fdf-eff0-47c9-91b9-c1d6d8f62c79 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:09.223046 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c2a76-e58b-4d56-875d-1a4c53d6f393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:09.223929 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c2a76-e58b-4d56-875d-1a4c53d6f393 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:09.224046 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c2a76-e58b-4d56-875d-1a4c53d6f393 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:09.224395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c2a76-e58b-4d56-875d-1a4c53d6f393 None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:09.225132 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c2a76-e58b-4d56-875d-1a4c53d6f393 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:09.225498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c2a76-e58b-4d56-875d-1a4c53d6f393 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:09.227025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c2a76-e58b-4d56-875d-1a4c53d6f393 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:09.236325 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-93ef5fdf-eff0-47c9-91b9-c1d6d8f62c79 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 11 09:41:09.236325 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:09.236325 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:09.236325 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:09.236325 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:09.236325 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:09.236325 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:09.236325 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:09.236325 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:09.236325 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:09.236325 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:09.236325 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:09.236325 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:09.236325 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:09.236325 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:09.236325 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:09.237442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:09.237442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:09.237442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:09.237442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:09.237442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:09.237442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:09.237442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:09.237442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:09.237442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:09.237442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:09.237442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:09.237442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:09.237442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:09.237442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:09.237442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:09.237442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:09.237442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:09.237442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:09.238608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:09.238608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:09.238608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:09.238608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:09.238608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:09.238608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:09.238608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:09.238608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:09.238608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 11 09:41:09.238608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:09.245795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 296/581] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:41:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:09.245795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef5fdf-eff0-47c9-91b9-c1d6d8f62c79 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:09.256375 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 286/582] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:09.256375 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c2a76-e58b-4d56-875d-1a4c53d6f393 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:09.353059 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef5fdf-eff0-47c9-91b9-c1d6d8f62c79 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:09.356351 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:09.363566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c2a76-e58b-4d56-875d-1a4c53d6f393 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:09.382771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:09.390664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f083c8-61ef-4289-b222-1aecb9b581fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:09.391449 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f083c8-61ef-4289-b222-1aecb9b581fe None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:09.391781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f083c8-61ef-4289-b222-1aecb9b581fe None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:09.392114 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f083c8-61ef-4289-b222-1aecb9b581fe None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:09.392856 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f083c8-61ef-4289-b222-1aecb9b581fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:09.393217 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f083c8-61ef-4289-b222-1aecb9b581fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:09.394826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f083c8-61ef-4289-b222-1aecb9b581fe None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:09.398931 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d4686-6d1e-48fa-9f5e-5075f54ba541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:09.399591 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d4686-6d1e-48fa-9f5e-5075f54ba541 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:09.399926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d4686-6d1e-48fa-9f5e-5075f54ba541 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:09.400248 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d4686-6d1e-48fa-9f5e-5075f54ba541 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:09.400979 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d4686-6d1e-48fa-9f5e-5075f54ba541 None admin] RBAC: Adding query filter params (name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:09.401335 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d4686-6d1e-48fa-9f5e-5075f54ba541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:09.402772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d4686-6d1e-48fa-9f5e-5075f54ba541 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:09.411119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 297/583] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:09.411119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f083c8-61ef-4289-b222-1aecb9b581fe None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:09.415104 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 287/584] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Aug 11 09:41:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:09.420129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d4686-6d1e-48fa-9f5e-5075f54ba541 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:09.511575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f083c8-61ef-4289-b222-1aecb9b581fe None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:09.521664 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d4686-6d1e-48fa-9f5e-5075f54ba541 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:09.545357 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7909dc-62b2-4624-a881-ffde8d7d56fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:09.545954 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7909dc-62b2-4624-a881-ffde8d7d56fb None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:09.546271 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7909dc-62b2-4624-a881-ffde8d7d56fb None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:09.546543 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7909dc-62b2-4624-a881-ffde8d7d56fb None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:09.547250 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7909dc-62b2-4624-a881-ffde8d7d56fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:09.547558 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7909dc-62b2-4624-a881-ffde8d7d56fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:09.548970 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7909dc-62b2-4624-a881-ffde8d7d56fb None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:09.560047 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a5a45-7f1d-453a-abf4-011289f6f009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:09.560888 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a5a45-7f1d-453a-abf4-011289f6f009 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:09.561368 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a5a45-7f1d-453a-abf4-011289f6f009 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:09.561824 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a5a45-7f1d-453a-abf4-011289f6f009 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:09.562877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a5a45-7f1d-453a-abf4-011289f6f009 None admin] RBAC: Adding query filter params (role.id=b8d32893edf5475791d4c3b9aea5a3f6, scope.project.id=a0211f5c0b174c8c998e3ad29f96baab, user.id=f7e3b1c5aec94673b391210ae51d4cc2) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:09.563321 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a5a45-7f1d-453a-abf4-011289f6f009 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:09.564811 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a5a45-7f1d-453a-abf4-011289f6f009 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:09.570591 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 298/585] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Aug 11 09:41:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:09.570591 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7909dc-62b2-4624-a881-ffde8d7d56fb None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:09.582120 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 288/586] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:41:09 2022] GET /identity/v3/role_assignments?user.id=f7e3b1c5aec94673b391210ae51d4cc2&scope.project.id=a0211f5c0b174c8c998e3ad29f96baab&role.id=b8d32893edf5475791d4c3b9aea5a3f6 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:09.582120 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a5a45-7f1d-453a-abf4-011289f6f009 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:09.608144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:09.631519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:09.701302 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7909dc-62b2-4624-a881-ffde8d7d56fb None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:09.714751 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a5a45-7f1d-453a-abf4-011289f6f009 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:09.779939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436cb78-0b43-4b8c-8e0c-edb1eb77d9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:09.780684 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436cb78-0b43-4b8c-8e0c-edb1eb77d9ca None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:09.781032 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436cb78-0b43-4b8c-8e0c-edb1eb77d9ca None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:09.781390 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436cb78-0b43-4b8c-8e0c-edb1eb77d9ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:09.781755 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd85dbc-8630-4be8-a838-82918fdd35fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:09.782580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd85dbc-8630-4be8-a838-82918fdd35fe None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:09.783017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd85dbc-8630-4be8-a838-82918fdd35fe None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:09.783427 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd85dbc-8630-4be8-a838-82918fdd35fe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:09.792148 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd85dbc-8630-4be8-a838-82918fdd35fe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:09.793759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd85dbc-8630-4be8-a838-82918fdd35fe None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:09.794333 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436cb78-0b43-4b8c-8e0c-edb1eb77d9ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:09.795990 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436cb78-0b43-4b8c-8e0c-edb1eb77d9ca None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:09.806445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-cfd85dbc-8630-4be8-a838-82918fdd35fe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 09:41:09.806445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:09.806445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:09.806445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:09.806445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:09.806445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:09.806445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:09.806445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:09.806445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:09.806445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:09.806445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:09.806445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:09.806445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:09.806445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:09.806445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:09.806445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:09.808178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:09.808178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:09.808178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:09.808178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:09.808178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:09.808178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:09.808178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:09.808178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:09.808178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:09.808178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:09.808178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:09.808178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:09.808178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:09.808178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:09.808178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:09.808178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:09.808178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:09.808178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:09.809206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:09.809206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:09.809206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:09.809206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:09.809206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:09.809206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:09.809206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:09.809206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:09.809206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 09:41:09.809206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:09.811567 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 299/587] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:41:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:09.812706 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd85dbc-8630-4be8-a838-82918fdd35fe None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:09.813302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-0436cb78-0b43-4b8c-8e0c-edb1eb77d9ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:09.813302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:09.813302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:09.813302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:09.813302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:09.813302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:09.813302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:09.813302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:09.813302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:09.813302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:09.813302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:09.813302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:09.813302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:09.813302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:09.813302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:09.813302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:09.814254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:09.814254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:09.814254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:09.814254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:09.814254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:09.814254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:09.814254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:09.814254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:09.814254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:09.814254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:09.814254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:09.814254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:09.814254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:09.814254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:09.814254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:09.814254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:09.814254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:09.815528 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:09.815528 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:09.815528 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:09.815528 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 289/588] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:09.820106 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436cb78-0b43-4b8c-8e0c-edb1eb77d9ca None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:09.894293 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:09.925171 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd85dbc-8630-4be8-a838-82918fdd35fe None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:09.928018 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436cb78-0b43-4b8c-8e0c-edb1eb77d9ca None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:09.937170 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:09.964586 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcecd4-9fa1-4915-8b95-69c0b458df1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:09.965346 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcecd4-9fa1-4915-8b95-69c0b458df1b None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:09.965589 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b81850-65b9-477b-995a-6ec5b5d03392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:09.965806 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcecd4-9fa1-4915-8b95-69c0b458df1b None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:09.966350 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcecd4-9fa1-4915-8b95-69c0b458df1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:09.966975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b81850-65b9-477b-995a-6ec5b5d03392 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:09.967943 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b81850-65b9-477b-995a-6ec5b5d03392 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:09.968448 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b81850-65b9-477b-995a-6ec5b5d03392 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:09.969315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b81850-65b9-477b-995a-6ec5b5d03392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:09.969754 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b81850-65b9-477b-995a-6ec5b5d03392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:09.971373 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b81850-65b9-477b-995a-6ec5b5d03392 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:09.979121 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbcecd4-9fa1-4915-8b95-69c0b458df1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:09.980660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbcecd4-9fa1-4915-8b95-69c0b458df1b None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:09.985018 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 290/589] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:09.986072 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b81850-65b9-477b-995a-6ec5b5d03392 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:09.996157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-dcbcecd4-9fa1-4915-8b95-69c0b458df1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:09.996157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:09.996157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:09.996157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:09.996157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:09.996157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:09.996157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:09.996157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:09.996157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:09.996157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:09.996157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:09.996157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:09.996157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:09.996157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:09.996157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:09.996157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:09.997206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:09.997206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:09.997206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:09.997206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:09.997206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:09.997206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:09.997206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:09.997206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:09.997206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:09.997206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:09.997206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:09.997206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:09.997206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:09.997206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:09.997206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:09.997206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:09.997206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:09.998128 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:09.998128 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:09.998128 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:10.002191 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 300/590] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:10.003098 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcecd4-9fa1-4915-8b95-69c0b458df1b None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:10.093536 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b81850-65b9-477b-995a-6ec5b5d03392 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:10.111503 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcecd4-9fa1-4915-8b95-69c0b458df1b None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:10.126697 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:10.132152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678665bf-a120-4df2-9f80-abf9a5f02801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:10.132920 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678665bf-a120-4df2-9f80-abf9a5f02801 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:10.133335 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678665bf-a120-4df2-9f80-abf9a5f02801 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:10.133812 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678665bf-a120-4df2-9f80-abf9a5f02801 None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:10.134723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678665bf-a120-4df2-9f80-abf9a5f02801 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:10.135186 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678665bf-a120-4df2-9f80-abf9a5f02801 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:10.136877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678665bf-a120-4df2-9f80-abf9a5f02801 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:10.148442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e1ed9-d3ba-42c2-a481-1a5d4e83d695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:10.149068 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e1ed9-d3ba-42c2-a481-1a5d4e83d695 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:10.149340 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e1ed9-d3ba-42c2-a481-1a5d4e83d695 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:10.149606 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e1ed9-d3ba-42c2-a481-1a5d4e83d695 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:10.157626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 291/591] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Aug 11 09:41:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:10.158202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e1ed9-d3ba-42c2-a481-1a5d4e83d695 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:10.158981 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678665bf-a120-4df2-9f80-abf9a5f02801 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:10.159915 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e1ed9-d3ba-42c2-a481-1a5d4e83d695 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:10.173317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-f37e1ed9-d3ba-42c2-a481-1a5d4e83d695 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 11 09:41:10.173317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:10.173317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:10.173317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:10.173317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:10.173317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:10.173317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:10.173317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:10.173317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:10.173317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:10.173317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:10.173317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:10.173317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:10.173317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:10.173317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:10.173317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:10.174323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:10.174323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:10.174323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:10.174323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:10.174323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:10.174323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:10.174323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:10.174323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:10.174323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:10.174323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:10.174323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:10.174323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:10.174323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:10.174323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:10.174323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:10.174323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:10.174323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:10.174323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:10.175259 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:10.175259 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:10.175259 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:10.175259 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:10.175259 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:10.175259 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:10.175259 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:10.175259 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:10.175259 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 11 09:41:10.175259 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:10.175259 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 301/592] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Aug 11 09:41:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:10.175914 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e1ed9-d3ba-42c2-a481-1a5d4e83d695 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:10.200104 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:10.269315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678665bf-a120-4df2-9f80-abf9a5f02801 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:10.285068 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e1ed9-d3ba-42c2-a481-1a5d4e83d695 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:10.306650 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b172ac-7088-4e5c-b1ea-183ad0998278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:10.307704 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b172ac-7088-4e5c-b1ea-183ad0998278 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:10.308177 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b172ac-7088-4e5c-b1ea-183ad0998278 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:10.308681 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b172ac-7088-4e5c-b1ea-183ad0998278 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:10.309504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b172ac-7088-4e5c-b1ea-183ad0998278 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:10.310125 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b172ac-7088-4e5c-b1ea-183ad0998278 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:10.311806 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b172ac-7088-4e5c-b1ea-183ad0998278 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:10.321898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8dc430-a27e-4c0f-9be5-f65920c60f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:10.323094 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dc430-a27e-4c0f-9be5-f65920c60f3f None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:10.323415 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dc430-a27e-4c0f-9be5-f65920c60f3f None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:10.323622 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dc430-a27e-4c0f-9be5-f65920c60f3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:10.325654 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 292/593] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:10.326686 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b172ac-7088-4e5c-b1ea-183ad0998278 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:10.339994 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8dc430-a27e-4c0f-9be5-f65920c60f3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:10.341769 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8dc430-a27e-4c0f-9be5-f65920c60f3f None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:10.357740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-0c8dc430-a27e-4c0f-9be5-f65920c60f3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:10.357740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:10.357740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:10.357740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:10.357740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:10.357740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:10.357740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:10.357740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:10.357740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:10.357740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:10.357740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:10.357740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:10.357740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:10.357740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:10.357740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:10.357740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:10.358757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:10.358757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:10.358757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:10.358757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:10.358757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:10.358757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:10.358757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:10.358757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:10.358757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:10.358757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:10.358757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:10.358757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:10.358757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:10.358757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:10.358757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:10.358757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:10.358757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:10.359634 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:10.359634 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:10.359634 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:10.359634 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 302/594] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:10.360277 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8dc430-a27e-4c0f-9be5-f65920c60f3f None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:10.385514 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:10.441293 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b172ac-7088-4e5c-b1ea-183ad0998278 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:10.445555 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:10.478659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab95f4d-e6d9-4756-b010-620e3d116bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:10.480112 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab95f4d-e6d9-4756-b010-620e3d116bc6 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:10.480586 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab95f4d-e6d9-4756-b010-620e3d116bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:10.481478 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab95f4d-e6d9-4756-b010-620e3d116bc6 None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:10.482525 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab95f4d-e6d9-4756-b010-620e3d116bc6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:10.483056 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab95f4d-e6d9-4756-b010-620e3d116bc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:10.484699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab95f4d-e6d9-4756-b010-620e3d116bc6 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:10.484880 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8dc430-a27e-4c0f-9be5-f65920c60f3f None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:10.504211 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 293/595] 10.222.0.13 () {56 vars in 1139 bytes} [Thu Aug 11 09:41:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:10.505445 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab95f4d-e6d9-4756-b010-620e3d116bc6 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:10.531210 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd10c98-5d37-4c9f-95f1-4238d4e12cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:10.532235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd10c98-5d37-4c9f-95f1-4238d4e12cc2 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:10.532512 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd10c98-5d37-4c9f-95f1-4238d4e12cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:10.532783 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd10c98-5d37-4c9f-95f1-4238d4e12cc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:10.542367 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd10c98-5d37-4c9f-95f1-4238d4e12cc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:10.543856 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd10c98-5d37-4c9f-95f1-4238d4e12cc2 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:10.560061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-ebd10c98-5d37-4c9f-95f1-4238d4e12cc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:10.560061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:10.560061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:10.560061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:10.560061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:10.560061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:10.560061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:10.560061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:10.560061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:10.560061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:10.560061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:10.560061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:10.560061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:10.560061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:10.560061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:10.560963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:10.560963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:10.560963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:10.560963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:10.560963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:10.560963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:10.560963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:10.560963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:10.560963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:10.560963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:10.560963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:10.560963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:10.560963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:10.560963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:10.560963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:10.560963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:10.560963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:10.561881 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:10.561881 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:10.561881 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:10.561881 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:10.561881 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:10.561881 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:10.561881 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:10.561881 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:10.566027 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 303/596] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:10.567404 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd10c98-5d37-4c9f-95f1-4238d4e12cc2 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:10.632223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab95f4d-e6d9-4756-b010-620e3d116bc6 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:10.647742 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:10.678126 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac386d-af5c-4e74-8aae-c9481fe3f157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:10.678870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac386d-af5c-4e74-8aae-c9481fe3f157 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:10.679245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac386d-af5c-4e74-8aae-c9481fe3f157 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:10.679625 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac386d-af5c-4e74-8aae-c9481fe3f157 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:10.680608 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac386d-af5c-4e74-8aae-c9481fe3f157 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:10.680982 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac386d-af5c-4e74-8aae-c9481fe3f157 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:10.683256 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac386d-af5c-4e74-8aae-c9481fe3f157 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:10.689699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd10c98-5d37-4c9f-95f1-4238d4e12cc2 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:10.696261 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 294/597] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:10.701792 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac386d-af5c-4e74-8aae-c9481fe3f157 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:10.722623 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:10.728908 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95856c-52ce-48d9-949b-be5ce5ef5c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:10.729816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95856c-52ce-48d9-949b-be5ce5ef5c83 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:10.730328 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95856c-52ce-48d9-949b-be5ce5ef5c83 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:10.730483 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95856c-52ce-48d9-949b-be5ce5ef5c83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:10.741654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95856c-52ce-48d9-949b-be5ce5ef5c83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:10.743121 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95856c-52ce-48d9-949b-be5ce5ef5c83 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:10.758522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-0c95856c-52ce-48d9-949b-be5ce5ef5c83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:10.758522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:10.758522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:10.758522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:10.758522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:10.758522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:10.758522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:10.758522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:10.758522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:10.758522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:10.758522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:10.758522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:10.758522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:10.758522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:10.758522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:10.758522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:10.759461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:10.759461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:10.759461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:10.759461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:10.759461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:10.759461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:10.759461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:10.759461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:10.759461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:10.759461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:10.759461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:10.759461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:10.759461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:10.759461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:10.759461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:10.759461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:10.759461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:10.761040 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:10.761040 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:10.761040 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:10.761040 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 304/598] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:10.761802 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c12961-04a0-4671-be89-20de07f4d5c9 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:10.762025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c12961-04a0-4671-be89-20de07f4d5c9 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:10.762313 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c12961-04a0-4671-be89-20de07f4d5c9 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:10.763661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 305/599] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:10.764240 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c12961-04a0-4671-be89-20de07f4d5c9 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:10.816543 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac386d-af5c-4e74-8aae-c9481fe3f157 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:10.851560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b43eb-1c4f-4b06-ae07-16c9617ea4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:10.852172 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b43eb-1c4f-4b06-ae07-16c9617ea4e6 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:10.852446 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b43eb-1c4f-4b06-ae07-16c9617ea4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:10.852720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b43eb-1c4f-4b06-ae07-16c9617ea4e6 None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:10.853447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b43eb-1c4f-4b06-ae07-16c9617ea4e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:10.853753 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b43eb-1c4f-4b06-ae07-16c9617ea4e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:10.855218 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b43eb-1c4f-4b06-ae07-16c9617ea4e6 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:10.867140 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 295/600] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:10.867140 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b43eb-1c4f-4b06-ae07-16c9617ea4e6 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:10.879042 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c12961-04a0-4671-be89-20de07f4d5c9 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:10.897388 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:10.920303 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae81d3-8745-472d-a3a7-87c0b49e9f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:10.920939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae81d3-8745-472d-a3a7-87c0b49e9f21 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:10.921217 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae81d3-8745-472d-a3a7-87c0b49e9f21 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:10.921484 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae81d3-8745-472d-a3a7-87c0b49e9f21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:10.929903 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae81d3-8745-472d-a3a7-87c0b49e9f21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:10.932186 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae81d3-8745-472d-a3a7-87c0b49e9f21 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:10.943030 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-e1ae81d3-8745-472d-a3a7-87c0b49e9f21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:10.943030 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:10.943030 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:10.943030 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:10.943030 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:10.943030 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:10.943030 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:10.943030 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:10.943030 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:10.943030 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:10.943030 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:10.943030 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:10.943030 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:10.943030 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:10.943030 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:10.943902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:10.943902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:10.943902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:10.943902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:10.943902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:10.943902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:10.943902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:10.943902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:10.943902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:10.943902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:10.943902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:10.943902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:10.943902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:10.943902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:10.943902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:10.943902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:10.943902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:10.944781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:10.944781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:10.944781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:10.944781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:10.944781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:10.944781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:10.944781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:10.944781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:10.949128 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 306/601] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:10.950335 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80f081-229a-4abb-a6c0-e5bf785f86e0 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:10.950609 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80f081-229a-4abb-a6c0-e5bf785f86e0 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:10.950886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80f081-229a-4abb-a6c0-e5bf785f86e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:10.968389 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-3d80f081-229a-4abb-a6c0-e5bf785f86e0 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:10.969561 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-3d80f081-229a-4abb-a6c0-e5bf785f86e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:10.972701 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b43eb-1c4f-4b06-ae07-16c9617ea4e6 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:11.008559 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209086d-96bc-41cc-a25e-a5d60bd062ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:11.009158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209086d-96bc-41cc-a25e-a5d60bd062ba None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:11.009430 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209086d-96bc-41cc-a25e-a5d60bd062ba None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:11.009723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209086d-96bc-41cc-a25e-a5d60bd062ba None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:11.010381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209086d-96bc-41cc-a25e-a5d60bd062ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:11.010681 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209086d-96bc-41cc-a25e-a5d60bd062ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:11.011436 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:11.012251 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209086d-96bc-41cc-a25e-a5d60bd062ba None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:11.023380 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 296/602] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:11.024813 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209086d-96bc-41cc-a25e-a5d60bd062ba None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:11.039863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 307/603] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:41:11.040798 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80f081-229a-4abb-a6c0-e5bf785f86e0 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:11.117854 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:11.132258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209086d-96bc-41cc-a25e-a5d60bd062ba None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:11.158493 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80f081-229a-4abb-a6c0-e5bf785f86e0 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:11.172832 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a5a62-f719-4f52-9fa7-0c210da67644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:11.173822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a5a62-f719-4f52-9fa7-0c210da67644 None admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:11.173822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a5a62-f719-4f52-9fa7-0c210da67644 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:11.174235 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a5a62-f719-4f52-9fa7-0c210da67644 None admin] PATH_INFO: `/v3/projects/a0211f5c0b174c8c998e3ad29f96baab/users/a7791be968594cea9c32b51a7b3454b6/roles/b8d32893edf5475791d4c3b9aea5a3f6` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:11.189437 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a5a62-f719-4f52-9fa7-0c210da67644 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0211f5c0b174c8c998e3ad29f96baab, user_id=a7791be968594cea9c32b51a7b3454b6, role_id=b8d32893edf5475791d4c3b9aea5a3f6)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:11.190989 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a5a62-f719-4f52-9fa7-0c210da67644 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:11.196904 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67e163-d2da-4b6c-9efa-e432fb4b9169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:11.197609 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67e163-d2da-4b6c-9efa-e432fb4b9169 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:11.197954 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67e163-d2da-4b6c-9efa-e432fb4b9169 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:11.198313 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67e163-d2da-4b6c-9efa-e432fb4b9169 None admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:11.199067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67e163-d2da-4b6c-9efa-e432fb4b9169 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:11.199438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67e163-d2da-4b6c-9efa-e432fb4b9169 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:11.200916 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67e163-d2da-4b6c-9efa-e432fb4b9169 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:11.212430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 308/604] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:11.213288 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67e163-d2da-4b6c-9efa-e432fb4b9169 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:11.252951 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:11.262360 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 297/605] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Aug 11 09:41:11 2022] PUT /identity/v3/projects/a0211f5c0b174c8c998e3ad29f96baab/users/a7791be968594cea9c32b51a7b3454b6/roles/b8d32893edf5475791d4c3b9aea5a3f6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:41:11.262360 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a5a62-f719-4f52-9fa7-0c210da67644 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:11.344266 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67e163-d2da-4b6c-9efa-e432fb4b9169 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:11.387449 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55184a95-b6ec-4745-a1bc-b1b17f5050c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:11.388196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55184a95-b6ec-4745-a1bc-b1b17f5050c8 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:11.388544 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55184a95-b6ec-4745-a1bc-b1b17f5050c8 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:11.388883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55184a95-b6ec-4745-a1bc-b1b17f5050c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:11.393717 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a5a62-f719-4f52-9fa7-0c210da67644 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:11.396959 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55184a95-b6ec-4745-a1bc-b1b17f5050c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:11.398589 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55184a95-b6ec-4745-a1bc-b1b17f5050c8 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:11.412221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-55184a95-b6ec-4745-a1bc-b1b17f5050c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:11.412221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:11.412221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:11.412221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:11.412221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:11.412221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:11.412221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:11.412221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:11.412221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:11.412221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:11.412221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:11.412221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:11.412221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:11.412221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:11.412221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:11.413334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:11.413334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:11.413334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:11.413334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:11.413334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:11.413334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:11.413334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:11.413334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:11.413334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:11.413334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:11.413334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:11.413334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:11.413334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:11.413334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:11.413334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:11.413334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:11.413334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:11.414501 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:11.414501 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:11.414501 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:11.414501 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:11.414501 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:11.414501 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:11.414501 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:11.414501 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:11.420153 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 309/606] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:11.420153 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55184a95-b6ec-4745-a1bc-b1b17f5050c8 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:11.458374 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a4b62-687f-4902-a6e4-756d9e91935b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:11.459837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a4b62-687f-4902-a6e4-756d9e91935b None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:11.460769 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a4b62-687f-4902-a6e4-756d9e91935b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:11.461140 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a4b62-687f-4902-a6e4-756d9e91935b None admin] PATH_INFO: `/v3/roles/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:11.473008 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:11.479022 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a4b62-687f-4902-a6e4-756d9e91935b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:11.484692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-3a6a4b62-687f-4902-a6e4-756d9e91935b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:11.484692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:11.484692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:11.484692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:11.484692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:11.484692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:11.484692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:11.484692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:11.484692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:11.484692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:11.484692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:11.484692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:11.484692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:11.484692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:11.484692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:11.484692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:11.485843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:11.485843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:11.485843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:11.485843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:11.485843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:11.485843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:11.485843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:11.485843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:11.485843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:11.485843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:11.485843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:11.485843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:11.485843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:11.485843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:11.485843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:11.485843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:11.487036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:11.487036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:11.487036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:11.487036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:11.487036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:11.487036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:11.487036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:11.487036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:11.487036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:11.487036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:11.487036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:11.487036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:11.490468 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 298/607] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Aug 11 09:41:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:11.491769 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a4b62-687f-4902-a6e4-756d9e91935b None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:11.533599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:11.540125 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55184a95-b6ec-4745-a1bc-b1b17f5050c8 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:11.576785 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8aad51-dd17-4179-a90d-9fb81949b98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:11.577539 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aad51-dd17-4179-a90d-9fb81949b98c None admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:11.577886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aad51-dd17-4179-a90d-9fb81949b98c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:11.578259 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aad51-dd17-4179-a90d-9fb81949b98c None admin] PATH_INFO: `/v3/projects/a0211f5c0b174c8c998e3ad29f96baab/users/740fc24dc2134f5ca2fba8caa9abb3cf/roles/b8d32893edf5475791d4c3b9aea5a3f6` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:11.592754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8aad51-dd17-4179-a90d-9fb81949b98c None admin] RBAC: Authorizing `identity:create_grant(project_id=a0211f5c0b174c8c998e3ad29f96baab, user_id=740fc24dc2134f5ca2fba8caa9abb3cf, role_id=b8d32893edf5475791d4c3b9aea5a3f6)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:11.594311 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8aad51-dd17-4179-a90d-9fb81949b98c None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:11.610502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a4b62-687f-4902-a6e4-756d9e91935b None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:11.652032 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc5a9b-4c36-4922-b3ac-a7fcd2878f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:11.655850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc5a9b-4c36-4922-b3ac-a7fcd2878f14 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:11.656300 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc5a9b-4c36-4922-b3ac-a7fcd2878f14 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:11.656716 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc5a9b-4c36-4922-b3ac-a7fcd2878f14 None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:11.657769 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc5a9b-4c36-4922-b3ac-a7fcd2878f14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:11.658246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc5a9b-4c36-4922-b3ac-a7fcd2878f14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:11.659881 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc5a9b-4c36-4922-b3ac-a7fcd2878f14 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:11.672603 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 299/608] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:11.673563 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc5a9b-4c36-4922-b3ac-a7fcd2878f14 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:11.693159 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 310/609] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Aug 11 09:41:11 2022] PUT /identity/v3/projects/a0211f5c0b174c8c998e3ad29f96baab/users/740fc24dc2134f5ca2fba8caa9abb3cf/roles/b8d32893edf5475791d4c3b9aea5a3f6 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:41:11.694526 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c2875-ce78-47d5-8ccc-621fa5fd1852 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:11.694836 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c2875-ce78-47d5-8ccc-621fa5fd1852 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:11.695240 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c2875-ce78-47d5-8ccc-621fa5fd1852 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:11.700905 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 311/610] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:11.700905 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c2875-ce78-47d5-8ccc-621fa5fd1852 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:11.764705 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:11.825131 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc5a9b-4c36-4922-b3ac-a7fcd2878f14 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:11.838713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c2875-ce78-47d5-8ccc-621fa5fd1852 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:11.872567 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cf306-a59d-4677-b461-6536556b4dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:11.873636 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cf306-a59d-4677-b461-6536556b4dfd None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:11.874432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cf306-a59d-4677-b461-6536556b4dfd None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:11.874878 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cf306-a59d-4677-b461-6536556b4dfd None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:11.875962 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cf306-a59d-4677-b461-6536556b4dfd None admin] RBAC: Adding query filter params (name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:11.876603 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cf306-a59d-4677-b461-6536556b4dfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:11.878796 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cf306-a59d-4677-b461-6536556b4dfd None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:11.887230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b16af5-0a95-4c4a-b9a8-41cdc54db004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:11.887946 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b16af5-0a95-4c4a-b9a8-41cdc54db004 None admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:11.888225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b16af5-0a95-4c4a-b9a8-41cdc54db004 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:11.888496 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b16af5-0a95-4c4a-b9a8-41cdc54db004 None admin] PATH_INFO: `/v3/projects/a0211f5c0b174c8c998e3ad29f96baab/users/4ac6ca32b5144c59b2bb5086fbd53ea4/roles/b8d32893edf5475791d4c3b9aea5a3f6` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:11.890161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 300/611] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Aug 11 09:41:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:11.891581 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9e307-d3be-461e-af51-8ad9f65a38ff None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:11.892027 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9e307-d3be-461e-af51-8ad9f65a38ff None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:11.892298 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9e307-d3be-461e-af51-8ad9f65a38ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:11.905452 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b16af5-0a95-4c4a-b9a8-41cdc54db004 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0211f5c0b174c8c998e3ad29f96baab, user_id=4ac6ca32b5144c59b2bb5086fbd53ea4, role_id=b8d32893edf5475791d4c3b9aea5a3f6)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:11.907502 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b16af5-0a95-4c4a-b9a8-41cdc54db004 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:11.909860 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:11.909988 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-72f9e307-d3be-461e-af51-8ad9f65a38ff None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:11.911205 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-72f9e307-d3be-461e-af51-8ad9f65a38ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:11.981964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 301/612] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:41:11.982583 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9e307-d3be-461e-af51-8ad9f65a38ff None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:11.999132 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 312/613] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Aug 11 09:41:11 2022] PUT /identity/v3/projects/a0211f5c0b174c8c998e3ad29f96baab/users/4ac6ca32b5144c59b2bb5086fbd53ea4/roles/b8d32893edf5475791d4c3b9aea5a3f6 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:41:12.005893 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b16af5-0a95-4c4a-b9a8-41cdc54db004 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:12.061379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:12.153405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9e307-d3be-461e-af51-8ad9f65a38ff None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:12.192600 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199f373-f335-4b00-98a6-c1d4eb2f0431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:12.193243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199f373-f335-4b00-98a6-c1d4eb2f0431 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:12.193522 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199f373-f335-4b00-98a6-c1d4eb2f0431 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:12.193792 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199f373-f335-4b00-98a6-c1d4eb2f0431 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:12.199957 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b16af5-0a95-4c4a-b9a8-41cdc54db004 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:12.205726 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1199f373-f335-4b00-98a6-c1d4eb2f0431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:12.207235 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1199f373-f335-4b00-98a6-c1d4eb2f0431 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:12.223192 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-1199f373-f335-4b00-98a6-c1d4eb2f0431 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:12.223192 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:12.223192 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:12.223192 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:12.223192 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:12.223192 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:12.223192 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:12.223192 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:12.223192 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:12.223192 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:12.223192 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:12.223192 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:12.223192 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:12.223192 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:12.223192 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:12.223192 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:12.224359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:12.224359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:12.224359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:12.224359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:12.224359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:12.224359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:12.224359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:12.224359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:12.224359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:12.224359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:12.224359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:12.224359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:12.224359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:12.224359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:12.224359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:12.224359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:12.224359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:12.225425 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:12.225425 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:12.225425 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:12.225425 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 302/614] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:12.229830 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199f373-f335-4b00-98a6-c1d4eb2f0431 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:12.260708 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f852de-bbff-4615-8c18-bb874e44b20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:12.261818 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f852de-bbff-4615-8c18-bb874e44b20f None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:12.262239 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f852de-bbff-4615-8c18-bb874e44b20f None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:12.262615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f852de-bbff-4615-8c18-bb874e44b20f None admin] PATH_INFO: `/v3/roles/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:12.278697 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f852de-bbff-4615-8c18-bb874e44b20f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:12.285028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-d9f852de-bbff-4615-8c18-bb874e44b20f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:12.285028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:12.285028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:12.285028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:12.285028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:12.285028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:12.285028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:12.285028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:12.285028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:12.285028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:12.285028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:12.285028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:12.285028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:12.285028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:12.285028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:12.285028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:12.286167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:12.286167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:12.286167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:12.286167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:12.286167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:12.286167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:12.286167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:12.286167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:12.286167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:12.286167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:12.286167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:12.286167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:12.286167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:12.286167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:12.286167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:12.286167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:12.287144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:12.287144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:12.287144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:12.287144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:12.287144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:12.287144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:12.287144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:12.287144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:12.287144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:12.287144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:12.287144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:12.287144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:12.294136 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 313/615] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Aug 11 09:41:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:41:12.294136 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f852de-bbff-4615-8c18-bb874e44b20f None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:12.359062 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:12.363506 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199f373-f335-4b00-98a6-c1d4eb2f0431 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:12.365507 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:12.400382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93a7d6-811d-45b6-bdfc-3f5283742216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:12.401975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93a7d6-811d-45b6-bdfc-3f5283742216 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:12.402353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93a7d6-811d-45b6-bdfc-3f5283742216 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:12.402625 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93a7d6-811d-45b6-bdfc-3f5283742216 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:12.403274 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93a7d6-811d-45b6-bdfc-3f5283742216 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:12.403575 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93a7d6-811d-45b6-bdfc-3f5283742216 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:12.405013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93a7d6-811d-45b6-bdfc-3f5283742216 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:12.420044 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f852de-bbff-4615-8c18-bb874e44b20f None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:12.428374 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 303/616] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:41:12.434505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93a7d6-811d-45b6-bdfc-3f5283742216 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:12.459918 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c27a7-1473-4336-aa5d-6c51f791fa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:12.461221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c27a7-1473-4336-aa5d-6c51f791fa5b None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:12.461502 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c27a7-1473-4336-aa5d-6c51f791fa5b None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:12.461774 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c27a7-1473-4336-aa5d-6c51f791fa5b None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:12.462501 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c27a7-1473-4336-aa5d-6c51f791fa5b None admin] RBAC: Adding query filter params (name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:12.462836 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c27a7-1473-4336-aa5d-6c51f791fa5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:12.464456 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c27a7-1473-4336-aa5d-6c51f791fa5b None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:12.474536 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 314/617] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Aug 11 09:41:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:12.482899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c27a7-1473-4336-aa5d-6c51f791fa5b None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:12.631738 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93a7d6-811d-45b6-bdfc-3f5283742216 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:12.662102 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c27a7-1473-4336-aa5d-6c51f791fa5b None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:12.691977 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:12.707120 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50095357-7552-40f7-95fc-b0694430de7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:12.708958 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50095357-7552-40f7-95fc-b0694430de7e None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:12.708958 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50095357-7552-40f7-95fc-b0694430de7e None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:12.708958 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50095357-7552-40f7-95fc-b0694430de7e None admin] PATH_INFO: `/v3/users/nova` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:12.719750 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50095357-7552-40f7-95fc-b0694430de7e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:12.721208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50095357-7552-40f7-95fc-b0694430de7e None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:12.736002 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-50095357-7552-40f7-95fc-b0694430de7e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 09:41:12.736002 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:12.736002 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:12.736002 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:12.736002 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:12.736002 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:12.736002 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:12.736002 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:12.736002 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:12.736002 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:12.736002 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:12.736002 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:12.736002 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:12.736002 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:12.736002 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:12.736002 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:12.736964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:12.736964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:12.736964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:12.736964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:12.736964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:12.736964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:12.736964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:12.736964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:12.736964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:12.736964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:12.736964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:12.736964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:12.736964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:12.736964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:12.736964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:12.736964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:12.736964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:12.736964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:12.738253 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:12.738253 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:12.738253 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:12.738253 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:12.738253 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:12.738253 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:12.738253 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:12.738253 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:12.738253 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 09:41:12.738253 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:12.738253 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 304/618] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Aug 11 09:41:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:41:12.740161 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298e414-8f5b-4d85-9bd9-7f3f4b04008b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:12.740469 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298e414-8f5b-4d85-9bd9-7f3f4b04008b None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:12.740657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298e414-8f5b-4d85-9bd9-7f3f4b04008b None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:12.743228 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298e414-8f5b-4d85-9bd9-7f3f4b04008b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:12.746346 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50095357-7552-40f7-95fc-b0694430de7e None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:12.768377 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298e414-8f5b-4d85-9bd9-7f3f4b04008b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:12.771418 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298e414-8f5b-4d85-9bd9-7f3f4b04008b None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:12.790402 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:12.805633 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-c298e414-8f5b-4d85-9bd9-7f3f4b04008b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:12.805633 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:12.805633 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:12.805633 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:12.805633 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:12.805633 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:12.805633 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:12.805633 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:12.805633 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:12.805633 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:12.805633 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:12.805633 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:12.805633 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:12.805633 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:12.805633 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:12.805633 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:12.808612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:12.808612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:12.808612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:12.808612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:12.808612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:12.808612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:12.808612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:12.808612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:12.808612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:12.808612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:12.808612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:12.808612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:12.808612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:12.808612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:12.808612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:12.808612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:12.808612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:12.810721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:12.810721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:12.810721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:12.810721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 315/619] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:41:12.816997 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298e414-8f5b-4d85-9bd9-7f3f4b04008b None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:12.937885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298e414-8f5b-4d85-9bd9-7f3f4b04008b None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:12.976674 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff30ef-8672-4272-9f97-28af89407400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:12.977230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff30ef-8672-4272-9f97-28af89407400 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:12.977510 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff30ef-8672-4272-9f97-28af89407400 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:12.977778 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff30ef-8672-4272-9f97-28af89407400 None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:12.979013 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff30ef-8672-4272-9f97-28af89407400 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:12.979317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff30ef-8672-4272-9f97-28af89407400 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:12.980680 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff30ef-8672-4272-9f97-28af89407400 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:12.999127 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 316/620] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:13.011136 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff30ef-8672-4272-9f97-28af89407400 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:13.014381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50095357-7552-40f7-95fc-b0694430de7e None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:13.052447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7bd6e1-d285-4353-8d19-9bc56dbfcd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:13.053058 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7bd6e1-d285-4353-8d19-9bc56dbfcd7e None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:13.053333 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7bd6e1-d285-4353-8d19-9bc56dbfcd7e None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:13.053598 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7bd6e1-d285-4353-8d19-9bc56dbfcd7e None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:13.054344 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7bd6e1-d285-4353-8d19-9bc56dbfcd7e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:13.054644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7bd6e1-d285-4353-8d19-9bc56dbfcd7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:13.056918 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7bd6e1-d285-4353-8d19-9bc56dbfcd7e None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:13.063551 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:13.077115 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 305/621] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Aug 11 09:41:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:41:13.082876 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7bd6e1-d285-4353-8d19-9bc56dbfcd7e None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:13.184343 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:13.200125 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff30ef-8672-4272-9f97-28af89407400 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:13.204677 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7bd6e1-d285-4353-8d19-9bc56dbfcd7e None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:13.240371 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8e03c-d470-4221-87ca-65be77759c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:13.241242 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8e03c-d470-4221-87ca-65be77759c4c None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:13.241664 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8e03c-d470-4221-87ca-65be77759c4c None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:13.242073 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8e03c-d470-4221-87ca-65be77759c4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:13.258544 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be778b-d788-446b-aa82-edf402366b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:13.259185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be778b-d788-446b-aa82-edf402366b2b None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:13.259533 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be778b-d788-446b-aa82-edf402366b2b None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:13.260094 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be778b-d788-446b-aa82-edf402366b2b None admin] PATH_INFO: `/v3/users/swift` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:13.269126 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be778b-d788-446b-aa82-edf402366b2b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:13.277570 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be778b-d788-446b-aa82-edf402366b2b None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:13.304649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-41be778b-d788-446b-aa82-edf402366b2b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 11 09:41:13.304649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:13.304649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:13.304649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:13.304649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:13.304649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:13.304649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:13.304649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:13.304649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:13.304649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:13.304649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:13.304649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:13.304649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:13.304649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:13.304649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:13.304649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:13.310187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:13.310187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:13.310187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:13.310187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:13.310187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:13.310187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:13.310187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:13.310187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:13.310187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:13.310187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:13.310187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:13.310187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:13.310187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:13.310187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:13.310187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:13.310187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:13.310187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:13.310187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:13.311426 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:13.311426 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:13.311426 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:13.311426 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:13.311426 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:13.311426 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:13.311426 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:13.311426 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:13.311426 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 11 09:41:13.311426 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:13.311426 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 317/622] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:41:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:13.316309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be778b-d788-446b-aa82-edf402366b2b None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:13.324502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8e03c-d470-4221-87ca-65be77759c4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:13.326196 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8e03c-d470-4221-87ca-65be77759c4c None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:13.417633 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:13.439219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 306/623] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:41:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:41:13.444789 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8e03c-d470-4221-87ca-65be77759c4c None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:13.511912 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:13.528796 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be778b-d788-446b-aa82-edf402366b2b None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:13.570474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008d32f-7068-4e2e-8a4a-e8bc5a0f00a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:13.571576 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008d32f-7068-4e2e-8a4a-e8bc5a0f00a6 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:13.571868 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008d32f-7068-4e2e-8a4a-e8bc5a0f00a6 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:13.572167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008d32f-7068-4e2e-8a4a-e8bc5a0f00a6 None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:13.572891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008d32f-7068-4e2e-8a4a-e8bc5a0f00a6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:13.573191 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008d32f-7068-4e2e-8a4a-e8bc5a0f00a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:13.575233 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008d32f-7068-4e2e-8a4a-e8bc5a0f00a6 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:13.586436 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8e03c-d470-4221-87ca-65be77759c4c None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:13.597840 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 318/624] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Aug 11 09:41:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:41:13.603881 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d2359-6ff9-4d13-86c4-bf02a1f3efd0 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:13.604376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d2359-6ff9-4d13-86c4-bf02a1f3efd0 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:13.604906 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d2359-6ff9-4d13-86c4-bf02a1f3efd0 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:13.610176 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 319/625] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:13.611105 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d2359-6ff9-4d13-86c4-bf02a1f3efd0 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:13.630902 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557b3f6-27f2-4f2c-adc1-804a8642f4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:13.631529 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557b3f6-27f2-4f2c-adc1-804a8642f4af None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:13.631804 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557b3f6-27f2-4f2c-adc1-804a8642f4af None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:13.632071 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557b3f6-27f2-4f2c-adc1-804a8642f4af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:13.646462 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557b3f6-27f2-4f2c-adc1-804a8642f4af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:13.648367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557b3f6-27f2-4f2c-adc1-804a8642f4af None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:13.666638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-7557b3f6-27f2-4f2c-adc1-804a8642f4af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:13.666638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:13.666638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:13.666638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:13.666638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:13.666638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:13.666638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:13.666638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:13.666638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:13.666638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:13.666638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:13.666638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:13.666638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:13.666638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:13.666638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:13.666638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:13.667630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:13.667630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:13.667630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:13.667630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:13.667630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:13.667630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:13.667630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:13.667630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:13.667630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:13.667630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:13.667630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:13.667630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:13.667630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:13.667630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:13.667630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:13.667630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:13.667630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:13.668845 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:13.668845 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:13.668845 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:13.672082 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 307/626] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:13.677646 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbcf6c-e637-4abc-b6ad-73f90fff0695 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:13.678835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbcf6c-e637-4abc-b6ad-73f90fff0695 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:13.679322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbcf6c-e637-4abc-b6ad-73f90fff0695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:13.701385 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-f4bbcf6c-e637-4abc-b6ad-73f90fff0695 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:13.702927 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-f4bbcf6c-e637-4abc-b6ad-73f90fff0695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:13.731551 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:13.749115 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d2359-6ff9-4d13-86c4-bf02a1f3efd0 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:13.786215 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 308/627] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:41:13.787567 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbcf6c-e637-4abc-b6ad-73f90fff0695 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:13.789963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a0efb-702c-42a5-b39e-c15329d8b22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:13.790940 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a0efb-702c-42a5-b39e-c15329d8b22c None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:13.791216 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a0efb-702c-42a5-b39e-c15329d8b22c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:13.791485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a0efb-702c-42a5-b39e-c15329d8b22c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:13.803287 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a0efb-702c-42a5-b39e-c15329d8b22c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:13.805497 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a0efb-702c-42a5-b39e-c15329d8b22c None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:13.814861 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:13.824874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-fc5a0efb-702c-42a5-b39e-c15329d8b22c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:13.824874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:13.824874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:13.824874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:13.824874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:13.824874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:13.824874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:13.824874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:13.824874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:13.824874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:13.824874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:13.824874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:13.824874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:13.824874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:13.824874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:13.824874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:13.828698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:13.828698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:13.828698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:13.828698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:13.828698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:13.828698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:13.828698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:13.828698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:13.828698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:13.828698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:13.828698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:13.828698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:13.828698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:13.828698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:13.828698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:13.828698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:13.828698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:13.829631 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:13.829631 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:13.829631 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:13.829631 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 320/628] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:13.832708 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a0efb-702c-42a5-b39e-c15329d8b22c None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:13.931128 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbcf6c-e637-4abc-b6ad-73f90fff0695 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:13.949733 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a0efb-702c-42a5-b39e-c15329d8b22c None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:13.969971 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08bdcc-2e31-4c49-a210-ffccab250892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:13.971119 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08bdcc-2e31-4c49-a210-ffccab250892 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:13.971770 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08bdcc-2e31-4c49-a210-ffccab250892 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:13.972290 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08bdcc-2e31-4c49-a210-ffccab250892 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:13.973128 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08bdcc-2e31-4c49-a210-ffccab250892 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:13.973602 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08bdcc-2e31-4c49-a210-ffccab250892 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:13.975295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08bdcc-2e31-4c49-a210-ffccab250892 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:13.995069 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 309/629] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:13.996319 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08bdcc-2e31-4c49-a210-ffccab250892 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:13.998014 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bb360-b7af-49ae-a8dc-c5898561a3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:13.998668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bb360-b7af-49ae-a8dc-c5898561a3f0 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:13.998943 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bb360-b7af-49ae-a8dc-c5898561a3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:13.999210 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bb360-b7af-49ae-a8dc-c5898561a3f0 None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:13.999858 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bb360-b7af-49ae-a8dc-c5898561a3f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:14.000158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bb360-b7af-49ae-a8dc-c5898561a3f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:14.002572 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bb360-b7af-49ae-a8dc-c5898561a3f0 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:14.025480 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 321/630] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:14.027487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bb360-b7af-49ae-a8dc-c5898561a3f0 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:14.028128 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:14.093893 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:14.108858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08bdcc-2e31-4c49-a210-ffccab250892 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:14.139704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bb360-b7af-49ae-a8dc-c5898561a3f0 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:14.146662 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d710b2-343d-4d07-8d86-27d7c9a3c77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:14.147291 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d710b2-343d-4d07-8d86-27d7c9a3c77a None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:14.147561 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d710b2-343d-4d07-8d86-27d7c9a3c77a None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:14.147825 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d710b2-343d-4d07-8d86-27d7c9a3c77a None admin] PATH_INFO: `/v3/roles/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:14.158745 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d710b2-343d-4d07-8d86-27d7c9a3c77a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:14.164324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-80d710b2-343d-4d07-8d86-27d7c9a3c77a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:14.164324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:14.164324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:14.164324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:14.164324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:14.164324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:14.164324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:14.164324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:14.164324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:14.164324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:14.164324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:14.164324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:14.164324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:14.164324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:14.164324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:14.164324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:14.165272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:14.165272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:14.165272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:14.165272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:14.165272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:14.165272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:14.165272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:14.165272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:14.165272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:14.165272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:14.165272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:14.165272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:14.165272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:14.165272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:14.165272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:14.165272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:14.167124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:14.167124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:14.167124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:14.167124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:14.167124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:14.167124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:14.167124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:14.167124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:14.167124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:14.167124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:14.167124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:14.167124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:14.170972 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 310/631] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Aug 11 09:41:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:14.171864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d710b2-343d-4d07-8d86-27d7c9a3c77a None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:14.184435 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4119b8-1794-4efd-a944-8e275f785a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:14.185450 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4119b8-1794-4efd-a944-8e275f785a8c None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:14.186053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4119b8-1794-4efd-a944-8e275f785a8c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:14.186584 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4119b8-1794-4efd-a944-8e275f785a8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:14.194219 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4119b8-1794-4efd-a944-8e275f785a8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:14.195871 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4119b8-1794-4efd-a944-8e275f785a8c None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:14.206888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-2c4119b8-1794-4efd-a944-8e275f785a8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:14.206888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:14.206888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:14.206888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:14.206888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:14.206888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:14.206888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:14.206888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:14.206888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:14.206888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:14.206888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:14.206888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:14.206888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:14.206888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:14.206888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:14.207813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:14.207813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:14.207813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:14.207813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:14.207813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:14.207813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:14.207813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:14.207813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:14.207813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:14.207813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:14.207813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:14.207813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:14.207813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:14.207813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:14.207813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:14.207813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:14.207813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:14.208690 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:14.208690 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:14.208690 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:14.208690 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:14.208690 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:14.208690 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:14.208690 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:14.208690 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:14.208690 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 322/632] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:14.209201 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4119b8-1794-4efd-a944-8e275f785a8c None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:14.266744 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:14.285758 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d710b2-343d-4d07-8d86-27d7c9a3c77a None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:14.323868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485a623-6b3a-437d-9a73-b5fc022c83b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:14.324144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4119b8-1794-4efd-a944-8e275f785a8c None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:14.324489 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485a623-6b3a-437d-9a73-b5fc022c83b2 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:14.324766 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485a623-6b3a-437d-9a73-b5fc022c83b2 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:14.325031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485a623-6b3a-437d-9a73-b5fc022c83b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:14.331710 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485a623-6b3a-437d-9a73-b5fc022c83b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:14.333142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485a623-6b3a-437d-9a73-b5fc022c83b2 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:14.341288 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:14.344560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-b485a623-6b3a-437d-9a73-b5fc022c83b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:14.344560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:14.344560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:14.344560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:14.344560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:14.344560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:14.344560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:14.344560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:14.344560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:14.344560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:14.344560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:14.344560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:14.344560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:14.344560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:14.344560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:14.345615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:14.345615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:14.345615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:14.345615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:14.345615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:14.345615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:14.345615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:14.345615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:14.345615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:14.345615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:14.345615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:14.345615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:14.345615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:14.345615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:14.345615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:14.345615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:14.345615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:14.346650 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:14.346650 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:14.346650 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:14.346650 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:14.346650 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:14.346650 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:14.346650 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:14.346650 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:14.346650 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 311/633] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:14.347158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6dfb0-cb28-4494-ac92-1a387920d46b None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:14.347158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6dfb0-cb28-4494-ac92-1a387920d46b None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:14.347282 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6dfb0-cb28-4494-ac92-1a387920d46b None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:14.352394 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 312/634] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:14.353156 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6dfb0-cb28-4494-ac92-1a387920d46b None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:14.359239 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc212d-a977-4172-ab3d-4b419f244092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:14.359837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc212d-a977-4172-ab3d-4b419f244092 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:14.360207 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc212d-a977-4172-ab3d-4b419f244092 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:14.360475 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc212d-a977-4172-ab3d-4b419f244092 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:14.361123 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc212d-a977-4172-ab3d-4b419f244092 None admin] RBAC: Adding query filter params (name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:14.361418 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc212d-a977-4172-ab3d-4b419f244092 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:14.362880 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc212d-a977-4172-ab3d-4b419f244092 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:14.371532 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 323/635] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Aug 11 09:41:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:14.372804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59869b-241b-4a80-9e93-5ded40affdcd None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:14.373339 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59869b-241b-4a80-9e93-5ded40affdcd None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:14.373604 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59869b-241b-4a80-9e93-5ded40affdcd None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:14.378134 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 324/636] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:14.378134 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59869b-241b-4a80-9e93-5ded40affdcd None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:14.456559 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6dfb0-cb28-4494-ac92-1a387920d46b None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:14.473966 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59869b-241b-4a80-9e93-5ded40affdcd None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:14.490003 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256b0aa-44e6-4622-8055-f06071702960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:14.490626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256b0aa-44e6-4622-8055-f06071702960 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:14.490902 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256b0aa-44e6-4622-8055-f06071702960 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:14.491169 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256b0aa-44e6-4622-8055-f06071702960 None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:14.491842 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256b0aa-44e6-4622-8055-f06071702960 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:14.492140 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256b0aa-44e6-4622-8055-f06071702960 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:14.493585 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256b0aa-44e6-4622-8055-f06071702960 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:14.504957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 313/637] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:14.506065 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f138e-d622-43e3-9f15-f806732b1c54 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:14.506378 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f138e-d622-43e3-9f15-f806732b1c54 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:14.506644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f138e-d622-43e3-9f15-f806732b1c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:14.511734 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779a56c-1323-4411-81c5-aba44fccbe06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:14.512331 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779a56c-1323-4411-81c5-aba44fccbe06 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:14.512605 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779a56c-1323-4411-81c5-aba44fccbe06 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:14.512869 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779a56c-1323-4411-81c5-aba44fccbe06 None admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:14.513404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:14.513527 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779a56c-1323-4411-81c5-aba44fccbe06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:14.513825 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779a56c-1323-4411-81c5-aba44fccbe06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:14.515490 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779a56c-1323-4411-81c5-aba44fccbe06 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:14.524824 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-8f4f138e-d622-43e3-9f15-f806732b1c54 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:14.526582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-8f4f138e-d622-43e3-9f15-f806732b1c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:14.527154 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 325/638] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:14.527857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779a56c-1323-4411-81c5-aba44fccbe06 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:14.573228 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:14.593622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 314/639] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:41:14.595043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfea8f-0f4e-4b88-8381-60eaaacc3ba4 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:14.595275 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfea8f-0f4e-4b88-8381-60eaaacc3ba4 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:14.595543 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfea8f-0f4e-4b88-8381-60eaaacc3ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:14.614188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-65bfea8f-0f4e-4b88-8381-60eaaacc3ba4 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:14.615436 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-65bfea8f-0f4e-4b88-8381-60eaaacc3ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:14.632806 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779a56c-1323-4411-81c5-aba44fccbe06 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:14.667645 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052e09f-f26e-45f3-a2f0-a4b74ac1377d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:14.668277 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052e09f-f26e-45f3-a2f0-a4b74ac1377d None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:14.668554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052e09f-f26e-45f3-a2f0-a4b74ac1377d None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:14.668826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052e09f-f26e-45f3-a2f0-a4b74ac1377d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:14.679346 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052e09f-f26e-45f3-a2f0-a4b74ac1377d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:14.681024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052e09f-f26e-45f3-a2f0-a4b74ac1377d None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:14.682761 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 315/640] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:41:14.683590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfea8f-0f4e-4b88-8381-60eaaacc3ba4 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:14.695476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-e052e09f-f26e-45f3-a2f0-a4b74ac1377d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:14.695476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:14.695476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:14.695476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:14.695476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:14.695476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:14.695476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:14.695476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:14.695476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:14.695476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:14.695476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:14.695476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:14.695476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:14.695476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:14.695476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:14.695476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:14.696416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:14.696416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:14.696416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:14.696416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:14.696416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:14.696416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:14.696416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:14.696416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:14.696416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:14.696416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:14.696416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:14.696416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:14.696416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:14.696416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:14.696416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:14.696416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:14.696416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:14.697898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:14.697898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:14.697898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:14.697898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 326/641] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:14.697898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052e09f-f26e-45f3-a2f0-a4b74ac1377d None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:14.748269 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:14.787634 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:14.788010 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfea8f-0f4e-4b88-8381-60eaaacc3ba4 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:14.796249 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052e09f-f26e-45f3-a2f0-a4b74ac1377d None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:14.821359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491d332-d959-4202-8d02-a126fe755036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:14.822498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491d332-d959-4202-8d02-a126fe755036 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:14.822770 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491d332-d959-4202-8d02-a126fe755036 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:14.823029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491d332-d959-4202-8d02-a126fe755036 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:14.823730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491d332-d959-4202-8d02-a126fe755036 None admin] RBAC: Adding query filter params (role.id=b8d32893edf5475791d4c3b9aea5a3f6, scope.project.id=a0211f5c0b174c8c998e3ad29f96baab, user.id=4c1dc8e0d9454ad98894ed1e8d31f931) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:14.824026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491d332-d959-4202-8d02-a126fe755036 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:14.825431 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491d332-d959-4202-8d02-a126fe755036 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:14.828910 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787cb2c-0d10-445d-a692-52dbf7f4289c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:14.829546 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787cb2c-0d10-445d-a692-52dbf7f4289c None admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:14.829818 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787cb2c-0d10-445d-a692-52dbf7f4289c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:14.830103 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787cb2c-0d10-445d-a692-52dbf7f4289c None admin] PATH_INFO: `/v3/projects/a0211f5c0b174c8c998e3ad29f96baab/users/f7e3b1c5aec94673b391210ae51d4cc2/roles/b8d32893edf5475791d4c3b9aea5a3f6` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:14.830938 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 316/642] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:41:14 2022] GET /identity/v3/role_assignments?user.id=4c1dc8e0d9454ad98894ed1e8d31f931&scope.project.id=a0211f5c0b174c8c998e3ad29f96baab&role.id=b8d32893edf5475791d4c3b9aea5a3f6 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:14.831684 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491d332-d959-4202-8d02-a126fe755036 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:14.853799 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787cb2c-0d10-445d-a692-52dbf7f4289c None admin] RBAC: Authorizing `identity:create_grant(project_id=a0211f5c0b174c8c998e3ad29f96baab, user_id=f7e3b1c5aec94673b391210ae51d4cc2, role_id=b8d32893edf5475791d4c3b9aea5a3f6)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:14.855392 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787cb2c-0d10-445d-a692-52dbf7f4289c None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:14.927724 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 327/643] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Aug 11 09:41:14 2022] PUT /identity/v3/projects/a0211f5c0b174c8c998e3ad29f96baab/users/f7e3b1c5aec94673b391210ae51d4cc2/roles/b8d32893edf5475791d4c3b9aea5a3f6 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:41:14.928571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787cb2c-0d10-445d-a692-52dbf7f4289c None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:14.958768 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491d332-d959-4202-8d02-a126fe755036 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:14.996396 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:15.006057 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92d6fe-9947-4a93-afe4-5fdb9bc1eaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:15.006734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92d6fe-9947-4a93-afe4-5fdb9bc1eaf1 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:15.007012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92d6fe-9947-4a93-afe4-5fdb9bc1eaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:15.007287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92d6fe-9947-4a93-afe4-5fdb9bc1eaf1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:15.022560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92d6fe-9947-4a93-afe4-5fdb9bc1eaf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:15.029208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-bd92d6fe-9947-4a93-afe4-5fdb9bc1eaf1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:15.029208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:15.029208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:15.029208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:15.029208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:15.029208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:15.029208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:15.029208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:15.029208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:15.029208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:15.029208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:15.029208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:15.029208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:15.029208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:15.029208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:15.029208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:15.030944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:15.030944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:15.030944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:15.030944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:15.030944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:15.030944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:15.030944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:15.030944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:15.030944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:15.030944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:15.030944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:15.030944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:15.030944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:15.030944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:15.030944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:15.030944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:15.031991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:15.031991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:15.031991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:15.031991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:15.031991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:15.031991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:15.031991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:15.031991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:15.031991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:15.031991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:15.031991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:15.031991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:15.033460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 317/644] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Aug 11 09:41:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:15.034601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92d6fe-9947-4a93-afe4-5fdb9bc1eaf1 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:15.065612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787cb2c-0d10-445d-a692-52dbf7f4289c None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:15.115483 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75f6c8-db35-4a25-b7b3-c349fcac281f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:15.116381 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75f6c8-db35-4a25-b7b3-c349fcac281f None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:15.116661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75f6c8-db35-4a25-b7b3-c349fcac281f None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:15.116924 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75f6c8-db35-4a25-b7b3-c349fcac281f None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:15.117559 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75f6c8-db35-4a25-b7b3-c349fcac281f None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:15.118551 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75f6c8-db35-4a25-b7b3-c349fcac281f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:15.119778 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75f6c8-db35-4a25-b7b3-c349fcac281f None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:15.140749 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 328/645] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:15.142454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75f6c8-db35-4a25-b7b3-c349fcac281f None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:15.146056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:15.163347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92d6fe-9947-4a93-afe4-5fdb9bc1eaf1 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:15.205286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33febf-f8bc-4e1a-bb51-06f89e79dcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:15.206293 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33febf-f8bc-4e1a-bb51-06f89e79dcfc None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:15.206799 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33febf-f8bc-4e1a-bb51-06f89e79dcfc None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:15.207279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33febf-f8bc-4e1a-bb51-06f89e79dcfc None admin] PATH_INFO: `/v3/roles/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:15.218670 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33febf-f8bc-4e1a-bb51-06f89e79dcfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:15.224095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-df33febf-f8bc-4e1a-bb51-06f89e79dcfc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:15.224095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:15.224095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:15.224095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:15.224095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:15.224095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:15.224095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:15.224095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:15.224095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:15.224095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:15.224095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:15.224095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:15.224095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:15.224095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:15.224095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:15.224095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:15.225029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:15.225029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:15.225029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:15.225029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:15.225029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:15.225029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:15.225029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:15.225029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:15.225029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:15.225029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:15.225029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:15.225029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:15.225029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:15.225029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:15.225029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:15.225029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:15.226011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:15.226011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:15.226011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:15.226011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:15.226011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:15.226011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:15.226011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:15.226011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:15.226011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:15.226011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:15.226011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:15.226011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:15.228767 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 318/646] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Aug 11 09:41:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:15.229752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33febf-f8bc-4e1a-bb51-06f89e79dcfc None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:15.280034 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75f6c8-db35-4a25-b7b3-c349fcac281f None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:15.281190 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:15.326151 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0171bd-6b8a-4fe4-b489-e46c626adefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:15.326773 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0171bd-6b8a-4fe4-b489-e46c626adefb None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:15.327292 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0171bd-6b8a-4fe4-b489-e46c626adefb None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:15.327571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0171bd-6b8a-4fe4-b489-e46c626adefb None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:15.328232 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0171bd-6b8a-4fe4-b489-e46c626adefb None admin] RBAC: Adding query filter params (name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:15.328528 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0171bd-6b8a-4fe4-b489-e46c626adefb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:15.330208 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0171bd-6b8a-4fe4-b489-e46c626adefb None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:15.342129 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 329/647] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Aug 11 09:41:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:15.343283 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0171bd-6b8a-4fe4-b489-e46c626adefb None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:15.347481 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33febf-f8bc-4e1a-bb51-06f89e79dcfc None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:15.388494 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69638991-23e8-478a-8cf4-0d870289cdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:15.389452 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69638991-23e8-478a-8cf4-0d870289cdba None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:15.389928 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69638991-23e8-478a-8cf4-0d870289cdba None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:15.390434 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69638991-23e8-478a-8cf4-0d870289cdba None admin] PATH_INFO: `/v3/users/glance` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:15.399727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69638991-23e8-478a-8cf4-0d870289cdba None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:15.401491 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69638991-23e8-478a-8cf4-0d870289cdba None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:15.413240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-69638991-23e8-478a-8cf4-0d870289cdba None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 11 09:41:15.413240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:15.413240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:15.413240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:15.413240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:15.413240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:15.413240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:15.413240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:15.413240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:15.413240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:15.413240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:15.413240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:15.413240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:15.413240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:15.413240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:15.413240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:15.414245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:15.414245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:15.414245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:15.414245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:15.414245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:15.414245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:15.414245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:15.414245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:15.414245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:15.414245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:15.414245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:15.414245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:15.414245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:15.414245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:15.414245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:15.414245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:15.414245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:15.414245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:15.415209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:15.415209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:15.415209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:15.415209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:15.415209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:15.415209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:15.415209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:15.415209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:15.415209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 11 09:41:15.415209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:15.417970 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:15.418122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 319/648] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:41:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:15.419105 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69638991-23e8-478a-8cf4-0d870289cdba None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:15.470702 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0171bd-6b8a-4fe4-b489-e46c626adefb None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:15.508128 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00de78b-0f5a-4b54-bf2b-cbd1024a2d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:15.508735 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00de78b-0f5a-4b54-bf2b-cbd1024a2d51 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:15.509011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00de78b-0f5a-4b54-bf2b-cbd1024a2d51 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:15.509365 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00de78b-0f5a-4b54-bf2b-cbd1024a2d51 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:15.510023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00de78b-0f5a-4b54-bf2b-cbd1024a2d51 None admin] RBAC: Adding query filter params (name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:15.510384 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00de78b-0f5a-4b54-bf2b-cbd1024a2d51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:15.512193 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00de78b-0f5a-4b54-bf2b-cbd1024a2d51 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:15.522806 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 330/649] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Aug 11 09:41:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:15.523874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00de78b-0f5a-4b54-bf2b-cbd1024a2d51 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:15.540469 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69638991-23e8-478a-8cf4-0d870289cdba None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:15.550200 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:15.584007 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbd1a6-9159-495f-acb9-af1561ad0daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:15.584631 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbd1a6-9159-495f-acb9-af1561ad0daf None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:15.584905 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbd1a6-9159-495f-acb9-af1561ad0daf None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:15.585170 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbd1a6-9159-495f-acb9-af1561ad0daf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:15.600719 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbd1a6-9159-495f-acb9-af1561ad0daf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:15.602880 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbd1a6-9159-495f-acb9-af1561ad0daf None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:15.621635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-34bbd1a6-9159-495f-acb9-af1561ad0daf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:15.621635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:15.621635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:15.621635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:15.621635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:15.621635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:15.621635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:15.621635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:15.621635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:15.621635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:15.621635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:15.621635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:15.621635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:15.621635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:15.621635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:15.621635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:15.622635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:15.622635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:15.622635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:15.622635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:15.622635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:15.622635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:15.622635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:15.622635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:15.622635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:15.622635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:15.622635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:15.622635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:15.622635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:15.622635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:15.622635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:15.622635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:15.622635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:15.623531 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:15.623531 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:15.623531 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:15.625825 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 320/650] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:15.626800 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbd1a6-9159-495f-acb9-af1561ad0daf None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:15.658915 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00de78b-0f5a-4b54-bf2b-cbd1024a2d51 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:15.686995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:15.696211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3a18f-f63f-476a-95da-a18cd886538b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:15.697056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3a18f-f63f-476a-95da-a18cd886538b None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:15.697485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3a18f-f63f-476a-95da-a18cd886538b None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:15.697937 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3a18f-f63f-476a-95da-a18cd886538b None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:15.698833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3a18f-f63f-476a-95da-a18cd886538b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:15.699283 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3a18f-f63f-476a-95da-a18cd886538b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:15.700897 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3a18f-f63f-476a-95da-a18cd886538b None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:15.719435 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 331/651] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Aug 11 09:41:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:15.720572 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3a18f-f63f-476a-95da-a18cd886538b None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:15.748343 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbd1a6-9159-495f-acb9-af1561ad0daf None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:15.785435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623daaad-4c3a-45ae-b35d-250a038939f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:15.786168 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623daaad-4c3a-45ae-b35d-250a038939f9 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:15.786563 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623daaad-4c3a-45ae-b35d-250a038939f9 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:15.786851 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623daaad-4c3a-45ae-b35d-250a038939f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:15.798937 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623daaad-4c3a-45ae-b35d-250a038939f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:15.800562 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623daaad-4c3a-45ae-b35d-250a038939f9 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:15.816453 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-623daaad-4c3a-45ae-b35d-250a038939f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:15.816453 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:15.816453 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:15.816453 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:15.816453 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:15.816453 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:15.816453 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:15.816453 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:15.816453 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:15.816453 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:15.816453 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:15.816453 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:15.816453 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:15.816453 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:15.816453 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:15.816453 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:15.817427 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:15.817427 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:15.817427 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:15.817427 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:15.817427 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:15.817427 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:15.817427 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:15.817427 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:15.817427 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:15.817427 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:15.817427 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:15.817427 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:15.817427 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:15.817427 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:15.817427 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:15.817427 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:15.817427 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:15.818494 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:15.818494 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:15.818494 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:15.818494 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 321/652] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:15.819256 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623daaad-4c3a-45ae-b35d-250a038939f9 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:15.828631 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3a18f-f63f-476a-95da-a18cd886538b None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:15.832507 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:15.864469 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d221a-7124-46cd-ac21-82e26f098e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:15.865497 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d221a-7124-46cd-ac21-82e26f098e34 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:15.865992 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d221a-7124-46cd-ac21-82e26f098e34 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:15.866542 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d221a-7124-46cd-ac21-82e26f098e34 None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:15.867385 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d221a-7124-46cd-ac21-82e26f098e34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:15.867914 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d221a-7124-46cd-ac21-82e26f098e34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:15.869554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d221a-7124-46cd-ac21-82e26f098e34 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:15.881384 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 332/653] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:15.882428 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d221a-7124-46cd-ac21-82e26f098e34 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:15.928488 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:15.933123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623daaad-4c3a-45ae-b35d-250a038939f9 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:15.969334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde31000-5906-4142-8aa8-3e2a3eed70cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:15.970033 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde31000-5906-4142-8aa8-3e2a3eed70cb None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:15.970343 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde31000-5906-4142-8aa8-3e2a3eed70cb None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:15.970614 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde31000-5906-4142-8aa8-3e2a3eed70cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:15.986006 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d221a-7124-46cd-ac21-82e26f098e34 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:16.020423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb11505-2fb3-44d1-8851-b8bb60247676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:16.021374 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb11505-2fb3-44d1-8851-b8bb60247676 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:16.021876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb11505-2fb3-44d1-8851-b8bb60247676 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:16.022385 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb11505-2fb3-44d1-8851-b8bb60247676 None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:16.023245 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb11505-2fb3-44d1-8851-b8bb60247676 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:16.023749 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb11505-2fb3-44d1-8851-b8bb60247676 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:16.025859 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb11505-2fb3-44d1-8851-b8bb60247676 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:16.038311 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 333/654] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:16.039366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb11505-2fb3-44d1-8851-b8bb60247676 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:16.044665 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde31000-5906-4142-8aa8-3e2a3eed70cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:16.046199 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde31000-5906-4142-8aa8-3e2a3eed70cb None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:16.058769 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:16.151070 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb11505-2fb3-44d1-8851-b8bb60247676 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:16.153479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:16.155626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 322/655] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:41:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:41:16.156473 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde31000-5906-4142-8aa8-3e2a3eed70cb None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:16.189234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c373a-82ee-40aa-ad5a-64e70ae3719c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:16.190299 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c373a-82ee-40aa-ad5a-64e70ae3719c None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:16.190802 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c373a-82ee-40aa-ad5a-64e70ae3719c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:16.191252 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c373a-82ee-40aa-ad5a-64e70ae3719c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:16.200736 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c373a-82ee-40aa-ad5a-64e70ae3719c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:16.202626 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c373a-82ee-40aa-ad5a-64e70ae3719c None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:16.215519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-927c373a-82ee-40aa-ad5a-64e70ae3719c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 09:41:16.215519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:16.215519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:16.215519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:16.215519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:16.215519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:16.215519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:16.215519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:16.215519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:16.215519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:16.215519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:16.215519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:16.215519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:16.215519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:16.215519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:16.215519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:16.216696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:16.216696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:16.216696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:16.216696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:16.216696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:16.216696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:16.216696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:16.216696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:16.216696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:16.216696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:16.216696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:16.216696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:16.216696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:16.216696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:16.216696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:16.216696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:16.216696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:16.216696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:16.217870 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:16.217870 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:16.217870 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:16.217870 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:16.217870 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:16.217870 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:16.217870 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:16.217870 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:16.217870 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 09:41:16.217870 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:16.219953 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 334/656] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:41:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:16.220855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c373a-82ee-40aa-ad5a-64e70ae3719c None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:16.268932 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde31000-5906-4142-8aa8-3e2a3eed70cb None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:16.280547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:16.304756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a793852-de7a-4291-a849-8f8cb356cbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:16.305635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a793852-de7a-4291-a849-8f8cb356cbbb None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:16.305909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a793852-de7a-4291-a849-8f8cb356cbbb None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:16.306242 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a793852-de7a-4291-a849-8f8cb356cbbb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:16.313375 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a793852-de7a-4291-a849-8f8cb356cbbb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:16.315838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a793852-de7a-4291-a849-8f8cb356cbbb None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:16.324471 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c373a-82ee-40aa-ad5a-64e70ae3719c None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:16.327916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-2a793852-de7a-4291-a849-8f8cb356cbbb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 11 09:41:16.327916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:16.327916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:16.327916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:16.327916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:16.327916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:16.327916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:16.327916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:16.327916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:16.327916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:16.327916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:16.327916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:16.327916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:16.327916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:16.327916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:16.327916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:16.328916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:16.328916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:16.328916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:16.328916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:16.328916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:16.328916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:16.328916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:16.328916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:16.328916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:16.328916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:16.328916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:16.328916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:16.328916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:16.328916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:16.328916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:16.328916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:16.328916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:16.328916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:16.329868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:16.329868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:16.329868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:16.329868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:16.329868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:16.329868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:16.329868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:16.329868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:16.329868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 11 09:41:16.329868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:16.333825 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 323/657] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Aug 11 09:41:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:16.334737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a793852-de7a-4291-a849-8f8cb356cbbb None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:16.363348 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14340a8e-7116-4f47-b047-1f7be585ad6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:16.364275 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14340a8e-7116-4f47-b047-1f7be585ad6b None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:16.364777 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14340a8e-7116-4f47-b047-1f7be585ad6b None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:16.365248 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14340a8e-7116-4f47-b047-1f7be585ad6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:16.376065 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14340a8e-7116-4f47-b047-1f7be585ad6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:16.377720 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14340a8e-7116-4f47-b047-1f7be585ad6b None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:16.393430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-14340a8e-7116-4f47-b047-1f7be585ad6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:16.393430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:16.393430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:16.393430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:16.393430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:16.393430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:16.393430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:16.393430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:16.393430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:16.393430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:16.393430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:16.393430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:16.393430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:16.393430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:16.393430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:16.393430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:16.394398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:16.394398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:16.394398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:16.394398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:16.394398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:16.394398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:16.394398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:16.394398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:16.394398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:16.394398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:16.394398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:16.394398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:16.394398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:16.394398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:16.394398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:16.394398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:16.394398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:16.395281 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:16.395281 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:16.395281 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:16.397248 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 335/658] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:16.398248 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14340a8e-7116-4f47-b047-1f7be585ad6b None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:16.426412 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:16.438701 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a793852-de7a-4291-a849-8f8cb356cbbb None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:16.476395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba340631-2027-451e-b89f-3d17a16d929e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:16.476915 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba340631-2027-451e-b89f-3d17a16d929e None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:16.477228 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba340631-2027-451e-b89f-3d17a16d929e None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:16.477504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba340631-2027-451e-b89f-3d17a16d929e None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:16.478279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba340631-2027-451e-b89f-3d17a16d929e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:16.478581 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba340631-2027-451e-b89f-3d17a16d929e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:16.480468 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba340631-2027-451e-b89f-3d17a16d929e None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:16.504778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 324/659] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Aug 11 09:41:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:16.505567 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba340631-2027-451e-b89f-3d17a16d929e None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:16.518670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14340a8e-7116-4f47-b047-1f7be585ad6b None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:16.537144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:16.566482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88e13e-809d-45d0-83ce-78971cd44573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:16.567645 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88e13e-809d-45d0-83ce-78971cd44573 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:16.568420 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88e13e-809d-45d0-83ce-78971cd44573 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:16.569156 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88e13e-809d-45d0-83ce-78971cd44573 None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:16.570255 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88e13e-809d-45d0-83ce-78971cd44573 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:16.571075 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88e13e-809d-45d0-83ce-78971cd44573 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:16.574672 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88e13e-809d-45d0-83ce-78971cd44573 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:16.598246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 336/660] 10.222.0.13 () {56 vars in 1139 bytes} [Thu Aug 11 09:41:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:16.599404 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88e13e-809d-45d0-83ce-78971cd44573 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:16.621183 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba340631-2027-451e-b89f-3d17a16d929e None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:16.671421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741617c9-08ca-4560-be27-3c969babd0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:16.672898 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741617c9-08ca-4560-be27-3c969babd0b6 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:16.673326 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741617c9-08ca-4560-be27-3c969babd0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:16.673741 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741617c9-08ca-4560-be27-3c969babd0b6 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:16.674822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741617c9-08ca-4560-be27-3c969babd0b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:16.675711 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741617c9-08ca-4560-be27-3c969babd0b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:16.677769 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741617c9-08ca-4560-be27-3c969babd0b6 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:16.693586 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:16.695353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 325/661] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:16.696397 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741617c9-08ca-4560-be27-3c969babd0b6 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:16.723118 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88e13e-809d-45d0-83ce-78971cd44573 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:16.760305 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4ce8d-546a-488c-b323-3cd716beb76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:16.760981 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4ce8d-546a-488c-b323-3cd716beb76a None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:16.761364 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4ce8d-546a-488c-b323-3cd716beb76a None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:16.761710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4ce8d-546a-488c-b323-3cd716beb76a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:16.813918 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:16.826967 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741617c9-08ca-4560-be27-3c969babd0b6 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:16.849412 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4ce8d-546a-488c-b323-3cd716beb76a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:16.851850 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4ce8d-546a-488c-b323-3cd716beb76a None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:16.863105 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84102278-7572-46e6-9333-729df64aee47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:16.863833 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84102278-7572-46e6-9333-729df64aee47 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:16.864206 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84102278-7572-46e6-9333-729df64aee47 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:16.864572 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84102278-7572-46e6-9333-729df64aee47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:16.938856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84102278-7572-46e6-9333-729df64aee47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:16.940550 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84102278-7572-46e6-9333-729df64aee47 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:16.950033 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:16.988726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 337/662] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:41:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:41:16.989827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4ce8d-546a-488c-b323-3cd716beb76a None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:17.036776 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:17.055050 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 326/663] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:41:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:41:17.055050 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84102278-7572-46e6-9333-729df64aee47 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:17.107877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4ce8d-546a-488c-b323-3cd716beb76a None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:17.140388 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81603969-440f-452a-bc3c-8b2733be37d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:17.141013 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81603969-440f-452a-bc3c-8b2733be37d8 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:17.141280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81603969-440f-452a-bc3c-8b2733be37d8 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:17.141540 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81603969-440f-452a-bc3c-8b2733be37d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:17.147814 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81603969-440f-452a-bc3c-8b2733be37d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:17.148224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84102278-7572-46e6-9333-729df64aee47 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:17.149241 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81603969-440f-452a-bc3c-8b2733be37d8 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:17.159885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-81603969-440f-452a-bc3c-8b2733be37d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:17.159885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:17.159885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:17.159885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:17.159885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:17.159885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:17.159885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:17.159885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:17.159885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:17.159885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:17.159885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:17.159885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:17.159885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:17.159885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:17.159885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:17.161203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:17.161203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:17.161203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:17.161203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:17.161203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:17.161203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:17.161203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:17.161203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:17.161203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:17.161203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:17.161203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:17.161203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:17.161203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:17.161203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:17.161203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:17.161203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:17.161203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:17.162106 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:17.162106 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:17.162106 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:17.162106 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:17.162106 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:17.162106 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:17.162106 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:17.162106 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:17.162106 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 338/664] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:17.162106 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db0a16-eb45-4e61-ad8f-40ecc3849cd9 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:17.162667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db0a16-eb45-4e61-ad8f-40ecc3849cd9 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:17.162667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db0a16-eb45-4e61-ad8f-40ecc3849cd9 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:17.163724 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 339/665] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:17.164699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303381d-e63c-4c2b-84a5-e666ee77d1f4 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:17.164971 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303381d-e63c-4c2b-84a5-e666ee77d1f4 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:17.165236 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303381d-e63c-4c2b-84a5-e666ee77d1f4 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:17.167182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 340/666] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:17.167868 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303381d-e63c-4c2b-84a5-e666ee77d1f4 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:17.190318 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0060f6-7384-4c86-aaa1-ec00acb9735d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:17.191035 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0060f6-7384-4c86-aaa1-ec00acb9735d None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:17.191309 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0060f6-7384-4c86-aaa1-ec00acb9735d None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:17.191574 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0060f6-7384-4c86-aaa1-ec00acb9735d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:17.201167 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0060f6-7384-4c86-aaa1-ec00acb9735d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:17.202014 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:17.202645 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0060f6-7384-4c86-aaa1-ec00acb9735d None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:17.216628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-7f0060f6-7384-4c86-aaa1-ec00acb9735d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:17.216628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:17.216628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:17.216628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:17.216628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:17.216628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:17.216628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:17.216628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:17.216628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:17.216628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:17.216628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:17.216628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:17.216628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:17.216628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:17.216628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:17.216628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:17.217656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:17.217656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:17.217656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:17.217656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:17.217656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:17.217656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:17.217656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:17.217656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:17.217656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:17.217656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:17.217656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:17.217656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:17.217656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:17.217656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:17.217656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:17.217656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:17.217656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:17.218597 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:17.218597 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:17.218597 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:17.218597 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 327/667] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:17.218597 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0060f6-7384-4c86-aaa1-ec00acb9735d None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:17.262814 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:17.267476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303381d-e63c-4c2b-84a5-e666ee77d1f4 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:17.300945 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269071d7-0b75-4cd0-806e-17405b1d9e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:17.301506 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269071d7-0b75-4cd0-806e-17405b1d9e8a None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:17.301777 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269071d7-0b75-4cd0-806e-17405b1d9e8a None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:17.302051 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269071d7-0b75-4cd0-806e-17405b1d9e8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:17.312462 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269071d7-0b75-4cd0-806e-17405b1d9e8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:17.313883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269071d7-0b75-4cd0-806e-17405b1d9e8a None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:17.319981 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0060f6-7384-4c86-aaa1-ec00acb9735d None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:17.327843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-269071d7-0b75-4cd0-806e-17405b1d9e8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:17.327843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:17.327843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:17.327843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:17.327843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:17.327843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:17.327843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:17.327843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:17.327843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:17.327843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:17.327843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:17.327843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:17.327843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:17.327843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:17.327843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:17.327843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:17.328786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:17.328786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:17.328786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:17.328786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:17.328786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:17.328786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:17.328786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:17.328786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:17.328786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:17.328786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:17.328786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:17.328786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:17.328786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:17.328786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:17.328786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:17.328786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:17.328786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:17.329666 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:17.329666 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:17.329666 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:17.329666 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 341/668] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:17.330496 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b932567-61cd-440e-a5ba-b78bc382aefc None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:17.330772 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b932567-61cd-440e-a5ba-b78bc382aefc None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:17.331036 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b932567-61cd-440e-a5ba-b78bc382aefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:17.348377 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-0b932567-61cd-440e-a5ba-b78bc382aefc None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:17.349556 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-0b932567-61cd-440e-a5ba-b78bc382aefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:17.366342 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26404e6-58f8-4462-9b81-7275104b82ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:17.366957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26404e6-58f8-4462-9b81-7275104b82ad None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:17.367252 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26404e6-58f8-4462-9b81-7275104b82ad None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:17.367524 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26404e6-58f8-4462-9b81-7275104b82ad None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:17.368217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26404e6-58f8-4462-9b81-7275104b82ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:17.368519 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26404e6-58f8-4462-9b81-7275104b82ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:17.372229 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26404e6-58f8-4462-9b81-7275104b82ad None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:17.386193 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 328/669] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:17.387485 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cae20-c0ab-4c83-96fe-b9ed5ced32e4 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:17.387926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cae20-c0ab-4c83-96fe-b9ed5ced32e4 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:17.388200 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cae20-c0ab-4c83-96fe-b9ed5ced32e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:17.406362 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-740cae20-c0ab-4c83-96fe-b9ed5ced32e4 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:17.407554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-740cae20-c0ab-4c83-96fe-b9ed5ced32e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:17.415383 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 342/670] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:41:17.416824 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b932567-61cd-440e-a5ba-b78bc382aefc None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:17.435029 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:17.482045 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 329/671] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:41:17.483112 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740cae20-c0ab-4c83-96fe-b9ed5ced32e4 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:17.511528 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:17.513677 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b932567-61cd-440e-a5ba-b78bc382aefc None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:17.546937 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64404684-e659-42e7-bb33-9d23b4719d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:17.547747 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64404684-e659-42e7-bb33-9d23b4719d00 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:17.548021 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64404684-e659-42e7-bb33-9d23b4719d00 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:17.548295 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64404684-e659-42e7-bb33-9d23b4719d00 None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:17.548928 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64404684-e659-42e7-bb33-9d23b4719d00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:17.549224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64404684-e659-42e7-bb33-9d23b4719d00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:17.550624 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64404684-e659-42e7-bb33-9d23b4719d00 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:17.561683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 343/672] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:17.562424 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64404684-e659-42e7-bb33-9d23b4719d00 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:17.579339 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740cae20-c0ab-4c83-96fe-b9ed5ced32e4 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:17.612671 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca4b4e-9e29-4332-92b4-7f2d3ca7598b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:17.613259 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca4b4e-9e29-4332-92b4-7f2d3ca7598b None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:17.613527 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca4b4e-9e29-4332-92b4-7f2d3ca7598b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:17.613790 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca4b4e-9e29-4332-92b4-7f2d3ca7598b None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:17.614445 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca4b4e-9e29-4332-92b4-7f2d3ca7598b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:17.614738 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca4b4e-9e29-4332-92b4-7f2d3ca7598b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:17.616089 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca4b4e-9e29-4332-92b4-7f2d3ca7598b None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:17.626670 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 330/673] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:17.627427 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca4b4e-9e29-4332-92b4-7f2d3ca7598b None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:17.640805 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:17.663948 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64404684-e659-42e7-bb33-9d23b4719d00 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:17.697837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb84c3c-322a-434d-9401-f62d5aec93b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:17.698456 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb84c3c-322a-434d-9401-f62d5aec93b3 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:17.698729 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb84c3c-322a-434d-9401-f62d5aec93b3 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:17.698994 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb84c3c-322a-434d-9401-f62d5aec93b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:17.699694 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb84c3c-322a-434d-9401-f62d5aec93b3 None admin] RBAC: Adding query filter params (role.id=b8d32893edf5475791d4c3b9aea5a3f6, scope.project.id=a0211f5c0b174c8c998e3ad29f96baab, user.id=a7791be968594cea9c32b51a7b3454b6) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:17.699993 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb84c3c-322a-434d-9401-f62d5aec93b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:17.701392 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb84c3c-322a-434d-9401-f62d5aec93b3 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:17.706904 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 344/674] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:41:17 2022] GET /identity/v3/role_assignments?user.id=a7791be968594cea9c32b51a7b3454b6&scope.project.id=a0211f5c0b174c8c998e3ad29f96baab&role.id=b8d32893edf5475791d4c3b9aea5a3f6 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:17.707661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb84c3c-322a-434d-9401-f62d5aec93b3 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:17.733901 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:17.745376 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca4b4e-9e29-4332-92b4-7f2d3ca7598b None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:17.786815 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845eb53-35b6-4024-aa1c-4fa062e1562e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:17.787515 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845eb53-35b6-4024-aa1c-4fa062e1562e None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:17.787792 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845eb53-35b6-4024-aa1c-4fa062e1562e None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:17.788060 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845eb53-35b6-4024-aa1c-4fa062e1562e None admin] PATH_INFO: `/v3/roles/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:17.800816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845eb53-35b6-4024-aa1c-4fa062e1562e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:17.806592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-5845eb53-35b6-4024-aa1c-4fa062e1562e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:17.806592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:17.806592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:17.806592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:17.806592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:17.806592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:17.806592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:17.806592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:17.806592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:17.806592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:17.806592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:17.806592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:17.806592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:17.806592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:17.806592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:17.806592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:17.807656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:17.807656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:17.807656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:17.807656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:17.807656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:17.807656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:17.807656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:17.807656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:17.807656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:17.807656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:17.807656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:17.807656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:17.807656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:17.807656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:17.807656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:17.807656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:17.808518 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:17.808518 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:17.808518 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:17.808518 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:17.808518 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:17.808518 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:17.808518 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:17.808518 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:17.808518 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:17.808518 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:17.808518 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:17.808518 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:17.808518 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 331/675] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Aug 11 09:41:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:17.809225 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845eb53-35b6-4024-aa1c-4fa062e1562e None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:17.924591 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845eb53-35b6-4024-aa1c-4fa062e1562e None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:17.947296 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb84c3c-322a-434d-9401-f62d5aec93b3 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:17.965043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf2457-1205-400d-8a27-cebaea96deb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:17.965969 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf2457-1205-400d-8a27-cebaea96deb8 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:17.966283 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf2457-1205-400d-8a27-cebaea96deb8 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:17.966555 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf2457-1205-400d-8a27-cebaea96deb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:17.973374 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf2457-1205-400d-8a27-cebaea96deb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:17.974842 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf2457-1205-400d-8a27-cebaea96deb8 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:17.982658 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e1c3d-681a-4973-9cef-7ebd6dc17ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:17.983280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e1c3d-681a-4973-9cef-7ebd6dc17ffc None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:17.983549 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e1c3d-681a-4973-9cef-7ebd6dc17ffc None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:17.983812 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e1c3d-681a-4973-9cef-7ebd6dc17ffc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:17.986502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-f0bf2457-1205-400d-8a27-cebaea96deb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:17.986502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:17.986502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:17.986502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:17.986502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:17.986502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:17.986502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:17.986502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:17.986502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:17.986502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:17.986502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:17.986502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:17.986502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:17.986502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:17.986502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:17.987432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:17.987432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:17.987432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:17.987432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:17.987432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:17.987432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:17.987432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:17.987432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:17.987432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:17.987432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:17.987432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:17.987432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:17.987432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:17.987432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:17.987432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:17.987432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:17.987432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:17.988834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:17.988834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:17.988834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:17.988834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:17.988834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:17.988834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:17.988834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:17.988834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:17.988834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 332/676] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:17.988834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf2457-1205-400d-8a27-cebaea96deb8 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:17.997416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:18.000408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e1c3d-681a-4973-9cef-7ebd6dc17ffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:18.002280 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:18.005378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-0b7e1c3d-681a-4973-9cef-7ebd6dc17ffc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:41:18.005378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:18.005378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:18.005378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:18.005378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:18.005378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:18.005378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:18.005378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:18.005378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:18.005378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:18.005378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:18.005378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:18.005378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:18.005378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:18.005378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:18.005378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:18.012786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:18.012786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:18.012786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:18.012786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:18.012786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:18.012786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:18.012786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:18.012786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:18.012786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:18.012786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:18.012786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:18.012786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:18.012786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:18.012786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:18.012786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:18.012786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:18.013651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:18.013651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:18.013651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:18.013651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:18.013651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:18.013651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:18.013651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:18.013651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:18.013651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:18.013651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:18.013651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:41:18.013651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:18.013651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 345/677] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:41:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:18.013651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e1c3d-681a-4973-9cef-7ebd6dc17ffc None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:18.105306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf2457-1205-400d-8a27-cebaea96deb8 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:18.108489 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e1c3d-681a-4973-9cef-7ebd6dc17ffc None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:18.142002 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c879482-4f1e-4dab-857f-4c7c58f6872f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:18.142368 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fda8ce-f6d8-4788-acec-45e1520fa2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:18.142660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c879482-4f1e-4dab-857f-4c7c58f6872f None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:18.142762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fda8ce-f6d8-4788-acec-45e1520fa2f3 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:18.142940 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c879482-4f1e-4dab-857f-4c7c58f6872f None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:18.143039 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fda8ce-f6d8-4788-acec-45e1520fa2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:18.143201 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fda8ce-f6d8-4788-acec-45e1520fa2f3 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:18.143291 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c879482-4f1e-4dab-857f-4c7c58f6872f None admin] PATH_INFO: `/v3/projects/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:18.143888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fda8ce-f6d8-4788-acec-45e1520fa2f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:18.144152 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fda8ce-f6d8-4788-acec-45e1520fa2f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:18.145524 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fda8ce-f6d8-4788-acec-45e1520fa2f3 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:18.150219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c879482-4f1e-4dab-857f-4c7c58f6872f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:18.151775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c879482-4f1e-4dab-857f-4c7c58f6872f None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:18.153945 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 346/678] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Aug 11 09:41:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:18.154757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fda8ce-f6d8-4788-acec-45e1520fa2f3 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:18.168310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-1c879482-4f1e-4dab-857f-4c7c58f6872f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:18.168310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:18.168310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:18.168310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:18.168310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:18.168310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:18.168310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:18.168310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:18.168310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:18.168310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:18.168310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:18.168310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:18.168310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:18.168310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:18.168310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:18.169244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:18.169244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:18.169244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:18.169244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:18.169244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:18.169244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:18.169244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:18.169244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:18.169244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:18.169244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:18.169244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:18.169244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:18.169244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:18.169244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:18.169244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:18.169244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:18.169244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:18.170169 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:18.170169 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:18.170169 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:18.170169 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:18.170169 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:18.170169 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:18.170169 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:18.170169 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:18.170169 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 333/679] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:18.170683 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c879482-4f1e-4dab-857f-4c7c58f6872f None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:18.223043 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:18.242477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:18.264208 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fda8ce-f6d8-4788-acec-45e1520fa2f3 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:18.274900 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c879482-4f1e-4dab-857f-4c7c58f6872f None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:18.301976 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be172c-703b-4b60-a954-d11a6296097d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:18.302717 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be172c-703b-4b60-a954-d11a6296097d None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:18.303002 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be172c-703b-4b60-a954-d11a6296097d None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:18.303275 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be172c-703b-4b60-a954-d11a6296097d None admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:18.303914 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be172c-703b-4b60-a954-d11a6296097d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:18.304211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be172c-703b-4b60-a954-d11a6296097d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:18.305910 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be172c-703b-4b60-a954-d11a6296097d None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:18.310939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad7d27-923e-4c0e-855f-4f2574f8a2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:18.311618 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad7d27-923e-4c0e-855f-4f2574f8a2f2 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:18.311966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad7d27-923e-4c0e-855f-4f2574f8a2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:18.312309 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad7d27-923e-4c0e-855f-4f2574f8a2f2 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:18.313030 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad7d27-923e-4c0e-855f-4f2574f8a2f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:18.313404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad7d27-923e-4c0e-855f-4f2574f8a2f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:18.314864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad7d27-923e-4c0e-855f-4f2574f8a2f2 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:18.318528 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 347/680] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:18.323925 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 334/681] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:41:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:18.324331 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be172c-703b-4b60-a954-d11a6296097d None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:18.327302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad7d27-923e-4c0e-855f-4f2574f8a2f2 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:18.422979 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be172c-703b-4b60-a954-d11a6296097d None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:18.435549 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad7d27-923e-4c0e-855f-4f2574f8a2f2 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:18.445234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:18.457940 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69635bc-e317-4519-8ad6-f29f03f3b0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:18.458769 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69635bc-e317-4519-8ad6-f29f03f3b0d6 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:18.464447 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69635bc-e317-4519-8ad6-f29f03f3b0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:18.464447 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69635bc-e317-4519-8ad6-f29f03f3b0d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:18.464928 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:18.471218 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da83ea-5f94-4c7c-92ab-b4fc2c3b2f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:18.471833 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da83ea-5f94-4c7c-92ab-b4fc2c3b2f46 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:18.472110 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da83ea-5f94-4c7c-92ab-b4fc2c3b2f46 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:18.472379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da83ea-5f94-4c7c-92ab-b4fc2c3b2f46 None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:18.472798 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69635bc-e317-4519-8ad6-f29f03f3b0d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:18.473118 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da83ea-5f94-4c7c-92ab-b4fc2c3b2f46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:18.473365 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da83ea-5f94-4c7c-92ab-b4fc2c3b2f46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:18.474831 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da83ea-5f94-4c7c-92ab-b4fc2c3b2f46 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:18.474971 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69635bc-e317-4519-8ad6-f29f03f3b0d6 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:18.488618 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 335/682] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:18.489420 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da83ea-5f94-4c7c-92ab-b4fc2c3b2f46 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:18.490554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-b69635bc-e317-4519-8ad6-f29f03f3b0d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:18.490554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:18.490554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:18.490554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:18.490554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:18.490554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:18.490554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:18.490554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:18.490554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:18.490554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:18.490554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:18.490554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:18.490554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:18.490554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:18.490554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:18.490554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:18.491487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:18.491487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:18.491487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:18.491487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:18.491487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:18.491487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:18.491487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:18.491487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:18.491487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:18.491487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:18.491487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:18.491487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:18.491487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:18.491487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:18.491487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:18.491487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:18.491487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:18.492373 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:18.492373 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:18.492373 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:18.496682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 348/683] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:18.497588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69635bc-e317-4519-8ad6-f29f03f3b0d6 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:18.592268 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da83ea-5f94-4c7c-92ab-b4fc2c3b2f46 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:18.604271 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69635bc-e317-4519-8ad6-f29f03f3b0d6 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:18.625531 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d077d2-0f0c-444a-9da7-b1573f2937cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:18.626153 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d077d2-0f0c-444a-9da7-b1573f2937cd None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:18.626431 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d077d2-0f0c-444a-9da7-b1573f2937cd None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:18.626698 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d077d2-0f0c-444a-9da7-b1573f2937cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:18.627405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d077d2-0f0c-444a-9da7-b1573f2937cd None admin] RBAC: Adding query filter params (role.id=b8d32893edf5475791d4c3b9aea5a3f6, scope.project.id=a0211f5c0b174c8c998e3ad29f96baab, user.id=740fc24dc2134f5ca2fba8caa9abb3cf) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:18.627702 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d077d2-0f0c-444a-9da7-b1573f2937cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:18.629124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d077d2-0f0c-444a-9da7-b1573f2937cd None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:18.638137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 336/684] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:41:18 2022] GET /identity/v3/role_assignments?user.id=740fc24dc2134f5ca2fba8caa9abb3cf&scope.project.id=a0211f5c0b174c8c998e3ad29f96baab&role.id=b8d32893edf5475791d4c3b9aea5a3f6 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:18.638137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d077d2-0f0c-444a-9da7-b1573f2937cd None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:18.652965 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607f20d-ab8b-4427-bd00-70154c00bb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:18.654328 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607f20d-ab8b-4427-bd00-70154c00bb24 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:18.655113 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607f20d-ab8b-4427-bd00-70154c00bb24 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:18.655618 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607f20d-ab8b-4427-bd00-70154c00bb24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:18.672791 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607f20d-ab8b-4427-bd00-70154c00bb24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:18.675156 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607f20d-ab8b-4427-bd00-70154c00bb24 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:18.706518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-6607f20d-ab8b-4427-bd00-70154c00bb24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:18.706518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:18.706518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:18.706518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:18.706518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:18.706518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:18.706518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:18.706518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:18.706518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:18.706518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:18.706518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:18.706518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:18.706518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:18.706518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:18.706518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:18.706518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:18.707554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:18.707554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:18.707554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:18.707554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:18.707554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:18.707554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:18.707554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:18.707554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:18.707554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:18.707554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:18.707554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:18.707554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:18.707554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:18.707554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:18.707554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:18.707554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:18.707554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:18.708448 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:18.708448 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:18.708448 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:18.708448 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 349/685] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:18.709101 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607f20d-ab8b-4427-bd00-70154c00bb24 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:18.716721 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:18.740442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:18.769492 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d077d2-0f0c-444a-9da7-b1573f2937cd None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:18.810670 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0d252-7aed-49ba-a959-72c62a555baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:18.811261 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0d252-7aed-49ba-a959-72c62a555baf None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:18.811529 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0d252-7aed-49ba-a959-72c62a555baf None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:18.812285 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0d252-7aed-49ba-a959-72c62a555baf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:18.812501 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0d252-7aed-49ba-a959-72c62a555baf None admin] RBAC: Adding query filter params (role.id=b8d32893edf5475791d4c3b9aea5a3f6, scope.project.id=a0211f5c0b174c8c998e3ad29f96baab, user.id=4ac6ca32b5144c59b2bb5086fbd53ea4) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:18.812798 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0d252-7aed-49ba-a959-72c62a555baf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:18.814240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0d252-7aed-49ba-a959-72c62a555baf None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:18.821491 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 337/686] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:41:18 2022] GET /identity/v3/role_assignments?user.id=4ac6ca32b5144c59b2bb5086fbd53ea4&scope.project.id=a0211f5c0b174c8c998e3ad29f96baab&role.id=b8d32893edf5475791d4c3b9aea5a3f6 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:18.821879 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0d252-7aed-49ba-a959-72c62a555baf None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:18.834877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607f20d-ab8b-4427-bd00-70154c00bb24 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:18.882419 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd31ab-ce0f-47ee-9c74-cc6f95f9ca5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:18.883444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd31ab-ce0f-47ee-9c74-cc6f95f9ca5f None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:18.883950 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd31ab-ce0f-47ee-9c74-cc6f95f9ca5f None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:18.884533 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd31ab-ce0f-47ee-9c74-cc6f95f9ca5f None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:18.885411 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd31ab-ce0f-47ee-9c74-cc6f95f9ca5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:18.885942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd31ab-ce0f-47ee-9c74-cc6f95f9ca5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:18.888517 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd31ab-ce0f-47ee-9c74-cc6f95f9ca5f None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:18.905625 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 350/687] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:18.914729 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd31ab-ce0f-47ee-9c74-cc6f95f9ca5f None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:18.998196 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0d252-7aed-49ba-a959-72c62a555baf None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:19.019893 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:19.035722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:19.037044 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555eac64-8aaa-4dd3-b805-9c36e52ce864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:19.037747 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555eac64-8aaa-4dd3-b805-9c36e52ce864 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:19.038114 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555eac64-8aaa-4dd3-b805-9c36e52ce864 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:19.038487 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555eac64-8aaa-4dd3-b805-9c36e52ce864 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:19.039210 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555eac64-8aaa-4dd3-b805-9c36e52ce864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:19.039577 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555eac64-8aaa-4dd3-b805-9c36e52ce864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:19.041682 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555eac64-8aaa-4dd3-b805-9c36e52ce864 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:19.056312 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd31ab-ce0f-47ee-9c74-cc6f95f9ca5f None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:19.063796 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 338/688] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:19.069063 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555eac64-8aaa-4dd3-b805-9c36e52ce864 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:19.107046 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29fa58-2024-4cd2-bdc9-a8c02f88981e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:19.107683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29fa58-2024-4cd2-bdc9-a8c02f88981e None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:19.108797 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29fa58-2024-4cd2-bdc9-a8c02f88981e None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:19.109634 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29fa58-2024-4cd2-bdc9-a8c02f88981e None admin] PATH_INFO: `/v3/users/swift` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:19.122367 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29fa58-2024-4cd2-bdc9-a8c02f88981e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:19.124111 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29fa58-2024-4cd2-bdc9-a8c02f88981e None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:19.144827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-6c29fa58-2024-4cd2-bdc9-a8c02f88981e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 11 09:41:19.144827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:19.144827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:19.144827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:19.144827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:19.144827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:19.144827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:19.144827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:19.144827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:19.144827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:19.144827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:19.144827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:19.144827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:19.144827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:19.144827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:19.144827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:19.145810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:19.145810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:19.145810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:19.145810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:19.145810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:19.145810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:19.145810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:19.145810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:19.145810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:19.145810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:19.145810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:19.145810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:19.145810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:19.145810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:19.145810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:19.145810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:19.145810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:19.145810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:19.146804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:19.146804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:19.146804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:19.146804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:19.146804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:19.146804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:19.146804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:19.146804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:19.146804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 11 09:41:19.146804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:19.149085 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 351/689] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:41:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:19.155515 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29fa58-2024-4cd2-bdc9-a8c02f88981e None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:19.211971 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555eac64-8aaa-4dd3-b805-9c36e52ce864 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:19.248380 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485193a-c2f2-4fb5-96b9-4aa4d413cef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:19.249339 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485193a-c2f2-4fb5-96b9-4aa4d413cef0 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:19.249812 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485193a-c2f2-4fb5-96b9-4aa4d413cef0 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:19.250320 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485193a-c2f2-4fb5-96b9-4aa4d413cef0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:19.258373 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485193a-c2f2-4fb5-96b9-4aa4d413cef0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:19.260631 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485193a-c2f2-4fb5-96b9-4aa4d413cef0 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:19.272532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-8485193a-c2f2-4fb5-96b9-4aa4d413cef0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 09:41:19.272532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:19.272532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:19.272532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:19.272532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:19.272532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:19.272532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:19.272532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:19.272532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:19.272532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:19.272532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:19.272532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:19.272532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:19.272532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:19.272532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:19.272532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:19.273514 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:19.273514 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:19.273514 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:19.273514 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:19.273514 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:19.273514 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:19.273514 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:19.273514 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:19.273514 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:19.273514 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:19.273514 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:19.273514 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:19.273514 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:19.273514 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:19.273514 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:19.273514 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:19.273514 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:19.273514 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:19.274481 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:19.274481 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:19.274481 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:19.274481 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:19.274481 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:19.274481 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:19.274481 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:19.274481 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:19.274481 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 09:41:19.274481 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:19.277647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 339/690] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Aug 11 09:41:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:41:19.282882 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485193a-c2f2-4fb5-96b9-4aa4d413cef0 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:19.302658 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29fa58-2024-4cd2-bdc9-a8c02f88981e None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:19.345436 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:19.375186 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078a74c-9000-4ff1-8d8f-c25ee537579d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:19.376198 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078a74c-9000-4ff1-8d8f-c25ee537579d None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:19.376731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078a74c-9000-4ff1-8d8f-c25ee537579d None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:19.377185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078a74c-9000-4ff1-8d8f-c25ee537579d None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:19.378852 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078a74c-9000-4ff1-8d8f-c25ee537579d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:19.379418 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078a74c-9000-4ff1-8d8f-c25ee537579d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:19.382178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078a74c-9000-4ff1-8d8f-c25ee537579d None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:19.411645 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485193a-c2f2-4fb5-96b9-4aa4d413cef0 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:19.425742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 352/691] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Aug 11 09:41:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:19.433045 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078a74c-9000-4ff1-8d8f-c25ee537579d None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:19.447798 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:19.453897 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33dec08-288b-4ebc-952f-1232a9b251e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:19.454843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dec08-288b-4ebc-952f-1232a9b251e7 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:19.459641 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dec08-288b-4ebc-952f-1232a9b251e7 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:19.459641 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dec08-288b-4ebc-952f-1232a9b251e7 None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:19.459641 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33dec08-288b-4ebc-952f-1232a9b251e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:19.459641 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33dec08-288b-4ebc-952f-1232a9b251e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:19.459641 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33dec08-288b-4ebc-952f-1232a9b251e7 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:19.477331 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 340/692] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Aug 11 09:41:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:41:19.491194 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33dec08-288b-4ebc-952f-1232a9b251e7 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:19.595039 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33dec08-288b-4ebc-952f-1232a9b251e7 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:19.596909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:19.626015 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078a74c-9000-4ff1-8d8f-c25ee537579d None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:19.631849 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8086e3a-5851-44ea-bb27-fdbaa9d99a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:19.632616 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8086e3a-5851-44ea-bb27-fdbaa9d99a44 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:19.633051 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8086e3a-5851-44ea-bb27-fdbaa9d99a44 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:19.633420 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8086e3a-5851-44ea-bb27-fdbaa9d99a44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:19.677887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15501e0-b6c7-4248-a4c3-e7d952ec6eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:19.678902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15501e0-b6c7-4248-a4c3-e7d952ec6eda None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:19.679323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15501e0-b6c7-4248-a4c3-e7d952ec6eda None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:19.679736 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15501e0-b6c7-4248-a4c3-e7d952ec6eda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:19.712008 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8086e3a-5851-44ea-bb27-fdbaa9d99a44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:19.713651 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8086e3a-5851-44ea-bb27-fdbaa9d99a44 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:19.772742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15501e0-b6c7-4248-a4c3-e7d952ec6eda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:19.775105 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15501e0-b6c7-4248-a4c3-e7d952ec6eda None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:19.779162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:19.827729 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:19.834537 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 341/693] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:41:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:41:19.843273 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8086e3a-5851-44ea-bb27-fdbaa9d99a44 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:19.888444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 353/694] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:41:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 09:41:19.894225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15501e0-b6c7-4248-a4c3-e7d952ec6eda None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:20.005097 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15501e0-b6c7-4248-a4c3-e7d952ec6eda None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:20.007864 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:20.044156 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef5b21-8cde-45c4-8215-eb166213aaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:20.045063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef5b21-8cde-45c4-8215-eb166213aaa6 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:20.045873 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef5b21-8cde-45c4-8215-eb166213aaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:20.046321 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef5b21-8cde-45c4-8215-eb166213aaa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:20.058581 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef5b21-8cde-45c4-8215-eb166213aaa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:20.060177 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef5b21-8cde-45c4-8215-eb166213aaa6 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:20.077296 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8086e3a-5851-44ea-bb27-fdbaa9d99a44 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:20.077722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-12ef5b21-8cde-45c4-8215-eb166213aaa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:20.077722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:20.077722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:20.077722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:20.077722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:20.077722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:20.077722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:20.077722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:20.077722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:20.077722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:20.077722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:20.077722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:20.077722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:20.077722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:20.077722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:20.077722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:20.078831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:20.078831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:20.078831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:20.078831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:20.078831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:20.078831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:20.078831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:20.078831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:20.078831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:20.078831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:20.078831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:20.078831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:20.078831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:20.078831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:20.078831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:20.078831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:20.078831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:20.079934 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:20.079934 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:20.079934 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:20.081721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 354/695] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:20.083888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e6220-1e71-47c7-b00b-b5697eb51b88 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:20.084306 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e6220-1e71-47c7-b00b-b5697eb51b88 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:20.084696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e6220-1e71-47c7-b00b-b5697eb51b88 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:20.086276 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 355/696] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:20.093647 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e6220-1e71-47c7-b00b-b5697eb51b88 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:20.127200 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a39b5-6471-4ebc-8c51-78532669cbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:20.128221 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a39b5-6471-4ebc-8c51-78532669cbb8 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:20.128701 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a39b5-6471-4ebc-8c51-78532669cbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:20.129173 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a39b5-6471-4ebc-8c51-78532669cbb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:20.141328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a39b5-6471-4ebc-8c51-78532669cbb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:20.143211 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a39b5-6471-4ebc-8c51-78532669cbb8 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:20.158657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-360a39b5-6471-4ebc-8c51-78532669cbb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:20.158657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:20.158657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:20.158657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:20.158657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:20.158657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:20.158657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:20.158657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:20.158657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:20.158657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:20.158657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:20.158657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:20.158657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:20.158657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:20.158657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:20.158657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:20.159610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:20.159610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:20.159610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:20.159610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:20.159610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:20.159610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:20.159610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:20.159610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:20.159610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:20.159610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:20.159610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:20.159610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:20.159610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:20.159610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:20.159610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:20.159610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:20.159610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:20.160534 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:20.160534 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:20.160534 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:20.162607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 342/697] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:20.168746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a57185-499f-4362-8520-191842cabbba None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:20.169377 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a57185-499f-4362-8520-191842cabbba None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:20.169857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a57185-499f-4362-8520-191842cabbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:20.188924 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-89a57185-499f-4362-8520-191842cabbba None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:20.190579 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-89a57185-499f-4362-8520-191842cabbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:20.223231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e6220-1e71-47c7-b00b-b5697eb51b88 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:20.240387 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:20.263367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 343/698] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:41:20.264598 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a57185-499f-4362-8520-191842cabbba None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:20.273530 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5f524-ce85-48a7-a56a-ad23fd3a2445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:20.275256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5f524-ce85-48a7-a56a-ad23fd3a2445 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:20.282462 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5f524-ce85-48a7-a56a-ad23fd3a2445 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:20.282754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5f524-ce85-48a7-a56a-ad23fd3a2445 None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:20.283427 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5f524-ce85-48a7-a56a-ad23fd3a2445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:20.283732 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5f524-ce85-48a7-a56a-ad23fd3a2445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:20.285109 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5f524-ce85-48a7-a56a-ad23fd3a2445 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:20.302161 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 356/699] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:20.304032 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5f524-ce85-48a7-a56a-ad23fd3a2445 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:20.331772 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:20.401327 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a57185-499f-4362-8520-191842cabbba None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:20.425436 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5f524-ce85-48a7-a56a-ad23fd3a2445 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:20.451887 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f3659-7e5a-4dd1-b864-c29038d70980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:20.452492 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f3659-7e5a-4dd1-b864-c29038d70980 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:20.452770 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f3659-7e5a-4dd1-b864-c29038d70980 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:20.454363 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f3659-7e5a-4dd1-b864-c29038d70980 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:20.455780 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f3659-7e5a-4dd1-b864-c29038d70980 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:20.456458 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f3659-7e5a-4dd1-b864-c29038d70980 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:20.458416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f3659-7e5a-4dd1-b864-c29038d70980 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:20.470272 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c425d-4839-43c9-b67e-542674d7d93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:20.470713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c425d-4839-43c9-b67e-542674d7d93a None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:20.471108 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c425d-4839-43c9-b67e-542674d7d93a None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:20.471456 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c425d-4839-43c9-b67e-542674d7d93a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:20.475195 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 344/700] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:20.476204 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f3659-7e5a-4dd1-b864-c29038d70980 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:20.487635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c425d-4839-43c9-b67e-542674d7d93a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:20.489342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c425d-4839-43c9-b67e-542674d7d93a None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:20.505936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-797c425d-4839-43c9-b67e-542674d7d93a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:20.505936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:20.505936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:20.505936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:20.505936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:20.505936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:20.505936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:20.505936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:20.505936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:20.505936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:20.505936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:20.505936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:20.505936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:20.505936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:20.505936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:20.505936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:20.506991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:20.506991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:20.506991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:20.506991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:20.506991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:20.506991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:20.506991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:20.506991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:20.506991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:20.506991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:20.506991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:20.506991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:20.506991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:20.506991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:20.506991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:20.506991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:20.506991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:20.508039 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:20.508039 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:20.508039 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:20.512171 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 357/701] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:20.513178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c425d-4839-43c9-b67e-542674d7d93a None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:20.531579 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:20.592250 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f3659-7e5a-4dd1-b864-c29038d70980 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:20.599864 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:20.627984 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4cbdd-8a46-4608-becf-1cc30f7ad01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:20.628701 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4cbdd-8a46-4608-becf-1cc30f7ad01f None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:20.629043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4cbdd-8a46-4608-becf-1cc30f7ad01f None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:20.629404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4cbdd-8a46-4608-becf-1cc30f7ad01f None admin] PATH_INFO: `/v3/projects/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:20.645764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4cbdd-8a46-4608-becf-1cc30f7ad01f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:20.647664 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4cbdd-8a46-4608-becf-1cc30f7ad01f None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:20.649820 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c425d-4839-43c9-b67e-542674d7d93a None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:20.662957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-fbd4cbdd-8a46-4608-becf-1cc30f7ad01f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:20.662957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:20.662957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:20.662957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:20.662957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:20.662957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:20.662957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:20.662957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:20.662957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:20.662957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:20.662957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:20.662957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:20.662957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:20.662957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:20.662957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:20.663858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:20.663858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:20.663858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:20.663858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:20.663858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:20.663858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:20.663858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:20.663858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:20.663858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:20.663858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:20.663858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:20.663858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:20.663858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:20.663858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:20.663858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:20.663858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:20.663858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:20.664771 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:20.664771 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:20.664771 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:20.664771 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:20.664771 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:20.664771 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:20.664771 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:20.664771 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:20.673271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 345/702] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:20.674567 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4cbdd-8a46-4608-becf-1cc30f7ad01f None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:20.699995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826544ff-39d1-4953-99ed-62ff52eaa190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:20.700873 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826544ff-39d1-4953-99ed-62ff52eaa190 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:20.701346 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826544ff-39d1-4953-99ed-62ff52eaa190 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:20.701756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826544ff-39d1-4953-99ed-62ff52eaa190 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:20.709326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826544ff-39d1-4953-99ed-62ff52eaa190 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:20.711044 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826544ff-39d1-4953-99ed-62ff52eaa190 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:20.723740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-826544ff-39d1-4953-99ed-62ff52eaa190 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:20.723740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:20.723740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:20.723740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:20.723740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:20.723740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:20.723740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:20.723740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:20.723740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:20.723740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:20.723740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:20.723740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:20.723740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:20.723740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:20.723740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:20.724703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:20.724703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:20.724703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:20.724703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:20.724703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:20.724703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:20.724703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:20.724703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:20.724703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:20.724703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:20.724703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:20.724703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:20.724703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:20.724703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:20.724703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:20.724703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:20.724703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:20.725580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:20.725580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:20.725580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:20.725580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:20.725580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:20.725580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:20.725580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:20.725580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:20.732663 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 358/703] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:20.733748 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826544ff-39d1-4953-99ed-62ff52eaa190 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:20.786538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:20.791315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4cbdd-8a46-4608-becf-1cc30f7ad01f None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:20.831201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f9fa6-5ecc-4517-98fe-f36879632339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:20.832065 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f9fa6-5ecc-4517-98fe-f36879632339 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:20.832491 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f9fa6-5ecc-4517-98fe-f36879632339 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:20.832945 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f9fa6-5ecc-4517-98fe-f36879632339 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:20.833871 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f9fa6-5ecc-4517-98fe-f36879632339 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:20.834342 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f9fa6-5ecc-4517-98fe-f36879632339 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:20.836031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f9fa6-5ecc-4517-98fe-f36879632339 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:20.854285 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 346/704] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:20.855381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f9fa6-5ecc-4517-98fe-f36879632339 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:20.856448 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826544ff-39d1-4953-99ed-62ff52eaa190 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:20.889319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:20.901310 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18fec96-8826-4213-ad24-891ea8cda759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:20.902030 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fec96-8826-4213-ad24-891ea8cda759 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:20.902421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fec96-8826-4213-ad24-891ea8cda759 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:20.902765 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fec96-8826-4213-ad24-891ea8cda759 None admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:20.903525 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18fec96-8826-4213-ad24-891ea8cda759 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:20.904291 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18fec96-8826-4213-ad24-891ea8cda759 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:20.906214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18fec96-8826-4213-ad24-891ea8cda759 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:20.926120 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 359/705] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:20.926120 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18fec96-8826-4213-ad24-891ea8cda759 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:20.977209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f9fa6-5ecc-4517-98fe-f36879632339 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:21.015859 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf8376-d626-4fb7-ba60-d003875e30df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:21.016883 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf8376-d626-4fb7-ba60-d003875e30df None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:21.017385 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf8376-d626-4fb7-ba60-d003875e30df None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:21.017852 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf8376-d626-4fb7-ba60-d003875e30df None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:21.018855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf8376-d626-4fb7-ba60-d003875e30df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:21.019422 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf8376-d626-4fb7-ba60-d003875e30df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:21.021065 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf8376-d626-4fb7-ba60-d003875e30df None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:21.031471 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18fec96-8826-4213-ad24-891ea8cda759 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:21.039488 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 347/706] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:21.041389 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf8376-d626-4fb7-ba60-d003875e30df None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:21.065834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:21.070590 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065b4cf-583a-4ed9-8ffe-6e126c0e720e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:21.071483 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065b4cf-583a-4ed9-8ffe-6e126c0e720e None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:21.071820 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065b4cf-583a-4ed9-8ffe-6e126c0e720e None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:21.072242 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065b4cf-583a-4ed9-8ffe-6e126c0e720e None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:21.073204 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065b4cf-583a-4ed9-8ffe-6e126c0e720e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:21.075104 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065b4cf-583a-4ed9-8ffe-6e126c0e720e None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:21.143452 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf8376-d626-4fb7-ba60-d003875e30df None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:21.177962 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8d57d-5891-4981-85e6-cb265b0a9095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:21.178537 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 360/707] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Aug 11 09:41:20 2022] POST /identity/v3/users => generated 254 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:41:21.178652 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8d57d-5891-4981-85e6-cb265b0a9095 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:21.178826 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8d57d-5891-4981-85e6-cb265b0a9095 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:21.179205 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8d57d-5891-4981-85e6-cb265b0a9095 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:21.179676 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065b4cf-583a-4ed9-8ffe-6e126c0e720e None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:21.179937 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8d57d-5891-4981-85e6-cb265b0a9095 None admin] RBAC: Adding query filter params (role.id=b8d32893edf5475791d4c3b9aea5a3f6, scope.project.id=a0211f5c0b174c8c998e3ad29f96baab, user.id=f7e3b1c5aec94673b391210ae51d4cc2) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:21.180504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8d57d-5891-4981-85e6-cb265b0a9095 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:21.182483 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8d57d-5891-4981-85e6-cb265b0a9095 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:21.193385 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 348/708] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:41:21 2022] GET /identity/v3/role_assignments?user.id=f7e3b1c5aec94673b391210ae51d4cc2&scope.project.id=a0211f5c0b174c8c998e3ad29f96baab&role.id=b8d32893edf5475791d4c3b9aea5a3f6 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:21.193385 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef6c05-5e51-4b52-afbf-d9321810236c None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:21.193385 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef6c05-5e51-4b52-afbf-d9321810236c None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:21.193385 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef6c05-5e51-4b52-afbf-d9321810236c None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:21.197114 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 349/709] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:21.200221 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261b97e-8e54-4467-99d9-ce4c1faafb92 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:21.200221 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261b97e-8e54-4467-99d9-ce4c1faafb92 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:21.200221 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261b97e-8e54-4467-99d9-ce4c1faafb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:21.219420 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-6261b97e-8e54-4467-99d9-ce4c1faafb92 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:21.220669 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-6261b97e-8e54-4467-99d9-ce4c1faafb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:21.286732 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:21.344539 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 350/710] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:41:21.345764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12caab-001b-409a-b5d8-6da287f45dbb None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:21.346051 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12caab-001b-409a-b5d8-6da287f45dbb None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:21.346351 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12caab-001b-409a-b5d8-6da287f45dbb None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:21.352252 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 351/711] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:21.353685 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d646e-d90c-482b-b9df-ce654bd981e2 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:21.353971 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d646e-d90c-482b-b9df-ce654bd981e2 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:21.354293 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d646e-d90c-482b-b9df-ce654bd981e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:21.366915 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065b4cf-583a-4ed9-8ffe-6e126c0e720e None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:21.381111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-4a6d646e-d90c-482b-b9df-ce654bd981e2 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:21.382392 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-4a6d646e-d90c-482b-b9df-ce654bd981e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:21.397046 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:21.424883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16807ca4-db41-4d64-9c09-3c8da4e7ead4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:21.425575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16807ca4-db41-4d64-9c09-3c8da4e7ead4 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:21.425790 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16807ca4-db41-4d64-9c09-3c8da4e7ead4 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:21.426064 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16807ca4-db41-4d64-9c09-3c8da4e7ead4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:21.426838 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16807ca4-db41-4d64-9c09-3c8da4e7ead4 None admin] RBAC: Adding query filter params (role.id=6aae1c66f3f04cec80ed72c20d7e033b, scope.project.id=a0211f5c0b174c8c998e3ad29f96baab, user.id=4c1dc8e0d9454ad98894ed1e8d31f931) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:21.427144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16807ca4-db41-4d64-9c09-3c8da4e7ead4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:21.428646 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16807ca4-db41-4d64-9c09-3c8da4e7ead4 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:21.436816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 361/712] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:41:21 2022] GET /identity/v3/role_assignments?user.id=4c1dc8e0d9454ad98894ed1e8d31f931&scope.project.id=a0211f5c0b174c8c998e3ad29f96baab&role.id=6aae1c66f3f04cec80ed72c20d7e033b => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:21.438993 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16807ca4-db41-4d64-9c09-3c8da4e7ead4 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:21.476567 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 352/713] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:41:21.499004 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d646e-d90c-482b-b9df-ce654bd981e2 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:21.588553 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16807ca4-db41-4d64-9c09-3c8da4e7ead4 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:21.606141 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:21.627529 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d646e-d90c-482b-b9df-ce654bd981e2 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:21.651777 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949ba2c-9660-4294-a6e4-99811b6c1cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:21.654762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949ba2c-9660-4294-a6e4-99811b6c1cd6 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:21.655271 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949ba2c-9660-4294-a6e4-99811b6c1cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:21.655737 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949ba2c-9660-4294-a6e4-99811b6c1cd6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:21.658190 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949ba2c-9660-4294-a6e4-99811b6c1cd6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:21.660090 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949ba2c-9660-4294-a6e4-99811b6c1cd6 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:21.673521 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631cdf3-6280-43d4-a1ab-079a2940ded5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:21.674538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631cdf3-6280-43d4-a1ab-079a2940ded5 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:21.674957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631cdf3-6280-43d4-a1ab-079a2940ded5 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:21.678443 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631cdf3-6280-43d4-a1ab-079a2940ded5 None admin] PATH_INFO: `/v3/services/network` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:21.678443 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631cdf3-6280-43d4-a1ab-079a2940ded5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:21.678635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-b949ba2c-9660-4294-a6e4-99811b6c1cd6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 09:41:21.678635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:21.678635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:41:21.678635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:41:21.678635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:41:21.678635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:41:21.678635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:41:21.678635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:21.678635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 09:41:21.678635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:21.678635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:41:21.678635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:21.678635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:21.678635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:21.678635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:21.678635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:21.678635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:21.679759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:21.679759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:21.679759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:21.679759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:21.679759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:21.679759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:21.679759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:41:21.679759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:41:21.679759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:41:21.679759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:41:21.679759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:21.679759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:21.679759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:21.679759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:21.679759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:21.679759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:21.681829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:21.681829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:21.681829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:21.681829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:21.681829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:21.681829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:21.681829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:21.681829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:21.681829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:21.681829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:21.681829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:41:21.681829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:21.681829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 09:41:21.681829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:21.682619 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631cdf3-6280-43d4-a1ab-079a2940ded5 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:21.682700 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 362/714] 10.222.0.13 () {56 vars in 1129 bytes} [Thu Aug 11 09:41:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:21.687365 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949ba2c-9660-4294-a6e4-99811b6c1cd6 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:21.695025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-f631cdf3-6280-43d4-a1ab-079a2940ded5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 09:41:21.695025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:21.695025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:41:21.695025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:41:21.695025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:41:21.695025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:41:21.695025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:41:21.695025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:21.695025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 09:41:21.695025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:21.695025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:41:21.695025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:21.695025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:21.695025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:21.695025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:21.695025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:21.695025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:21.696837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:21.696837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:21.696837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:21.696837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:21.696837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:21.696837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:21.696837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:41:21.696837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:41:21.696837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:41:21.696837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:41:21.696837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:21.696837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:21.696837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:21.696837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:21.696837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:21.696837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:21.698822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:21.698822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:21.698822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:21.698822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:21.698822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:21.698822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:21.698822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:21.698822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:21.698822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:21.698822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:21.698822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:41:21.698822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:21.698822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 09:41:21.698822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:21.698822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 353/715] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:21 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:21.702070 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631cdf3-6280-43d4-a1ab-079a2940ded5 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:21.714349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:21.820052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631cdf3-6280-43d4-a1ab-079a2940ded5 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:21.827002 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949ba2c-9660-4294-a6e4-99811b6c1cd6 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:21.868363 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b11e5-113c-40a6-8c14-a5c64fe5d4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:21.868986 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b11e5-113c-40a6-8c14-a5c64fe5d4f3 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:21.869527 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b11e5-113c-40a6-8c14-a5c64fe5d4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:21.869803 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b11e5-113c-40a6-8c14-a5c64fe5d4f3 None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:21.870463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b11e5-113c-40a6-8c14-a5c64fe5d4f3 None admin] RBAC: Adding query filter params (name=network) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:21.870767 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b11e5-113c-40a6-8c14-a5c64fe5d4f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:21.872142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b11e5-113c-40a6-8c14-a5c64fe5d4f3 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:21.877798 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 354/716] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Aug 11 09:41:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:21.885706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b11e5-113c-40a6-8c14-a5c64fe5d4f3 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:21.894358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bddb47-4212-4565-a426-631e98a77085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:21.895043 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bddb47-4212-4565-a426-631e98a77085 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:21.895313 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bddb47-4212-4565-a426-631e98a77085 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:21.895573 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bddb47-4212-4565-a426-631e98a77085 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:21.896212 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bddb47-4212-4565-a426-631e98a77085 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:21.896503 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bddb47-4212-4565-a426-631e98a77085 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:21.897871 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bddb47-4212-4565-a426-631e98a77085 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:21.903882 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 363/717] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Aug 11 09:41:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:41:21.909657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bddb47-4212-4565-a426-631e98a77085 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:21.972299 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:21.995968 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:22.009413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b11e5-113c-40a6-8c14-a5c64fe5d4f3 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:22.047358 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139381b5-a43c-4463-b75d-9030dae4e986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:22.047977 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139381b5-a43c-4463-b75d-9030dae4e986 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:22.048248 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139381b5-a43c-4463-b75d-9030dae4e986 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:22.048517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139381b5-a43c-4463-b75d-9030dae4e986 None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:22.049149 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139381b5-a43c-4463-b75d-9030dae4e986 None admin] RBAC: Adding query filter params (type=network) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:22.049446 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139381b5-a43c-4463-b75d-9030dae4e986 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:22.050905 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139381b5-a43c-4463-b75d-9030dae4e986 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:22.057272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 355/718] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Aug 11 09:41:21 2022] GET /identity/v3/services?type=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:22.093468 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bddb47-4212-4565-a426-631e98a77085 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:22.131323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5bd29-7499-449c-bd81-a73351d3b3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:22.131938 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5bd29-7499-449c-bd81-a73351d3b3a8 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:22.132211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5bd29-7499-449c-bd81-a73351d3b3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:22.132471 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5bd29-7499-449c-bd81-a73351d3b3a8 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:22.133175 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5bd29-7499-449c-bd81-a73351d3b3a8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:22.133477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5bd29-7499-449c-bd81-a73351d3b3a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:22.134895 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5bd29-7499-449c-bd81-a73351d3b3a8 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:22.141186 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 364/719] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Aug 11 09:41:21 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:23.726357 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee2a68-1561-4376-8f54-19d39b64f478 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:23.726928 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee2a68-1561-4376-8f54-19d39b64f478 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:23.726928 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee2a68-1561-4376-8f54-19d39b64f478 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:23.729267 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 356/720] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:23.735215 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613c63c-2100-48b1-85ff-64db37bd9aab None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:23.735691 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613c63c-2100-48b1-85ff-64db37bd9aab None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:23.735919 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613c63c-2100-48b1-85ff-64db37bd9aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:23.764961 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-0613c63c-2100-48b1-85ff-64db37bd9aab None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:23.766185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-0613c63c-2100-48b1-85ff-64db37bd9aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:23.827754 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64062b-6109-45cd-b61a-6dc41d126384 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:23.827754 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64062b-6109-45cd-b61a-6dc41d126384 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:23.827754 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64062b-6109-45cd-b61a-6dc41d126384 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:23.828582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 357/721] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:23.834685 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17af207-7578-455e-abc7-3ebcf9422194 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:23.835951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17af207-7578-455e-abc7-3ebcf9422194 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:23.836504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17af207-7578-455e-abc7-3ebcf9422194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:23.867200 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-e17af207-7578-455e-abc7-3ebcf9422194 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:23.868968 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-e17af207-7578-455e-abc7-3ebcf9422194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:23.890564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 365/722] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:41:23.924475 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613c63c-2100-48b1-85ff-64db37bd9aab None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:23.979885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 358/723] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:41:24.030496 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:24.072959 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17af207-7578-455e-abc7-3ebcf9422194 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:24.095884 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613c63c-2100-48b1-85ff-64db37bd9aab None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:24.136391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba327ec-8ce1-40b9-9990-cf865ccd907d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:24.137028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba327ec-8ce1-40b9-9990-cf865ccd907d None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:24.137297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba327ec-8ce1-40b9-9990-cf865ccd907d None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:24.137564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba327ec-8ce1-40b9-9990-cf865ccd907d None admin] PATH_INFO: `/v3/roles/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:24.162632 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba327ec-8ce1-40b9-9990-cf865ccd907d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:24.175580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-cba327ec-8ce1-40b9-9990-cf865ccd907d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:24.175580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:24.175580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:24.175580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:24.175580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:24.175580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:24.175580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:24.175580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:24.175580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:24.175580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:24.175580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:24.175580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:24.175580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:24.175580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:24.175580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:24.175580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:24.176668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:24.176668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:24.176668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:24.176668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:24.176668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:24.176668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:24.176668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:24.176668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:24.176668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:24.176668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:24.176668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:24.176668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:24.176668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:24.176668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:24.176668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:24.176668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:24.178243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:24.178243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:24.178243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:24.178243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:24.178243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:24.178243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:24.178243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:24.178243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:24.178243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:24.178243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:24.178243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:24.178243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:24.178243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 366/724] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Aug 11 09:41:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:41:24.184300 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba327ec-8ce1-40b9-9990-cf865ccd907d None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:24.193244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:24.249743 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17af207-7578-455e-abc7-3ebcf9422194 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:24.316035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:24.317551 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae050b-784a-4ffb-979c-d36374eb4423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:24.319020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae050b-784a-4ffb-979c-d36374eb4423 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:24.319490 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae050b-784a-4ffb-979c-d36374eb4423 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:24.320158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae050b-784a-4ffb-979c-d36374eb4423 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:24.326883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba327ec-8ce1-40b9-9990-cf865ccd907d None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:24.335681 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae050b-784a-4ffb-979c-d36374eb4423 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:24.341400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-99ae050b-784a-4ffb-979c-d36374eb4423 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:41:24.341400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:24.341400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:24.341400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:24.341400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:24.341400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:24.341400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:24.341400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:24.341400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:24.341400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:24.341400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:24.341400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:24.341400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:24.341400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:24.341400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:24.341400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:24.343174 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:24.343174 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:24.343174 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:24.343174 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:24.343174 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:24.343174 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:24.343174 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:24.343174 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:24.343174 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:24.343174 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:24.343174 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:24.343174 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:24.343174 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:24.343174 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:24.343174 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:24.343174 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:24.344141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:24.344141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:24.344141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:24.344141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:24.344141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:24.344141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:24.344141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:24.344141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:24.344141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:24.344141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:24.344141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:41:24.344141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:24.344141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 359/725] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:41:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:41:24.348017 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7138b22-3f80-4e7a-ab4d-f8c2638ebaea None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:24.348017 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7138b22-3f80-4e7a-ab4d-f8c2638ebaea None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:24.348017 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7138b22-3f80-4e7a-ab4d-f8c2638ebaea None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:24.351176 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 360/726] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:24.352241 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7138b22-3f80-4e7a-ab4d-f8c2638ebaea None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:24.377479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fd8d3-c189-4273-be01-de5768f01dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:24.378107 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fd8d3-c189-4273-be01-de5768f01dc1 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:24.378462 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fd8d3-c189-4273-be01-de5768f01dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:24.378732 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fd8d3-c189-4273-be01-de5768f01dc1 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:24.379402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fd8d3-c189-4273-be01-de5768f01dc1 None admin] RBAC: Adding query filter params (name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:24.379699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fd8d3-c189-4273-be01-de5768f01dc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:24.381057 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fd8d3-c189-4273-be01-de5768f01dc1 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:24.390022 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 367/727] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Aug 11 09:41:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:41:24.391337 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa4de5-4eba-4a49-a940-61ea373cde65 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:24.391621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa4de5-4eba-4a49-a940-61ea373cde65 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:24.391894 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa4de5-4eba-4a49-a940-61ea373cde65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:24.414998 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-adfa4de5-4eba-4a49-a940-61ea373cde65 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:24.416726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-adfa4de5-4eba-4a49-a940-61ea373cde65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:24.477574 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7138b22-3f80-4e7a-ab4d-f8c2638ebaea None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:24.506370 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 368/728] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:41:24.507428 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa4de5-4eba-4a49-a940-61ea373cde65 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:24.509694 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:24.519717 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e393fa0-b5b9-4388-b723-9a5eeb72ffd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:24.520542 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e393fa0-b5b9-4388-b723-9a5eeb72ffd6 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:24.521456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e393fa0-b5b9-4388-b723-9a5eeb72ffd6 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:24.521888 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e393fa0-b5b9-4388-b723-9a5eeb72ffd6 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:24.522750 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e393fa0-b5b9-4388-b723-9a5eeb72ffd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:24.523203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e393fa0-b5b9-4388-b723-9a5eeb72ffd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:24.525360 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e393fa0-b5b9-4388-b723-9a5eeb72ffd6 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:24.538995 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 361/729] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:41:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:24.544524 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e393fa0-b5b9-4388-b723-9a5eeb72ffd6 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:24.615710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:24.640250 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa4de5-4eba-4a49-a940-61ea373cde65 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:24.657545 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e393fa0-b5b9-4388-b723-9a5eeb72ffd6 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:24.681204 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406ec07-92fb-448a-bc69-94ce50792c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:24.681829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406ec07-92fb-448a-bc69-94ce50792c86 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:24.682180 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406ec07-92fb-448a-bc69-94ce50792c86 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:24.682450 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406ec07-92fb-448a-bc69-94ce50792c86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:24.693582 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406ec07-92fb-448a-bc69-94ce50792c86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:24.695040 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406ec07-92fb-448a-bc69-94ce50792c86 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:24.695909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba1205-91a5-4e26-bcd1-df42bb22a8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:24.697607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba1205-91a5-4e26-bcd1-df42bb22a8d1 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:24.698175 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba1205-91a5-4e26-bcd1-df42bb22a8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:24.698613 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba1205-91a5-4e26-bcd1-df42bb22a8d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:24.709829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba1205-91a5-4e26-bcd1-df42bb22a8d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:24.714668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-0406ec07-92fb-448a-bc69-94ce50792c86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:24.714668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:24.714668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:24.714668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:24.714668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:24.714668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:24.714668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:24.714668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:24.714668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:24.714668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:24.714668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:24.714668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:24.714668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:24.714668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:24.714668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:24.714668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:24.715810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:24.715810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:24.715810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:24.715810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:24.715810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:24.715810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:24.715810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:24.715810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:24.715810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:24.715810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:24.715810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:24.715810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:24.715810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:24.715810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:24.715810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:24.715810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:24.715810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:24.716921 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:24.716921 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:24.716921 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:24.718352 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 369/730] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:24.718557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-a7ba1205-91a5-4e26-bcd1-df42bb22a8d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:41:24.718557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:24.718557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:24.718557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:24.718557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:24.718557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:24.718557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:24.718557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:24.718557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:24.718557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:24.718557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:24.718557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:24.718557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:24.718557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:24.718557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:24.718557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:24.719623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:24.719623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:24.719623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:24.719623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:24.719623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:24.719623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:24.719623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:24.719623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:24.719623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:24.719623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:24.719623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:24.719623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:24.719623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:24.719623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:24.719623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:24.719623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:24.720550 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:24.720550 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:24.720550 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:24.720550 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:24.720550 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:24.720550 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:24.720550 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:24.720550 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:24.720550 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:24.720550 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:24.720550 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:41:24.720550 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:24.721187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406ec07-92fb-448a-bc69-94ce50792c86 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:24.727700 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 362/731] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:41:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:41:24.727700 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba1205-91a5-4e26-bcd1-df42bb22a8d1 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:24.796353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:24.868611 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba1205-91a5-4e26-bcd1-df42bb22a8d1 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:24.883550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406ec07-92fb-448a-bc69-94ce50792c86 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:24.907644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f44fca-ddb9-4a4e-bed1-87526d908dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:24.908251 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f44fca-ddb9-4a4e-bed1-87526d908dcb None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:24.908525 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f44fca-ddb9-4a4e-bed1-87526d908dcb None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:24.908794 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f44fca-ddb9-4a4e-bed1-87526d908dcb None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:24.909426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f44fca-ddb9-4a4e-bed1-87526d908dcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:24.909726 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f44fca-ddb9-4a4e-bed1-87526d908dcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:24.911116 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f44fca-ddb9-4a4e-bed1-87526d908dcb None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:24.919025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb891f-8100-4fe9-a314-9d764ffcf696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:24.919644 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb891f-8100-4fe9-a314-9d764ffcf696 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:24.919968 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb891f-8100-4fe9-a314-9d764ffcf696 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:24.920273 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb891f-8100-4fe9-a314-9d764ffcf696 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:24.922316 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:24.923975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 363/732] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:24.924749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f44fca-ddb9-4a4e-bed1-87526d908dcb None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:24.937147 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb891f-8100-4fe9-a314-9d764ffcf696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:24.939001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb891f-8100-4fe9-a314-9d764ffcf696 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:24.953999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-d0cb891f-8100-4fe9-a314-9d764ffcf696 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:24.953999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:24.953999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:24.953999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:24.953999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:24.953999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:24.953999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:24.953999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:24.953999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:24.953999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:24.953999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:24.953999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:24.953999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:24.953999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:24.953999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:24.953999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:24.955133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:24.955133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:24.955133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:24.955133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:24.955133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:24.955133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:24.955133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:24.955133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:24.955133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:24.955133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:24.955133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:24.955133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:24.955133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:24.955133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:24.955133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:24.955133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:24.955133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:24.956047 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:24.956047 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:24.956047 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:24.956047 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 370/733] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:24.956279 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6e09c-1d85-4ecb-ada8-555b00d22e68 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:24.956487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6e09c-1d85-4ecb-ada8-555b00d22e68 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:24.956761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6e09c-1d85-4ecb-ada8-555b00d22e68 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:24.962501 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 371/734] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:24.963332 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6e09c-1d85-4ecb-ada8-555b00d22e68 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:25.030720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f44fca-ddb9-4a4e-bed1-87526d908dcb None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:25.040782 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:25.061921 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6e09c-1d85-4ecb-ada8-555b00d22e68 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:25.066272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bef77-5617-40e2-ade1-2f0fb1e09e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:25.066858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bef77-5617-40e2-ade1-2f0fb1e09e70 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:25.067131 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bef77-5617-40e2-ade1-2f0fb1e09e70 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:25.067418 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bef77-5617-40e2-ade1-2f0fb1e09e70 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:25.068077 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bef77-5617-40e2-ade1-2f0fb1e09e70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:25.068374 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bef77-5617-40e2-ade1-2f0fb1e09e70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:25.069748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bef77-5617-40e2-ade1-2f0fb1e09e70 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:25.078071 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 364/735] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:41:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:25.079339 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736af8a3-d0e6-412c-896e-ac087eed9616 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:25.079622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736af8a3-d0e6-412c-896e-ac087eed9616 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:25.079891 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736af8a3-d0e6-412c-896e-ac087eed9616 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:25.081247 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 365/736] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:25.082855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736af8a3-d0e6-412c-896e-ac087eed9616 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:25.095878 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8ee71-c080-4d10-98a4-6757992d0f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:25.096521 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8ee71-c080-4d10-98a4-6757992d0f30 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:25.096795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8ee71-c080-4d10-98a4-6757992d0f30 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:25.097088 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8ee71-c080-4d10-98a4-6757992d0f30 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:25.105601 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8ee71-c080-4d10-98a4-6757992d0f30 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:25.107159 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8ee71-c080-4d10-98a4-6757992d0f30 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:25.119876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-eab8ee71-c080-4d10-98a4-6757992d0f30 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 09:41:25.119876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:25.119876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:25.119876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:25.119876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:25.119876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:25.119876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:25.119876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:25.119876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:25.119876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:25.119876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:25.119876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:25.119876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:25.119876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:25.119876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:25.119876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:25.121001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:25.121001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:25.121001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:25.121001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:25.121001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:25.121001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:25.121001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:25.121001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:25.121001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:25.121001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:25.121001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:25.121001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:25.121001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:25.121001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:25.121001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:25.121001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:25.121001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:25.121001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:25.121988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:25.121988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:25.121988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:25.121988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:25.121988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:25.121988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:25.121988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:25.121988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:25.121988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 09:41:25.121988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:25.121988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 372/737] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Aug 11 09:41:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:25.122652 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea1b41-f4e1-46d7-a7a3-6a6f159065e5 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:25.122652 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea1b41-f4e1-46d7-a7a3-6a6f159065e5 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:25.122782 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea1b41-f4e1-46d7-a7a3-6a6f159065e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:25.142483 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-aeea1b41-f4e1-46d7-a7a3-6a6f159065e5 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:25.143703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-aeea1b41-f4e1-46d7-a7a3-6a6f159065e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:25.188970 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:25.212465 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 373/738] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:41:25.213308 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea1b41-f4e1-46d7-a7a3-6a6f159065e5 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:25.300648 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736af8a3-d0e6-412c-896e-ac087eed9616 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:25.326084 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea1b41-f4e1-46d7-a7a3-6a6f159065e5 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:25.333097 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db7bed-a93a-48cc-9b5b-fb60d79ef2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:25.333696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db7bed-a93a-48cc-9b5b-fb60d79ef2cd None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:25.333967 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db7bed-a93a-48cc-9b5b-fb60d79ef2cd None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:25.334263 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db7bed-a93a-48cc-9b5b-fb60d79ef2cd None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:25.334889 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db7bed-a93a-48cc-9b5b-fb60d79ef2cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:25.335186 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db7bed-a93a-48cc-9b5b-fb60d79ef2cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:25.336534 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db7bed-a93a-48cc-9b5b-fb60d79ef2cd None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:25.348567 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 366/739] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:25.350015 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828b47c-2ae4-4cbe-85c8-3b9161e075b1 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:25.350324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828b47c-2ae4-4cbe-85c8-3b9161e075b1 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:25.350595 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828b47c-2ae4-4cbe-85c8-3b9161e075b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:25.363892 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2200c-05ed-48b9-98b2-2dbb36ebc119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:25.364518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2200c-05ed-48b9-98b2-2dbb36ebc119 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:25.364792 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2200c-05ed-48b9-98b2-2dbb36ebc119 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:25.365057 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2200c-05ed-48b9-98b2-2dbb36ebc119 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:25.367823 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-2828b47c-2ae4-4cbe-85c8-3b9161e075b1 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:25.369580 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-2828b47c-2ae4-4cbe-85c8-3b9161e075b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:25.375436 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2200c-05ed-48b9-98b2-2dbb36ebc119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:25.376857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2200c-05ed-48b9-98b2-2dbb36ebc119 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:25.390764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-b3d2200c-05ed-48b9-98b2-2dbb36ebc119 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:25.390764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:25.390764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:25.390764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:25.390764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:25.390764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:25.390764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:25.390764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:25.390764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:25.390764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:25.390764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:25.390764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:25.390764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:25.390764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:25.390764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:25.390764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:25.391883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:25.391883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:25.391883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:25.391883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:25.391883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:25.391883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:25.391883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:25.391883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:25.391883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:25.391883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:25.391883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:25.391883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:25.391883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:25.391883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:25.391883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:25.391883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:25.391883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:25.393229 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:25.393229 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:25.393229 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:25.393229 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 374/740] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:25.393229 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2200c-05ed-48b9-98b2-2dbb36ebc119 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:25.393954 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:25.428846 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:25.442195 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 367/741] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 09:41:25.443015 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828b47c-2ae4-4cbe-85c8-3b9161e075b1 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:25.500609 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2200c-05ed-48b9-98b2-2dbb36ebc119 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:25.534242 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48401acf-8fd3-47d9-a143-7d74b28fea2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:25.534830 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48401acf-8fd3-47d9-a143-7d74b28fea2e None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:25.535101 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48401acf-8fd3-47d9-a143-7d74b28fea2e None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:25.535378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48401acf-8fd3-47d9-a143-7d74b28fea2e None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:25.536080 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48401acf-8fd3-47d9-a143-7d74b28fea2e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:25.536377 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48401acf-8fd3-47d9-a143-7d74b28fea2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:25.537772 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48401acf-8fd3-47d9-a143-7d74b28fea2e None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:25.539130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828b47c-2ae4-4cbe-85c8-3b9161e075b1 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:25.555247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 375/742] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Aug 11 09:41:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:25.556506 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48401acf-8fd3-47d9-a143-7d74b28fea2e None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:25.577627 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7bd1ca-17d9-47c8-a2f4-c70827c9ae9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:25.578260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bd1ca-17d9-47c8-a2f4-c70827c9ae9b None admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:25.578543 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bd1ca-17d9-47c8-a2f4-c70827c9ae9b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:25.578809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bd1ca-17d9-47c8-a2f4-c70827c9ae9b None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:25.579446 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7bd1ca-17d9-47c8-a2f4-c70827c9ae9b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:25.580846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7bd1ca-17d9-47c8-a2f4-c70827c9ae9b None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:25.637185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:25.652167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48401acf-8fd3-47d9-a143-7d74b28fea2e None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:25.682022 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 368/743] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Aug 11 09:41:25 2022] POST /identity/v3/services => generated 240 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:41:25.682903 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7bd1ca-17d9-47c8-a2f4-c70827c9ae9b None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:25.700536 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d05e67-ade2-4d57-ae00-bb3a009044b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:25.701217 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d05e67-ade2-4d57-ae00-bb3a009044b5 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:25.701488 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d05e67-ade2-4d57-ae00-bb3a009044b5 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:25.701753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d05e67-ade2-4d57-ae00-bb3a009044b5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:25.711016 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d05e67-ade2-4d57-ae00-bb3a009044b5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:25.712482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d05e67-ade2-4d57-ae00-bb3a009044b5 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:25.722465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:25.724477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-62d05e67-ade2-4d57-ae00-bb3a009044b5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 09:41:25.724477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:25.724477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:25.724477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:25.724477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:25.724477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:25.724477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:25.724477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:25.724477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:25.724477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:25.724477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:25.724477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:25.724477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:25.724477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:25.724477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:25.724477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:25.725434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:25.725434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:25.725434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:25.725434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:25.725434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:25.725434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:25.725434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:25.725434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:25.725434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:25.725434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:25.725434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:25.725434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:25.725434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:25.725434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:25.725434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:25.725434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:25.725434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:25.725434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:25.726546 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:25.726546 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:25.726546 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:25.726546 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:25.726546 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:25.726546 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:25.726546 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:25.726546 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:25.726546 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 09:41:25.726546 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:25.726546 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 376/744] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Aug 11 09:41:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:25.727185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d05e67-ade2-4d57-ae00-bb3a009044b5 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:25.816547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7bd1ca-17d9-47c8-a2f4-c70827c9ae9b None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:25.848349 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d05e67-ade2-4d57-ae00-bb3a009044b5 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:25.856970 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9d23f-aada-48a5-a419-735a6bac8e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:25.857457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9d23f-aada-48a5-a419-735a6bac8e8c None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:25.857852 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9d23f-aada-48a5-a419-735a6bac8e8c None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:25.858146 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9d23f-aada-48a5-a419-735a6bac8e8c None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:25.858788 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9d23f-aada-48a5-a419-735a6bac8e8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:25.859082 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9d23f-aada-48a5-a419-735a6bac8e8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:25.860561 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9d23f-aada-48a5-a419-735a6bac8e8c None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:25.875261 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 369/745] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:25.876137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9d23f-aada-48a5-a419-735a6bac8e8c None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:25.884958 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdeeda4-d3b0-402a-b3df-4401d2c7cab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:25.885571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdeeda4-d3b0-402a-b3df-4401d2c7cab0 None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:25.885850 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdeeda4-d3b0-402a-b3df-4401d2c7cab0 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:25.886145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdeeda4-d3b0-402a-b3df-4401d2c7cab0 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:25.886781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdeeda4-d3b0-402a-b3df-4401d2c7cab0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:25.888152 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdeeda4-d3b0-402a-b3df-4401d2c7cab0 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:25.957036 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 377/746] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Aug 11 09:41:25 2022] POST /identity/v3/services => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:41:25.958728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdeeda4-d3b0-402a-b3df-4401d2c7cab0 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:25.966869 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:25.967225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:25.984553 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9d23f-aada-48a5-a419-735a6bac8e8c None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:26.037557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b42a33-4f97-40ac-8ca5-829456903150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:26.038327 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b42a33-4f97-40ac-8ca5-829456903150 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:26.038665 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b42a33-4f97-40ac-8ca5-829456903150 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:26.038996 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b42a33-4f97-40ac-8ca5-829456903150 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:26.107640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdeeda4-d3b0-402a-b3df-4401d2c7cab0 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:26.120822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b42a33-4f97-40ac-8ca5-829456903150 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:26.122972 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b42a33-4f97-40ac-8ca5-829456903150 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:26.148222 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e40c09-e49f-48b2-91af-691175145db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:26.148986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e40c09-e49f-48b2-91af-691175145db6 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:26.149395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e40c09-e49f-48b2-91af-691175145db6 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:26.149758 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e40c09-e49f-48b2-91af-691175145db6 None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:26.150621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e40c09-e49f-48b2-91af-691175145db6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:26.152003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e40c09-e49f-48b2-91af-691175145db6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:26.153431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e40c09-e49f-48b2-91af-691175145db6 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:26.179746 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 378/747] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Aug 11 09:41:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:26.181500 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e40c09-e49f-48b2-91af-691175145db6 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:26.228832 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:26.247495 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 370/748] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:41:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 09:41:26.248919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b42a33-4f97-40ac-8ca5-829456903150 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:26.255697 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:26.313383 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e40c09-e49f-48b2-91af-691175145db6 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:26.362015 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88b3e9-eac2-4bfe-a5fc-cb380d900590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:26.362239 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b42a33-4f97-40ac-8ca5-829456903150 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:26.363028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88b3e9-eac2-4bfe-a5fc-cb380d900590 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:26.363767 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88b3e9-eac2-4bfe-a5fc-cb380d900590 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:26.364199 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88b3e9-eac2-4bfe-a5fc-cb380d900590 None admin] PATH_INFO: `/v3/users/swift` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:26.374392 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea88b3e9-eac2-4bfe-a5fc-cb380d900590 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:26.376576 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea88b3e9-eac2-4bfe-a5fc-cb380d900590 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:26.392699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-ea88b3e9-eac2-4bfe-a5fc-cb380d900590 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 11 09:41:26.392699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:26.392699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:26.392699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:26.392699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:26.392699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:26.392699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:26.392699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:26.392699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:26.392699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:26.392699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:26.392699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:26.392699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:26.392699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:26.392699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:26.392699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:26.393854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:26.393854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:26.393854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:26.393854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:26.393854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:26.393854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:26.393854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:26.393854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:26.393854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:26.393854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:26.393854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:26.393854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:26.393854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:26.393854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:26.393854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:26.393854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:26.393854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:26.393854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:26.395041 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:26.395041 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:26.395041 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:26.395041 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:26.395041 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:26.395041 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:26.395041 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:26.395041 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:26.395041 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 11 09:41:26.395041 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:26.397668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 379/749] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:41:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:26.398769 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88b3e9-eac2-4bfe-a5fc-cb380d900590 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:26.401725 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70621411-24e4-4c06-9636-340a4bb79bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:26.402641 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70621411-24e4-4c06-9636-340a4bb79bd8 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:26.403020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70621411-24e4-4c06-9636-340a4bb79bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:26.404419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70621411-24e4-4c06-9636-340a4bb79bd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:26.415799 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70621411-24e4-4c06-9636-340a4bb79bd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:26.417443 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70621411-24e4-4c06-9636-340a4bb79bd8 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:26.433919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-70621411-24e4-4c06-9636-340a4bb79bd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:26.433919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:26.433919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:26.433919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:26.433919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:26.433919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:26.433919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:26.433919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:26.433919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:26.433919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:26.433919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:26.433919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:26.433919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:26.433919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:26.433919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:26.433919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:26.435164 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:26.435164 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:26.435164 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:26.435164 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:26.435164 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:26.435164 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:26.435164 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:26.435164 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:26.435164 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:26.435164 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:26.435164 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:26.435164 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:26.435164 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:26.435164 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:26.435164 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:26.435164 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:26.435164 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:26.436313 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:26.436313 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:26.436313 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:26.437769 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 371/750] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:26.438662 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70621411-24e4-4c06-9636-340a4bb79bd8 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:26.470960 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:26.525631 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88b3e9-eac2-4bfe-a5fc-cb380d900590 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:26.551757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:26.555553 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70621411-24e4-4c06-9636-340a4bb79bd8 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:26.569913 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a3a55-e439-44bb-9e85-b357e5288be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:26.571207 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a3a55-e439-44bb-9e85-b357e5288be6 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:26.571719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a3a55-e439-44bb-9e85-b357e5288be6 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:26.572093 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a3a55-e439-44bb-9e85-b357e5288be6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:26.588400 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a3a55-e439-44bb-9e85-b357e5288be6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:26.589969 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a3a55-e439-44bb-9e85-b357e5288be6 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:26.592851 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88417a-8716-4b95-9a2f-169482c3fcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:26.593725 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88417a-8716-4b95-9a2f-169482c3fcdc None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:26.594249 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88417a-8716-4b95-9a2f-169482c3fcdc None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:26.594666 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88417a-8716-4b95-9a2f-169482c3fcdc None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:26.595535 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88417a-8716-4b95-9a2f-169482c3fcdc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:26.596004 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88417a-8716-4b95-9a2f-169482c3fcdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:26.597578 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88417a-8716-4b95-9a2f-169482c3fcdc None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:26.607460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-015a3a55-e439-44bb-9e85-b357e5288be6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:26.607460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:26.607460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:26.607460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:26.607460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:26.607460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:26.607460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:26.607460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:26.607460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:26.607460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:26.607460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:26.607460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:26.607460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:26.607460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:26.607460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:26.607460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:26.608617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:26.608617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:26.608617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:26.608617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:26.608617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:26.608617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:26.608617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:26.608617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:26.608617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:26.608617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:26.608617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:26.608617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:26.608617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:26.608617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:26.608617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:26.608617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:26.608617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:26.609725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:26.609725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:26.609725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:26.611871 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 380/751] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:26.612883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a3a55-e439-44bb-9e85-b357e5288be6 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:26.620242 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 372/752] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Aug 11 09:41:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:26.621317 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88417a-8716-4b95-9a2f-169482c3fcdc None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:26.721480 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:26.737730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88417a-8716-4b95-9a2f-169482c3fcdc None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:26.745416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a3a55-e439-44bb-9e85-b357e5288be6 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:26.776693 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a492a2-6cc1-46f4-82be-29e5ea8abb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:26.777540 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a492a2-6cc1-46f4-82be-29e5ea8abb07 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:26.777989 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a492a2-6cc1-46f4-82be-29e5ea8abb07 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:26.778432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a492a2-6cc1-46f4-82be-29e5ea8abb07 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:26.779387 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a492a2-6cc1-46f4-82be-29e5ea8abb07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:26.779950 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a492a2-6cc1-46f4-82be-29e5ea8abb07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:26.781557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a492a2-6cc1-46f4-82be-29e5ea8abb07 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:26.782436 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55359d89-3f9f-43a8-ba22-75cdf2062294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:26.783145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55359d89-3f9f-43a8-ba22-75cdf2062294 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:26.783515 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55359d89-3f9f-43a8-ba22-75cdf2062294 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:26.783886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55359d89-3f9f-43a8-ba22-75cdf2062294 None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:26.784618 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55359d89-3f9f-43a8-ba22-75cdf2062294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:26.785401 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55359d89-3f9f-43a8-ba22-75cdf2062294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:26.786500 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55359d89-3f9f-43a8-ba22-75cdf2062294 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:26.795554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 373/753] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:26.796640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a492a2-6cc1-46f4-82be-29e5ea8abb07 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:26.799444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 381/754] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:26.804293 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55359d89-3f9f-43a8-ba22-75cdf2062294 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:26.845898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:26.919440 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a492a2-6cc1-46f4-82be-29e5ea8abb07 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:26.939146 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55359d89-3f9f-43a8-ba22-75cdf2062294 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:26.964183 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dac7b-d02b-46bf-a946-36bd6bff2ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:26.965032 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dac7b-d02b-46bf-a946-36bd6bff2ec2 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:26.965523 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dac7b-d02b-46bf-a946-36bd6bff2ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:26.965866 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dac7b-d02b-46bf-a946-36bd6bff2ec2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:26.979247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee556047-d8ba-40cd-8176-f627345ee6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:26.980115 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee556047-d8ba-40cd-8176-f627345ee6b3 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:26.980604 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee556047-d8ba-40cd-8176-f627345ee6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:26.981057 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee556047-d8ba-40cd-8176-f627345ee6b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:26.984894 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:26.988956 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee556047-d8ba-40cd-8176-f627345ee6b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:26.990647 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee556047-d8ba-40cd-8176-f627345ee6b3 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:27.002505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-ee556047-d8ba-40cd-8176-f627345ee6b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:27.002505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:27.002505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:27.002505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:27.002505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:27.002505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:27.002505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:27.002505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:27.002505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:27.002505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:27.002505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:27.002505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:27.002505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:27.002505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:27.002505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:27.003505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:27.003505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:27.003505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:27.003505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:27.003505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:27.003505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:27.003505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:27.003505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:27.003505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:27.003505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:27.003505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:27.003505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:27.003505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:27.003505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:27.003505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:27.003505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:27.003505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:27.004437 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:27.004437 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:27.004437 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:27.004437 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:27.004437 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:27.004437 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:27.004437 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:27.004437 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:27.007074 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 382/755] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:27.008026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee556047-d8ba-40cd-8176-f627345ee6b3 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:27.057546 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2dac7b-d02b-46bf-a946-36bd6bff2ec2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:27.059375 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2dac7b-d02b-46bf-a946-36bd6bff2ec2 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:27.122136 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:27.135294 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee556047-d8ba-40cd-8176-f627345ee6b3 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:27.174879 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9e80b-dfaf-4527-b329-519c898609cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:27.175679 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9e80b-dfaf-4527-b329-519c898609cd None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:27.176136 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9e80b-dfaf-4527-b329-519c898609cd None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:27.176508 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9e80b-dfaf-4527-b329-519c898609cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:27.182793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 374/756] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:41:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 09:41:27.183650 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dac7b-d02b-46bf-a946-36bd6bff2ec2 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:27.189632 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9e80b-dfaf-4527-b329-519c898609cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:27.191288 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9e80b-dfaf-4527-b329-519c898609cd None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:27.206256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-c3a9e80b-dfaf-4527-b329-519c898609cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:27.206256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:27.206256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:27.206256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:27.206256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:27.206256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:27.206256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:27.206256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:27.206256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:27.206256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:27.206256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:27.206256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:27.206256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:27.206256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:27.206256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:27.207202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:27.207202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:27.207202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:27.207202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:27.207202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:27.207202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:27.207202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:27.207202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:27.207202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:27.207202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:27.207202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:27.207202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:27.207202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:27.207202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:27.207202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:27.207202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:27.207202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:27.208608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:27.208608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:27.208608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:27.208608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:27.208608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:27.208608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:27.208608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:27.208608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:27.208608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 383/757] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:27.209307 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9e80b-dfaf-4527-b329-519c898609cd None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:27.241273 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:27.298688 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dac7b-d02b-46bf-a946-36bd6bff2ec2 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:27.335952 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cc47c-64c8-4928-a765-96c28c3fad79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:27.336547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cc47c-64c8-4928-a765-96c28c3fad79 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:27.337124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cc47c-64c8-4928-a765-96c28c3fad79 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:27.337124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cc47c-64c8-4928-a765-96c28c3fad79 None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:27.337788 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cc47c-64c8-4928-a765-96c28c3fad79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:27.338098 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cc47c-64c8-4928-a765-96c28c3fad79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:27.339582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cc47c-64c8-4928-a765-96c28c3fad79 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:27.346772 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9e80b-dfaf-4527-b329-519c898609cd None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:27.354497 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 375/758] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:27.355263 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cc47c-64c8-4928-a765-96c28c3fad79 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:27.385520 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a124af-5f1c-450a-8c38-23904ef337b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:27.386515 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a124af-5f1c-450a-8c38-23904ef337b7 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:27.386938 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a124af-5f1c-450a-8c38-23904ef337b7 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:27.387375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a124af-5f1c-450a-8c38-23904ef337b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:27.401545 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a124af-5f1c-450a-8c38-23904ef337b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:27.403860 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a124af-5f1c-450a-8c38-23904ef337b7 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:27.431779 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-88a124af-5f1c-450a-8c38-23904ef337b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:27.431779 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:27.431779 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:27.431779 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:27.431779 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:27.431779 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:27.431779 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:27.431779 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:27.431779 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:27.431779 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:27.431779 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:27.431779 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:27.431779 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:27.431779 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:27.431779 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:27.431779 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:27.432939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:27.432939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:27.432939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:27.432939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:27.432939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:27.432939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:27.432939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:27.432939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:27.432939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:27.432939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:27.432939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:27.432939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:27.432939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:27.432939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:27.432939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:27.432939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:27.432939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:27.433978 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:27.433978 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:27.433978 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:27.440331 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 384/759] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:27.441433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a124af-5f1c-450a-8c38-23904ef337b7 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:27.445554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:27.473078 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cc47c-64c8-4928-a765-96c28c3fad79 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:27.480398 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:27.508349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441d233-6c4e-4cfe-8cbe-aa5ade61d533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:27.509077 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441d233-6c4e-4cfe-8cbe-aa5ade61d533 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:27.509316 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441d233-6c4e-4cfe-8cbe-aa5ade61d533 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:27.509634 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441d233-6c4e-4cfe-8cbe-aa5ade61d533 None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:27.510330 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441d233-6c4e-4cfe-8cbe-aa5ade61d533 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:27.510626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441d233-6c4e-4cfe-8cbe-aa5ade61d533 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:27.512057 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441d233-6c4e-4cfe-8cbe-aa5ade61d533 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:27.529191 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 376/760] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:27.530115 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441d233-6c4e-4cfe-8cbe-aa5ade61d533 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:27.556425 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a124af-5f1c-450a-8c38-23904ef337b7 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:27.594522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befc2a7-776b-4a9e-9df0-d0943fd67228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:27.595485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befc2a7-776b-4a9e-9df0-d0943fd67228 None admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:27.596209 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befc2a7-776b-4a9e-9df0-d0943fd67228 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:27.596685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befc2a7-776b-4a9e-9df0-d0943fd67228 None admin] PATH_INFO: `/v3/projects/a0211f5c0b174c8c998e3ad29f96baab/users/4c1dc8e0d9454ad98894ed1e8d31f931/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:27.599873 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befc2a7-776b-4a9e-9df0-d0943fd67228 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0211f5c0b174c8c998e3ad29f96baab, user_id=4c1dc8e0d9454ad98894ed1e8d31f931, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:27.602965 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befc2a7-776b-4a9e-9df0-d0943fd67228 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:27.632121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441d233-6c4e-4cfe-8cbe-aa5ade61d533 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:27.676867 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 385/761] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Aug 11 09:41:27 2022] PUT /identity/v3/projects/a0211f5c0b174c8c998e3ad29f96baab/users/4c1dc8e0d9454ad98894ed1e8d31f931/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:41:27.677969 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befc2a7-776b-4a9e-9df0-d0943fd67228 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:27.696856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e17f1-ef27-4868-95fb-e09664d71e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:27.696856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e17f1-ef27-4868-95fb-e09664d71e6d None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:27.696856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e17f1-ef27-4868-95fb-e09664d71e6d None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:27.696856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e17f1-ef27-4868-95fb-e09664d71e6d None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:27.697260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e17f1-ef27-4868-95fb-e09664d71e6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:27.697260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e17f1-ef27-4868-95fb-e09664d71e6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:27.698433 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e17f1-ef27-4868-95fb-e09664d71e6d None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:27.728196 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 377/762] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:27.731653 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e17f1-ef27-4868-95fb-e09664d71e6d None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:27.780920 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:27.793559 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:27.825312 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befc2a7-776b-4a9e-9df0-d0943fd67228 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:27.865693 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace4d3c-d110-4e14-b437-daf7acdc1275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:27.866357 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace4d3c-d110-4e14-b437-daf7acdc1275 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:27.866934 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace4d3c-d110-4e14-b437-daf7acdc1275 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:27.867533 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace4d3c-d110-4e14-b437-daf7acdc1275 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:27.868569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace4d3c-d110-4e14-b437-daf7acdc1275 None admin] RBAC: Adding query filter params (role.id=b8d32893edf5475791d4c3b9aea5a3f6, scope.project.id=a0211f5c0b174c8c998e3ad29f96baab, user.id=d392c30328a3491bb186bd7b55f4d99c) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:27.869341 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace4d3c-d110-4e14-b437-daf7acdc1275 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:27.870876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace4d3c-d110-4e14-b437-daf7acdc1275 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:27.879045 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 386/763] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:41:27 2022] GET /identity/v3/role_assignments?user.id=d392c30328a3491bb186bd7b55f4d99c&scope.project.id=a0211f5c0b174c8c998e3ad29f96baab&role.id=b8d32893edf5475791d4c3b9aea5a3f6 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:27.880280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6da4c2-540d-488b-a9d1-c8f6bc51a94a None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:27.880565 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6da4c2-540d-488b-a9d1-c8f6bc51a94a None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:27.880834 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6da4c2-540d-488b-a9d1-c8f6bc51a94a None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:27.882312 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 387/764] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:27.892006 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd9eb4-9e3a-4db3-b95a-9e2d6ea12ddb None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:27.892314 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd9eb4-9e3a-4db3-b95a-9e2d6ea12ddb None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:27.892553 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd9eb4-9e3a-4db3-b95a-9e2d6ea12ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:27.892861 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e17f1-ef27-4868-95fb-e09664d71e6d None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:27.918758 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-9bbd9eb4-9e3a-4db3-b95a-9e2d6ea12ddb None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:27.920976 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-9bbd9eb4-9e3a-4db3-b95a-9e2d6ea12ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:27.942126 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e557cd-d793-4095-884b-a4fb719f24b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:27.942809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e557cd-d793-4095-884b-a4fb719f24b2 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:27.943083 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e557cd-d793-4095-884b-a4fb719f24b2 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:27.943456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e557cd-d793-4095-884b-a4fb719f24b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:27.952202 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e557cd-d793-4095-884b-a4fb719f24b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:27.953602 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e557cd-d793-4095-884b-a4fb719f24b2 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:27.967277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-d8e557cd-d793-4095-884b-a4fb719f24b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:27.967277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:27.967277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:27.967277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:27.967277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:27.967277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:27.967277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:27.967277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:27.967277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:27.967277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:27.967277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:27.967277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:27.967277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:27.967277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:27.967277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:27.968246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:27.968246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:27.968246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:27.968246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:27.968246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:27.968246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:27.968246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:27.968246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:27.968246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:27.968246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:27.968246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:27.968246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:27.968246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:27.968246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:27.968246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:27.968246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:27.968246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:27.969696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:27.969696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:27.969696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:27.969696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:27.969696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:27.969696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:27.969696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:27.969696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:27.969696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 378/765] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:27.976457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e557cd-d793-4095-884b-a4fb719f24b2 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:28.000368 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 388/766] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:41:28.023523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd9eb4-9e3a-4db3-b95a-9e2d6ea12ddb None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:28.091597 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:28.136235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd9eb4-9e3a-4db3-b95a-9e2d6ea12ddb None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:28.139833 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:28.156654 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e557cd-d793-4095-884b-a4fb719f24b2 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:28.173679 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9aff0-4fcd-45d6-9d5d-045ec8c8b1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:28.174354 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9aff0-4fcd-45d6-9d5d-045ec8c8b1e3 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:28.174633 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9aff0-4fcd-45d6-9d5d-045ec8c8b1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:28.174906 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9aff0-4fcd-45d6-9d5d-045ec8c8b1e3 None admin] PATH_INFO: `/v3/services/network` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:28.175657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9aff0-4fcd-45d6-9d5d-045ec8c8b1e3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:28.177332 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9aff0-4fcd-45d6-9d5d-045ec8c8b1e3 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:28.188877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-1cd9aff0-4fcd-45d6-9d5d-045ec8c8b1e3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 09:41:28.188877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:28.188877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:41:28.188877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:41:28.188877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:41:28.188877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:41:28.188877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:41:28.188877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:28.188877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 09:41:28.188877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:28.188877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:41:28.188877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:28.188877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:28.188877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:28.188877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:28.188877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:28.188877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:28.189939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:28.189939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:28.189939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:28.189939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:28.189939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:28.189939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:28.189939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:41:28.189939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:41:28.189939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:41:28.189939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:41:28.189939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:28.189939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:28.189939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:28.189939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:28.189939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:28.189939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:28.190975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:28.190975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:28.190975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:28.190975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:28.190975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:28.190975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:28.190975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:28.190975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:28.190975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:28.190975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:28.190975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:41:28.190975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:28.190975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 09:41:28.190975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:28.194174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 389/767] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:28 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:28.196741 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4928cc-5c40-4a46-85f4-982b2a6206af None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:28.197371 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4928cc-5c40-4a46-85f4-982b2a6206af None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:28.197565 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4928cc-5c40-4a46-85f4-982b2a6206af None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:28.199476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 390/768] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:28.200153 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4928cc-5c40-4a46-85f4-982b2a6206af None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:28.206374 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7cd6cc-6357-4dca-a2c6-01a7fd96ecee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:28.207318 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7cd6cc-6357-4dca-a2c6-01a7fd96ecee None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:28.207819 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7cd6cc-6357-4dca-a2c6-01a7fd96ecee None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:28.208371 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7cd6cc-6357-4dca-a2c6-01a7fd96ecee None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:28.209328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7cd6cc-6357-4dca-a2c6-01a7fd96ecee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:28.210444 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7cd6cc-6357-4dca-a2c6-01a7fd96ecee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:28.213230 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7cd6cc-6357-4dca-a2c6-01a7fd96ecee None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:28.227875 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 379/769] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:28.229295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02c7a7-9a03-4a8e-acaa-e6d19dee8291 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:28.229428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02c7a7-9a03-4a8e-acaa-e6d19dee8291 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:28.229608 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02c7a7-9a03-4a8e-acaa-e6d19dee8291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:28.252276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-4f02c7a7-9a03-4a8e-acaa-e6d19dee8291 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:28.253449 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-4f02c7a7-9a03-4a8e-acaa-e6d19dee8291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:28.323796 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 380/770] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:41:28.324671 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02c7a7-9a03-4a8e-acaa-e6d19dee8291 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:28.332936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4928cc-5c40-4a46-85f4-982b2a6206af None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:28.362651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:28.384494 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0dc918-63f0-4f0d-bba5-fe16e2c079c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:28.385885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0dc918-63f0-4f0d-bba5-fe16e2c079c7 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:28.386583 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0dc918-63f0-4f0d-bba5-fe16e2c079c7 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:28.387097 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0dc918-63f0-4f0d-bba5-fe16e2c079c7 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:28.387929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0dc918-63f0-4f0d-bba5-fe16e2c079c7 None admin] RBAC: Adding query filter params (name=network) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:28.388453 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0dc918-63f0-4f0d-bba5-fe16e2c079c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:28.390247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0dc918-63f0-4f0d-bba5-fe16e2c079c7 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:28.395571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 391/771] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Aug 11 09:41:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:28.401619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0dc918-63f0-4f0d-bba5-fe16e2c079c7 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:28.415495 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:28.438998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02c7a7-9a03-4a8e-acaa-e6d19dee8291 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:28.476370 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c3375-4999-41d2-9ec2-7dcb966e12dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:28.476919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c3375-4999-41d2-9ec2-7dcb966e12dd None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:28.477215 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c3375-4999-41d2-9ec2-7dcb966e12dd None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:28.477491 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c3375-4999-41d2-9ec2-7dcb966e12dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:28.478233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c3375-4999-41d2-9ec2-7dcb966e12dd None admin] RBAC: Adding query filter params (role.id=6aae1c66f3f04cec80ed72c20d7e033b, scope.project.id=a0211f5c0b174c8c998e3ad29f96baab, user.id=f7e3b1c5aec94673b391210ae51d4cc2) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:28.478537 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c3375-4999-41d2-9ec2-7dcb966e12dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:28.479969 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c3375-4999-41d2-9ec2-7dcb966e12dd None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:28.491228 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 381/772] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:41:28 2022] GET /identity/v3/role_assignments?user.id=f7e3b1c5aec94673b391210ae51d4cc2&scope.project.id=a0211f5c0b174c8c998e3ad29f96baab&role.id=6aae1c66f3f04cec80ed72c20d7e033b => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:28.492202 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c3375-4999-41d2-9ec2-7dcb966e12dd None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:28.517559 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0dc918-63f0-4f0d-bba5-fe16e2c079c7 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:28.556551 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d98c0-e66a-423d-9ec3-70c2abc6f3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:28.557588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d98c0-e66a-423d-9ec3-70c2abc6f3ba None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:28.558131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d98c0-e66a-423d-9ec3-70c2abc6f3ba None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:28.558617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d98c0-e66a-423d-9ec3-70c2abc6f3ba None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:28.559401 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d98c0-e66a-423d-9ec3-70c2abc6f3ba None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:28.560969 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d98c0-e66a-423d-9ec3-70c2abc6f3ba None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:28.571704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-360d98c0-e66a-423d-9ec3-70c2abc6f3ba None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 09:41:28.571704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:28.571704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:41:28.571704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:41:28.571704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:41:28.571704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:41:28.571704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:41:28.571704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:28.571704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 09:41:28.571704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:28.571704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:41:28.571704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:28.571704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:28.571704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:28.571704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:28.571704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:28.571704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:28.572787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:28.572787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:28.572787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:28.572787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:28.572787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:28.572787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:28.572787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:41:28.572787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:41:28.572787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:41:28.572787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:41:28.572787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:28.572787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:28.572787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:28.572787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:28.572787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:28.572787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:28.573664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:28.573664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:28.573664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:28.573664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:28.573664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:28.573664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:28.573664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:28.573664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:28.573664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:28.573664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:28.573664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:41:28.573664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:28.573664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 09:41:28.573664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:28.576054 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 392/773] 10.222.0.13 () {56 vars in 1129 bytes} [Thu Aug 11 09:41:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:28.588057 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d98c0-e66a-423d-9ec3-70c2abc6f3ba None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:28.645793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c3375-4999-41d2-9ec2-7dcb966e12dd None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:28.687783 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d93c17-c132-4440-a97b-cf73b6f44b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:28.688393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d93c17-c132-4440-a97b-cf73b6f44b98 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:28.688676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d93c17-c132-4440-a97b-cf73b6f44b98 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:28.688930 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d93c17-c132-4440-a97b-cf73b6f44b98 None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:28.689551 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d93c17-c132-4440-a97b-cf73b6f44b98 None admin] RBAC: Adding query filter params (type=network) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:28.689846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d93c17-c132-4440-a97b-cf73b6f44b98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:28.691257 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d93c17-c132-4440-a97b-cf73b6f44b98 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:28.697393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 382/774] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Aug 11 09:41:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:28.698420 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:28.703613 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d93c17-c132-4440-a97b-cf73b6f44b98 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:28.717339 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:28.812919 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d98c0-e66a-423d-9ec3-70c2abc6f3ba None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:28.828763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d93c17-c132-4440-a97b-cf73b6f44b98 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:28.862809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352e0c8-2d20-4596-a2be-46ddab2c5dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:28.863416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352e0c8-2d20-4596-a2be-46ddab2c5dd3 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:28.863697 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352e0c8-2d20-4596-a2be-46ddab2c5dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:28.863950 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352e0c8-2d20-4596-a2be-46ddab2c5dd3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:28.864638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352e0c8-2d20-4596-a2be-46ddab2c5dd3 None admin] RBAC: Adding query filter params (interface=public, service_id=4841d60bfde14dd08e33b41fdacac060, region_id=RegionOne) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:28.865042 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352e0c8-2d20-4596-a2be-46ddab2c5dd3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:28.866471 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352e0c8-2d20-4596-a2be-46ddab2c5dd3 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:28.874918 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 383/775] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Aug 11 09:41:28 2022] GET /identity/v3/endpoints?service_id=4841d60bfde14dd08e33b41fdacac060&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:28.885879 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352e0c8-2d20-4596-a2be-46ddab2c5dd3 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:28.890953 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5d73b-53c2-4a73-82d7-cf8826e8da53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:28.891848 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5d73b-53c2-4a73-82d7-cf8826e8da53 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:28.892404 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5d73b-53c2-4a73-82d7-cf8826e8da53 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:28.892895 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5d73b-53c2-4a73-82d7-cf8826e8da53 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:28.893720 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5d73b-53c2-4a73-82d7-cf8826e8da53 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:28.894285 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5d73b-53c2-4a73-82d7-cf8826e8da53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:28.895850 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5d73b-53c2-4a73-82d7-cf8826e8da53 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:28.901204 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 393/776] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Aug 11 09:41:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:28.906822 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5d73b-53c2-4a73-82d7-cf8826e8da53 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:29.010691 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:29.072102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352e0c8-2d20-4596-a2be-46ddab2c5dd3 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:29.102377 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5d73b-53c2-4a73-82d7-cf8826e8da53 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:29.123263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:29.139400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d354d3b-f386-4472-b4de-2e2550413b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:29.140199 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d354d3b-f386-4472-b4de-2e2550413b49 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:29.140314 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d354d3b-f386-4472-b4de-2e2550413b49 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:29.140510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d354d3b-f386-4472-b4de-2e2550413b49 None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:29.141148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d354d3b-f386-4472-b4de-2e2550413b49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:29.142586 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d354d3b-f386-4472-b4de-2e2550413b49 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:29.149696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11065228-b043-4afb-8104-9849d7f285b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:29.150535 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11065228-b043-4afb-8104-9849d7f285b1 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:29.150993 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11065228-b043-4afb-8104-9849d7f285b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:29.151693 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11065228-b043-4afb-8104-9849d7f285b1 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:29.152601 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11065228-b043-4afb-8104-9849d7f285b1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:29.153081 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11065228-b043-4afb-8104-9849d7f285b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:29.153808 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 384/777] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Aug 11 09:41:28 2022] GET /identity/v3/services => generated 772 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:29.162111 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11065228-b043-4afb-8104-9849d7f285b1 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:29.168716 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 394/778] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Aug 11 09:41:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:29.175003 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d354d3b-f386-4472-b4de-2e2550413b49 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:29.337899 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d354d3b-f386-4472-b4de-2e2550413b49 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:29.369597 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:29.383010 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef801eac-f4f6-4689-9fd8-aab4961b7d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:29.383779 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef801eac-f4f6-4689-9fd8-aab4961b7d18 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:29.384063 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef801eac-f4f6-4689-9fd8-aab4961b7d18 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:29.384632 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef801eac-f4f6-4689-9fd8-aab4961b7d18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:29.385365 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef801eac-f4f6-4689-9fd8-aab4961b7d18 None admin] RBAC: Adding query filter params (interface=public, service_id=99feb69da3304908a3d326c576aa2926, region_id=RegionOne) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:29.385666 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef801eac-f4f6-4689-9fd8-aab4961b7d18 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:29.387125 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef801eac-f4f6-4689-9fd8-aab4961b7d18 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:29.393397 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 385/779] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Aug 11 09:41:29 2022] GET /identity/v3/endpoints?service_id=99feb69da3304908a3d326c576aa2926&interface=public®ion_id=RegionOne => generated 194 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:29.399742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11065228-b043-4afb-8104-9849d7f285b1 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:29.529296 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11065228-b043-4afb-8104-9849d7f285b1 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:29.574971 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ca22a-b7c7-4931-a1c3-da1168b03620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:29.575583 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ca22a-b7c7-4931-a1c3-da1168b03620 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:29.575860 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ca22a-b7c7-4931-a1c3-da1168b03620 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:29.576131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ca22a-b7c7-4931-a1c3-da1168b03620 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:29.576733 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ca22a-b7c7-4931-a1c3-da1168b03620 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:29.578100 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ca22a-b7c7-4931-a1c3-da1168b03620 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:29.583402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 395/780] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Aug 11 09:41:29 2022] GET /identity/v3/services => generated 772 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:30.209762 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2f3d5-6187-4b5a-8ad4-1a6cc0102fa7 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:30.210337 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2f3d5-6187-4b5a-8ad4-1a6cc0102fa7 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:30.210337 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2f3d5-6187-4b5a-8ad4-1a6cc0102fa7 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:30.211967 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 386/781] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:30.217094 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f0e49-45f9-4f18-9462-7b8794044374 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:30.217530 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f0e49-45f9-4f18-9462-7b8794044374 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:30.217610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f0e49-45f9-4f18-9462-7b8794044374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:30.235455 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-105f0e49-45f9-4f18-9462-7b8794044374 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:30.236631 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-105f0e49-45f9-4f18-9462-7b8794044374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:30.279753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:30.323982 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 396/782] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:41:30.358362 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2f3d5-6187-4b5a-8ad4-1a6cc0102fa7 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:30.368591 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc97004-d4c7-4d35-af1b-68abd6c54702 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:30.368868 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc97004-d4c7-4d35-af1b-68abd6c54702 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:30.369136 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc97004-d4c7-4d35-af1b-68abd6c54702 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:30.372555 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 397/783] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:30 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:30.375760 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e3476-1468-40bf-9f17-76b969788a20 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:30.376035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e3476-1468-40bf-9f17-76b969788a20 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:30.376302 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e3476-1468-40bf-9f17-76b969788a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:30.410810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-851e3476-1468-40bf-9f17-76b969788a20 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:30.411996 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-851e3476-1468-40bf-9f17-76b969788a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:30.511496 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2f3d5-6187-4b5a-8ad4-1a6cc0102fa7 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:30.531254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 398/784] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:41:30.564300 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e3476-1468-40bf-9f17-76b969788a20 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:30.586971 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0948d0e-d211-4113-8999-601527184af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:30.587611 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0948d0e-d211-4113-8999-601527184af3 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:30.587925 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0948d0e-d211-4113-8999-601527184af3 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:30.588239 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0948d0e-d211-4113-8999-601527184af3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:30.612259 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0948d0e-d211-4113-8999-601527184af3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:30.616906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-e0948d0e-d211-4113-8999-601527184af3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:41:30.616906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:30.616906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:30.616906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:30.616906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:30.616906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:30.616906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:30.616906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:30.616906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:30.616906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:30.616906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:30.616906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:30.616906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:30.616906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:30.616906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:30.616906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:30.618429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:30.618429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:30.618429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:30.618429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:30.618429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:30.618429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:30.618429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:30.618429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:30.618429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:30.618429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:30.618429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:30.618429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:30.618429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:30.618429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:30.618429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:30.618429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:30.619286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:30.619286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:30.619286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:30.619286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:30.619286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:30.619286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:30.619286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:30.619286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:30.619286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:30.619286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:30.619286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:41:30.619286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:30.629361 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 387/785] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:41:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:30.630337 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0948d0e-d211-4113-8999-601527184af3 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:30.726285 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:30.773948 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e3476-1468-40bf-9f17-76b969788a20 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:30.775625 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:30.776217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0948d0e-d211-4113-8999-601527184af3 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:30.819967 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902027e0-5f0a-472b-8d6f-ec53d603a805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:30.820977 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902027e0-5f0a-472b-8d6f-ec53d603a805 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:30.821253 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902027e0-5f0a-472b-8d6f-ec53d603a805 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:30.821520 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902027e0-5f0a-472b-8d6f-ec53d603a805 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:30.822227 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902027e0-5f0a-472b-8d6f-ec53d603a805 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:30.822586 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902027e0-5f0a-472b-8d6f-ec53d603a805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:30.824015 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902027e0-5f0a-472b-8d6f-ec53d603a805 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:30.833350 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 388/786] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:41:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:30.839327 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902027e0-5f0a-472b-8d6f-ec53d603a805 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:30.867064 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e4d03-d0f4-450e-9854-2e347697a96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:30.867892 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e4d03-d0f4-450e-9854-2e347697a96d None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:30.868170 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e4d03-d0f4-450e-9854-2e347697a96d None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:30.868749 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e4d03-d0f4-450e-9854-2e347697a96d None admin] PATH_INFO: `/v3/roles/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:30.881756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e4d03-d0f4-450e-9854-2e347697a96d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:30.887119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-d07e4d03-d0f4-450e-9854-2e347697a96d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:30.887119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:30.887119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:30.887119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:30.887119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:30.887119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:30.887119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:30.887119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:30.887119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:30.887119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:30.887119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:30.887119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:30.887119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:30.887119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:30.887119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:30.887119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:30.888069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:30.888069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:30.888069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:30.888069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:30.888069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:30.888069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:30.888069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:30.888069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:30.888069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:30.888069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:30.888069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:30.888069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:30.888069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:30.888069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:30.888069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:30.888069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:30.889472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:30.889472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:30.889472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:30.889472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:30.889472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:30.889472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:30.889472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:30.889472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:30.889472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:30.889472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:30.889472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:30.889472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:30.889472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 399/787] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Aug 11 09:41:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:41:30.890418 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc972a-7508-4b10-982c-ea345da29cc8 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:30.890418 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc972a-7508-4b10-982c-ea345da29cc8 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:30.890691 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc972a-7508-4b10-982c-ea345da29cc8 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:30.894321 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 400/788] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:30.895099 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc972a-7508-4b10-982c-ea345da29cc8 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:30.953011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902027e0-5f0a-472b-8d6f-ec53d603a805 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:30.970112 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:30.987072 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0a26c-98bc-49b1-b8b1-25f8325552f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:30.987797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0a26c-98bc-49b1-b8b1-25f8325552f8 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:30.988058 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0a26c-98bc-49b1-b8b1-25f8325552f8 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:30.988321 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0a26c-98bc-49b1-b8b1-25f8325552f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:30.998749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0a26c-98bc-49b1-b8b1-25f8325552f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:31.000256 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0a26c-98bc-49b1-b8b1-25f8325552f8 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:31.009943 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc972a-7508-4b10-982c-ea345da29cc8 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:31.015167 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-aec0a26c-98bc-49b1-b8b1-25f8325552f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:31.015167 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:31.015167 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:31.015167 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:31.015167 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:31.015167 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:31.015167 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:31.015167 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:31.015167 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:31.015167 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:31.015167 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:31.015167 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:31.015167 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:31.015167 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:31.015167 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:31.015167 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:31.017379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:31.017379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:31.017379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:31.017379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:31.017379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:31.017379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:31.017379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:31.017379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:31.017379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:31.017379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:31.017379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:31.017379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:31.017379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:31.017379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:31.017379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:31.017379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:31.017379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:31.019560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:31.019560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:31.019560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:31.022121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 389/789] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:41:31.022121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb4e3e-0174-457a-b86a-92b450741a88 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:31.022399 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb4e3e-0174-457a-b86a-92b450741a88 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:31.022671 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb4e3e-0174-457a-b86a-92b450741a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:31.041262 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-73fb4e3e-0174-457a-b86a-92b450741a88 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:31.042447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-73fb4e3e-0174-457a-b86a-92b450741a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:31.049210 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a35a43-f261-4637-a3f4-f96d404f195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:31.049995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a35a43-f261-4637-a3f4-f96d404f195c None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:31.050597 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a35a43-f261-4637-a3f4-f96d404f195c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:31.051011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a35a43-f261-4637-a3f4-f96d404f195c None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:31.051808 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a35a43-f261-4637-a3f4-f96d404f195c None admin] RBAC: Adding query filter params (name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:31.052439 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a35a43-f261-4637-a3f4-f96d404f195c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:31.054075 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a35a43-f261-4637-a3f4-f96d404f195c None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:31.068461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 401/790] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Aug 11 09:41:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:31.069666 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a35a43-f261-4637-a3f4-f96d404f195c None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:31.097993 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:31.111253 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 390/791] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:41:31.112161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb4e3e-0174-457a-b86a-92b450741a88 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:31.184488 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a35a43-f261-4637-a3f4-f96d404f195c None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:31.223755 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa55ea-ce4f-4d03-ae1e-d6808eb2b312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:31.225143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa55ea-ce4f-4d03-ae1e-d6808eb2b312 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:31.225664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa55ea-ce4f-4d03-ae1e-d6808eb2b312 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:31.226097 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa55ea-ce4f-4d03-ae1e-d6808eb2b312 None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:31.226925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa55ea-ce4f-4d03-ae1e-d6808eb2b312 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:31.227399 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa55ea-ce4f-4d03-ae1e-d6808eb2b312 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:31.229090 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa55ea-ce4f-4d03-ae1e-d6808eb2b312 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:31.234429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:31.237157 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb4e3e-0174-457a-b86a-92b450741a88 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:31.243777 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 402/792] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:31.244902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa55ea-ce4f-4d03-ae1e-d6808eb2b312 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:31.285438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947845d7-5ad9-4b2d-96a3-6bc1b173364b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:31.286679 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947845d7-5ad9-4b2d-96a3-6bc1b173364b None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:31.287157 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947845d7-5ad9-4b2d-96a3-6bc1b173364b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:31.288009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947845d7-5ad9-4b2d-96a3-6bc1b173364b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:31.302166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947845d7-5ad9-4b2d-96a3-6bc1b173364b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:31.304436 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947845d7-5ad9-4b2d-96a3-6bc1b173364b None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:31.325393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-947845d7-5ad9-4b2d-96a3-6bc1b173364b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:31.325393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:31.325393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:31.325393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:31.325393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:31.325393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:31.325393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:31.325393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:31.325393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:31.325393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:31.325393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:31.325393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:31.325393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:31.325393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:31.325393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:31.325393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:31.326590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:31.326590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:31.326590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:31.326590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:31.326590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:31.326590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:31.326590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:31.326590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:31.326590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:31.326590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:31.326590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:31.326590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:31.326590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:31.326590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:31.326590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:31.326590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:31.326590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:31.327692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:31.327692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:31.327692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:31.334712 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 391/793] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:31.334712 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947845d7-5ad9-4b2d-96a3-6bc1b173364b None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:31.356413 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:31.373902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa55ea-ce4f-4d03-ae1e-d6808eb2b312 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:31.413195 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a7578-6f0d-4a9e-8ebb-d15a463f920c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:31.414308 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a7578-6f0d-4a9e-8ebb-d15a463f920c None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:31.414921 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a7578-6f0d-4a9e-8ebb-d15a463f920c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:31.415422 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a7578-6f0d-4a9e-8ebb-d15a463f920c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:31.427002 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a7578-6f0d-4a9e-8ebb-d15a463f920c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:31.432554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947845d7-5ad9-4b2d-96a3-6bc1b173364b None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:31.435376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-e35a7578-6f0d-4a9e-8ebb-d15a463f920c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:41:31.435376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:31.435376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:31.435376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:31.435376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:31.435376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:31.435376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:31.435376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:31.435376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:31.435376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:31.435376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:31.435376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:31.435376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:31.435376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:31.435376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:31.435376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:31.437519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:31.437519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:31.437519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:31.437519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:31.437519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:31.437519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:31.437519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:31.437519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:31.437519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:31.437519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:31.437519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:31.437519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:31.437519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:31.437519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:31.437519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:31.437519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:31.438420 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:31.438420 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:31.438420 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:31.438420 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:31.438420 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:31.438420 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:31.438420 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:31.438420 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:31.438420 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:31.438420 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:31.438420 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:41:31.438420 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:31.441087 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 403/794] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:41:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:31.442226 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a7578-6f0d-4a9e-8ebb-d15a463f920c None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:31.484668 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d614fc-f39d-470a-b38b-5f8416aa5313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:31.486376 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d614fc-f39d-470a-b38b-5f8416aa5313 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:31.486899 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d614fc-f39d-470a-b38b-5f8416aa5313 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:31.487760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d614fc-f39d-470a-b38b-5f8416aa5313 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:31.498302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d614fc-f39d-470a-b38b-5f8416aa5313 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:31.499763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d614fc-f39d-470a-b38b-5f8416aa5313 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:31.517998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-f5d614fc-f39d-470a-b38b-5f8416aa5313 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 09:41:31.517998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:31.517998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:31.517998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:31.517998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:31.517998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:31.517998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:31.517998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:31.517998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:31.517998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:31.517998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:31.517998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:31.517998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:31.517998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:31.517998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:31.517998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:31.519014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:31.519014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:31.519014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:31.519014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:31.519014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:31.519014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:31.519014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:31.519014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:31.519014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:31.519014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:31.519014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:31.519014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:31.519014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:31.519014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:31.519014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:31.519014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:31.519014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:31.519014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:31.519977 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:31.519977 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:31.519977 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:31.519977 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:31.519977 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:31.519977 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:31.519977 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:31.519977 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:31.519977 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 09:41:31.519977 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:31.523260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 392/795] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Aug 11 09:41:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:31.524850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d614fc-f39d-470a-b38b-5f8416aa5313 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:31.542665 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:31.576543 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a7578-6f0d-4a9e-8ebb-d15a463f920c None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:31.614693 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea635f7d-e417-457b-a62f-3295c9089ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:31.615735 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea635f7d-e417-457b-a62f-3295c9089ac4 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:31.616252 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea635f7d-e417-457b-a62f-3295c9089ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:31.616721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea635f7d-e417-457b-a62f-3295c9089ac4 None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:31.617576 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea635f7d-e417-457b-a62f-3295c9089ac4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:31.618848 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea635f7d-e417-457b-a62f-3295c9089ac4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:31.620545 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea635f7d-e417-457b-a62f-3295c9089ac4 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:31.630438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d614fc-f39d-470a-b38b-5f8416aa5313 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:31.637991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 404/796] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:31.638921 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea635f7d-e417-457b-a62f-3295c9089ac4 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:31.643873 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:31.672691 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f5652-a7c8-452c-95a9-fbbe1b3e8aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:31.673295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f5652-a7c8-452c-95a9-fbbe1b3e8aaf None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:31.673567 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f5652-a7c8-452c-95a9-fbbe1b3e8aaf None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:31.673832 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f5652-a7c8-452c-95a9-fbbe1b3e8aaf None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:31.674516 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f5652-a7c8-452c-95a9-fbbe1b3e8aaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:31.674809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f5652-a7c8-452c-95a9-fbbe1b3e8aaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:31.676166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f5652-a7c8-452c-95a9-fbbe1b3e8aaf None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:31.693315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 393/797] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:41:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:31.693315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92090e83-cccf-4a3c-82a2-cf86f37a7853 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:31.693315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92090e83-cccf-4a3c-82a2-cf86f37a7853 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:31.693315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92090e83-cccf-4a3c-82a2-cf86f37a7853 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:31.693315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 394/798] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:31.693315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92090e83-cccf-4a3c-82a2-cf86f37a7853 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:31.757187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea635f7d-e417-457b-a62f-3295c9089ac4 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:31.771419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:31.794387 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed13740-a294-436f-85ab-c8894e2cb5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:31.794987 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed13740-a294-436f-85ab-c8894e2cb5d5 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:31.795258 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed13740-a294-436f-85ab-c8894e2cb5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:31.795523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed13740-a294-436f-85ab-c8894e2cb5d5 None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:31.796227 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed13740-a294-436f-85ab-c8894e2cb5d5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:31.796523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed13740-a294-436f-85ab-c8894e2cb5d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:31.797610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92090e83-cccf-4a3c-82a2-cf86f37a7853 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:31.797990 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed13740-a294-436f-85ab-c8894e2cb5d5 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:31.815724 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 405/799] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Aug 11 09:41:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:31.816385 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed13740-a294-436f-85ab-c8894e2cb5d5 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:31.842852 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1c248-092a-4930-af3b-e9e33fbc4c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:31.843391 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1c248-092a-4930-af3b-e9e33fbc4c54 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:31.843667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1c248-092a-4930-af3b-e9e33fbc4c54 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:31.843938 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1c248-092a-4930-af3b-e9e33fbc4c54 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:31.851503 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b1c248-092a-4930-af3b-e9e33fbc4c54 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:31.853556 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b1c248-092a-4930-af3b-e9e33fbc4c54 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:31.864347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-06b1c248-092a-4930-af3b-e9e33fbc4c54 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 09:41:31.864347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:31.864347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:31.864347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:31.864347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:31.864347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:31.864347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:31.864347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:31.864347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:31.864347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:31.864347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:31.864347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:31.864347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:31.864347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:31.864347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:31.864347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:31.865302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:31.865302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:31.865302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:31.865302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:31.865302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:31.865302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:31.865302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:31.865302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:31.865302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:31.865302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:31.865302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:31.865302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:31.865302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:31.865302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:31.865302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:31.865302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:31.865302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:31.865302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:31.866395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:31.866395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:31.866395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:31.866395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:31.866395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:31.866395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:31.866395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:31.866395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:31.866395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 09:41:31.866395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:31.866395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 395/800] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Aug 11 09:41:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:31.867001 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72091157-921f-4f9a-ac9e-02689c0a9179 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:31.867001 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72091157-921f-4f9a-ac9e-02689c0a9179 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:31.867137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72091157-921f-4f9a-ac9e-02689c0a9179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:31.885166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-72091157-921f-4f9a-ac9e-02689c0a9179 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:31.886393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-72091157-921f-4f9a-ac9e-02689c0a9179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:31.891245 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:31.931307 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed13740-a294-436f-85ab-c8894e2cb5d5 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:31.957005 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 396/801] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:41:31.958207 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72091157-921f-4f9a-ac9e-02689c0a9179 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:31.978272 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8067cd-aa3b-4bb4-9a45-df3258172f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:31.979246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8067cd-aa3b-4bb4-9a45-df3258172f37 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:31.980215 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8067cd-aa3b-4bb4-9a45-df3258172f37 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:31.980693 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8067cd-aa3b-4bb4-9a45-df3258172f37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:31.991818 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8067cd-aa3b-4bb4-9a45-df3258172f37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:31.994262 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8067cd-aa3b-4bb4-9a45-df3258172f37 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:32.011477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-6a8067cd-aa3b-4bb4-9a45-df3258172f37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:32.011477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:32.011477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:32.011477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:32.011477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:32.011477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:32.011477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:32.011477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:32.011477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:32.011477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:32.011477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:32.011477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:32.011477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:32.011477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:32.011477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:32.011477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:32.012444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:32.012444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:32.012444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:32.012444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:32.012444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:32.012444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:32.012444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:32.012444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:32.012444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:32.012444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:32.012444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:32.012444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:32.012444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:32.012444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:32.012444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:32.012444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:32.012444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:32.018575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:32.018575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:32.018575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:32.018575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 406/802] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:32.018575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8067cd-aa3b-4bb4-9a45-df3258172f37 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:32.027519 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:32.065122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72091157-921f-4f9a-ac9e-02689c0a9179 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:32.099539 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e9606-9f49-4e78-8519-71d520d4298a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:32.100055 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e9606-9f49-4e78-8519-71d520d4298a None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:32.100326 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e9606-9f49-4e78-8519-71d520d4298a None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:32.100598 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e9606-9f49-4e78-8519-71d520d4298a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:32.118101 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8067cd-aa3b-4bb4-9a45-df3258172f37 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:32.130963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:32.150807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf799c-1926-4025-a05b-b7f05a4cd259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:32.151397 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf799c-1926-4025-a05b-b7f05a4cd259 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:32.151668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf799c-1926-4025-a05b-b7f05a4cd259 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:32.151933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf799c-1926-4025-a05b-b7f05a4cd259 None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:32.152661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf799c-1926-4025-a05b-b7f05a4cd259 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:32.152954 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf799c-1926-4025-a05b-b7f05a4cd259 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:32.154389 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf799c-1926-4025-a05b-b7f05a4cd259 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:32.167799 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e9606-9f49-4e78-8519-71d520d4298a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:32.169239 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e9606-9f49-4e78-8519-71d520d4298a None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:32.172143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 407/803] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Aug 11 09:41:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:32.172932 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf799c-1926-4025-a05b-b7f05a4cd259 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:32.227988 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:32.265612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 397/804] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:41:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 09:41:32.269248 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf799c-1926-4025-a05b-b7f05a4cd259 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:32.270934 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e9606-9f49-4e78-8519-71d520d4298a None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:32.303755 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9a2e9-ed04-4f24-ba7a-7a5a60003604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:32.304378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9a2e9-ed04-4f24-ba7a-7a5a60003604 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:32.304917 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9a2e9-ed04-4f24-ba7a-7a5a60003604 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:32.305728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9a2e9-ed04-4f24-ba7a-7a5a60003604 None admin] PATH_INFO: `/v3/services/network` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:32.306337 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9a2e9-ed04-4f24-ba7a-7a5a60003604 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:32.307690 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9a2e9-ed04-4f24-ba7a-7a5a60003604 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:32.316063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-f7b9a2e9-ed04-4f24-ba7a-7a5a60003604 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 09:41:32.316063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:32.316063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:41:32.316063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:41:32.316063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:41:32.316063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:41:32.316063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:41:32.316063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:32.316063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 09:41:32.316063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:32.316063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:41:32.316063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:32.316063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:32.316063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:32.316063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:32.316063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:32.316063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:32.317011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:32.317011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:32.317011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:32.317011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:32.317011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:32.317011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:32.317011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:41:32.317011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:41:32.317011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:41:32.317011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:41:32.317011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:32.317011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:32.317011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:32.317011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:32.317011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:32.317011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:32.317851 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:32.317851 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:32.317851 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:32.317851 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:32.317851 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:32.317851 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:32.317851 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:32.317851 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:32.317851 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:32.317851 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:32.317851 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:41:32.317851 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:32.317851 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 09:41:32.317851 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:32.317851 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 408/805] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:32 2022] GET /identity/v3/services/network => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:32.318701 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0351b-c781-4a39-a270-8bbe05b5d8a9 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:32.318989 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0351b-c781-4a39-a270-8bbe05b5d8a9 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:32.319172 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0351b-c781-4a39-a270-8bbe05b5d8a9 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:32.320377 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 409/806] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:32.321620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0351b-c781-4a39-a270-8bbe05b5d8a9 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:32.357134 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:32.370494 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e9606-9f49-4e78-8519-71d520d4298a None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:32.404321 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaa236-6e9a-4e6e-9a41-4d9ba1e24029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:32.404917 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaa236-6e9a-4e6e-9a41-4d9ba1e24029 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:32.405199 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaa236-6e9a-4e6e-9a41-4d9ba1e24029 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:32.405462 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaa236-6e9a-4e6e-9a41-4d9ba1e24029 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:32.406117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbaa236-6e9a-4e6e-9a41-4d9ba1e24029 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:32.406408 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbaa236-6e9a-4e6e-9a41-4d9ba1e24029 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:32.407757 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbaa236-6e9a-4e6e-9a41-4d9ba1e24029 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:32.418612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 398/807] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:32.419398 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaa236-6e9a-4e6e-9a41-4d9ba1e24029 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:32.423863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0351b-c781-4a39-a270-8bbe05b5d8a9 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:32.448575 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:32.457999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cd9a9-aeb2-455d-852d-b9905b5c1e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:32.458651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cd9a9-aeb2-455d-852d-b9905b5c1e00 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:32.458928 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cd9a9-aeb2-455d-852d-b9905b5c1e00 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:32.461359 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cd9a9-aeb2-455d-852d-b9905b5c1e00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:32.469939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253cd9a9-aeb2-455d-852d-b9905b5c1e00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:32.471419 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253cd9a9-aeb2-455d-852d-b9905b5c1e00 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:32.485060 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-253cd9a9-aeb2-455d-852d-b9905b5c1e00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:32.485060 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:32.485060 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:32.485060 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:32.485060 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:32.485060 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:32.485060 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:32.485060 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:32.485060 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:32.485060 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:32.485060 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:32.485060 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:32.485060 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:32.485060 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:32.485060 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:32.485060 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:32.486053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:32.486053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:32.486053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:32.486053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:32.486053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:32.486053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:32.486053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:32.486053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:32.486053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:32.486053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:32.486053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:32.486053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:32.486053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:32.486053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:32.486053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:32.486053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:32.486053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:32.486986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:32.486986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:32.486986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:32.486986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 410/808] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:32.486986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cd9a9-aeb2-455d-852d-b9905b5c1e00 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:32.525072 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaa236-6e9a-4e6e-9a41-4d9ba1e24029 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:32.557571 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51dd02-7b4b-4019-87fd-6a6646d207ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:32.558743 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51dd02-7b4b-4019-87fd-6a6646d207ed None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:32.559020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51dd02-7b4b-4019-87fd-6a6646d207ed None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:32.559286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51dd02-7b4b-4019-87fd-6a6646d207ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:32.569392 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51dd02-7b4b-4019-87fd-6a6646d207ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:32.571449 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51dd02-7b4b-4019-87fd-6a6646d207ed None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:32.575925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:32.584936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-0b51dd02-7b4b-4019-87fd-6a6646d207ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:32.584936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:32.584936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:32.584936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:32.584936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:32.584936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:32.584936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:32.584936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:32.584936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:32.584936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:32.584936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:32.584936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:32.584936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:32.584936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:32.584936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:32.584936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:32.593315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:32.593315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:32.593315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:32.593315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:32.593315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:32.593315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:32.593315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:32.593315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:32.593315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:32.593315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:32.593315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:32.593315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:32.593315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:32.593315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:32.593315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:32.593315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:32.593315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:32.594326 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:32.594326 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:32.594326 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:32.594326 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 399/809] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:32.594326 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee5d9b-150a-497a-b847-f4df2c2cfdc4 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:32.594326 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee5d9b-150a-497a-b847-f4df2c2cfdc4 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:32.594326 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee5d9b-150a-497a-b847-f4df2c2cfdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:32.594729 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cd9a9-aeb2-455d-852d-b9905b5c1e00 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:32.604967 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-e2ee5d9b-150a-497a-b847-f4df2c2cfdc4 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:32.606166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-e2ee5d9b-150a-497a-b847-f4df2c2cfdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:32.623214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301728c-c18f-4120-afc0-bdc00035ed2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:32.623753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301728c-c18f-4120-afc0-bdc00035ed2a None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:32.624026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301728c-c18f-4120-afc0-bdc00035ed2a None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:32.624292 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301728c-c18f-4120-afc0-bdc00035ed2a None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:32.624905 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301728c-c18f-4120-afc0-bdc00035ed2a None admin] RBAC: Adding query filter params (name=network) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:32.625201 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301728c-c18f-4120-afc0-bdc00035ed2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:32.626571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301728c-c18f-4120-afc0-bdc00035ed2a None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:32.630929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 411/810] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Aug 11 09:41:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:32.631681 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301728c-c18f-4120-afc0-bdc00035ed2a None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:32.674774 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 400/811] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:41:32.675592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee5d9b-150a-497a-b847-f4df2c2cfdc4 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:32.684169 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:32.743633 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301728c-c18f-4120-afc0-bdc00035ed2a None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:32.772466 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee5d9b-150a-497a-b847-f4df2c2cfdc4 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:32.777128 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bed9f-b1b9-4a9d-bb99-4a9c3b1890bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:32.777739 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bed9f-b1b9-4a9d-bb99-4a9c3b1890bf None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:32.778009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bed9f-b1b9-4a9d-bb99-4a9c3b1890bf None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:32.778301 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bed9f-b1b9-4a9d-bb99-4a9c3b1890bf None admin] PATH_INFO: `/v3/users/swift` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:32.785017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458bed9f-b1b9-4a9d-bb99-4a9c3b1890bf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:32.786459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458bed9f-b1b9-4a9d-bb99-4a9c3b1890bf None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:32.798067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-458bed9f-b1b9-4a9d-bb99-4a9c3b1890bf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 11 09:41:32.798067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:32.798067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:32.798067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:32.798067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:32.798067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:32.798067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:32.798067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:32.798067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:32.798067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:32.798067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:32.798067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:32.798067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:32.798067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:32.798067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:32.798067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:32.799194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:32.799194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:32.799194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:32.799194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:32.799194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:32.799194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:32.799194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:32.799194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:32.799194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:32.799194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:32.799194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:32.799194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:32.799194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:32.799194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:32.799194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:32.799194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:32.799194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:32.799194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:32.800343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:32.800343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:32.800343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:32.800343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:32.800343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:32.800343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:32.800343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:32.800343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:32.800343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 11 09:41:32.800343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:32.800343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 412/812] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:41:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:32.800343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bed9f-b1b9-4a9d-bb99-4a9c3b1890bf None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:32.809515 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4503c9d-c5db-4133-a7b1-bfb9e519452a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:32.810137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4503c9d-c5db-4133-a7b1-bfb9e519452a None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:32.810418 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4503c9d-c5db-4133-a7b1-bfb9e519452a None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:32.810685 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4503c9d-c5db-4133-a7b1-bfb9e519452a None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:32.811326 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4503c9d-c5db-4133-a7b1-bfb9e519452a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:32.811625 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4503c9d-c5db-4133-a7b1-bfb9e519452a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:32.812981 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4503c9d-c5db-4133-a7b1-bfb9e519452a None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:32.817503 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:32.824410 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 401/813] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:32.825227 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4503c9d-c5db-4133-a7b1-bfb9e519452a None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:32.888110 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:32.907795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bed9f-b1b9-4a9d-bb99-4a9c3b1890bf None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:32.922159 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4503c9d-c5db-4133-a7b1-bfb9e519452a None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:32.943186 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2ec34-e3f6-4466-bb11-c3e449a6f757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:32.943790 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2ec34-e3f6-4466-bb11-c3e449a6f757 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:32.944069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2ec34-e3f6-4466-bb11-c3e449a6f757 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:32.944339 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2ec34-e3f6-4466-bb11-c3e449a6f757 None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:32.944971 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2ec34-e3f6-4466-bb11-c3e449a6f757 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:32.945270 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2ec34-e3f6-4466-bb11-c3e449a6f757 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:32.946671 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2ec34-e3f6-4466-bb11-c3e449a6f757 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:32.954585 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c69478-44b2-49c8-a44e-044294a77b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:32.955172 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c69478-44b2-49c8-a44e-044294a77b84 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:32.955443 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c69478-44b2-49c8-a44e-044294a77b84 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:32.955711 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c69478-44b2-49c8-a44e-044294a77b84 None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:32.956315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c69478-44b2-49c8-a44e-044294a77b84 None admin] RBAC: Adding query filter params (type=network) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:32.956607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c69478-44b2-49c8-a44e-044294a77b84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:32.957569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 413/814] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:32.957942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c69478-44b2-49c8-a44e-044294a77b84 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:32.958377 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2ec34-e3f6-4466-bb11-c3e449a6f757 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:32.965974 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 402/815] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Aug 11 09:41:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:32.966758 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c69478-44b2-49c8-a44e-044294a77b84 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:33.029545 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:33.059181 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2ec34-e3f6-4466-bb11-c3e449a6f757 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:33.065276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c69478-44b2-49c8-a44e-044294a77b84 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:33.092793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:33.093838 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aaeeb7-41ad-4e52-91dd-1918e56a6571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:33.094480 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aaeeb7-41ad-4e52-91dd-1918e56a6571 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:33.094754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aaeeb7-41ad-4e52-91dd-1918e56a6571 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:33.095021 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aaeeb7-41ad-4e52-91dd-1918e56a6571 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:33.095588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aaeeb7-41ad-4e52-91dd-1918e56a6571 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:33.096935 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aaeeb7-41ad-4e52-91dd-1918e56a6571 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:33.098531 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc8f4e-c5ef-4297-98bd-0e7a132c276d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:33.099137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc8f4e-c5ef-4297-98bd-0e7a132c276d None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:33.099414 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc8f4e-c5ef-4297-98bd-0e7a132c276d None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:33.099684 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc8f4e-c5ef-4297-98bd-0e7a132c276d None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:33.100465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc8f4e-c5ef-4297-98bd-0e7a132c276d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:33.100771 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc8f4e-c5ef-4297-98bd-0e7a132c276d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:33.102841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc8f4e-c5ef-4297-98bd-0e7a132c276d None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:33.106010 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-32aaeeb7-41ad-4e52-91dd-1918e56a6571 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 09:41:33.106010 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:33.106010 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:41:33.106010 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:41:33.106010 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:41:33.106010 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:41:33.106010 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:41:33.106010 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:33.106010 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 09:41:33.106010 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:33.106010 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:41:33.106010 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:33.106010 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:33.106010 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:33.106010 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:33.106010 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:33.106010 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:33.112731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:33.112731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:33.112731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:33.112731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:33.112731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:33.112731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:33.112731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:41:33.112731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:41:33.112731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:41:33.112731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:41:33.112731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:33.112731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:33.112731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:33.112731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:33.112731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:33.112731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:33.113588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:33.113588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:33.113588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:33.113588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:33.113588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:33.113588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:33.113588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:33.113588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:33.113588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:33.113588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:33.113588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:41:33.113588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:33.113588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 09:41:33.113588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:33.113588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 414/816] 10.222.0.13 () {56 vars in 1129 bytes} [Thu Aug 11 09:41:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:33.114442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aaeeb7-41ad-4e52-91dd-1918e56a6571 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:33.120876 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 403/817] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Aug 11 09:41:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:33.121682 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc8f4e-c5ef-4297-98bd-0e7a132c276d None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:33.207831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aaeeb7-41ad-4e52-91dd-1918e56a6571 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:33.219536 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc8f4e-c5ef-4297-98bd-0e7a132c276d None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:33.240371 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd48f3-11d0-4238-b7e5-5811eafa5a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:33.240998 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd48f3-11d0-4238-b7e5-5811eafa5a83 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:33.241282 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd48f3-11d0-4238-b7e5-5811eafa5a83 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:33.241554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd48f3-11d0-4238-b7e5-5811eafa5a83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:33.244692 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:33.249155 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd48f3-11d0-4238-b7e5-5811eafa5a83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:33.250625 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd48f3-11d0-4238-b7e5-5811eafa5a83 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:33.252302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fdf6c-bc85-4927-bcb3-74612cd7d7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:33.252987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fdf6c-bc85-4927-bcb3-74612cd7d7f4 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:33.253267 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fdf6c-bc85-4927-bcb3-74612cd7d7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:33.253535 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fdf6c-bc85-4927-bcb3-74612cd7d7f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:33.260657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fdf6c-bc85-4927-bcb3-74612cd7d7f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:33.268043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fdf6c-bc85-4927-bcb3-74612cd7d7f4 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:33.268594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-53cd48f3-11d0-4238-b7e5-5811eafa5a83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:33.268594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:33.268594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:33.268594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:33.268594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:33.268594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:33.268594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:33.268594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:33.268594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:33.268594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:33.268594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:33.268594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:33.268594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:33.268594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:33.268594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:33.269973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:33.269973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:33.269973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:33.269973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:33.269973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:33.269973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:33.269973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:33.269973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:33.269973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:33.269973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:33.269973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:33.269973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:33.269973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:33.269973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:33.269973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:33.269973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:33.269973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:33.271203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:33.271203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:33.271203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:33.271203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:33.271203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:33.271203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:33.271203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:33.271203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:33.271203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 415/818] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:33.271203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd48f3-11d0-4238-b7e5-5811eafa5a83 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:33.273346 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-872fdf6c-bc85-4927-bcb3-74612cd7d7f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:33.273346 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:33.273346 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:33.273346 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:33.273346 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:33.273346 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:33.273346 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:33.273346 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:33.273346 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:33.273346 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:33.273346 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:33.273346 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:33.273346 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:33.273346 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:33.273346 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:33.274432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:33.274432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:33.274432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:33.274432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:33.274432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:33.274432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:33.274432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:33.274432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:33.274432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:33.274432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:33.274432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:33.274432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:33.274432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:33.274432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:33.274432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:33.274432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:33.274432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:33.275798 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:33.275798 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:33.275798 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:33.275798 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:33.275798 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:33.275798 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:33.275798 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:33.275798 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:33.275798 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 404/819] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:33.275798 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fdf6c-bc85-4927-bcb3-74612cd7d7f4 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:33.324499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:33.363207 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd48f3-11d0-4238-b7e5-5811eafa5a83 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:33.374127 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fdf6c-bc85-4927-bcb3-74612cd7d7f4 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:33.397216 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c42f4-2fdc-4c49-a687-30f6de7b0b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:33.397817 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c42f4-2fdc-4c49-a687-30f6de7b0b3c None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:33.398113 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c42f4-2fdc-4c49-a687-30f6de7b0b3c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:33.398381 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c42f4-2fdc-4c49-a687-30f6de7b0b3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:33.399046 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c42f4-2fdc-4c49-a687-30f6de7b0b3c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:33.400442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c42f4-2fdc-4c49-a687-30f6de7b0b3c None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:33.406698 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44034c90-7d93-4e35-a2b9-aadfd3a1dd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:33.407287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44034c90-7d93-4e35-a2b9-aadfd3a1dd1e None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:33.407559 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44034c90-7d93-4e35-a2b9-aadfd3a1dd1e None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:33.407826 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44034c90-7d93-4e35-a2b9-aadfd3a1dd1e None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:33.408442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44034c90-7d93-4e35-a2b9-aadfd3a1dd1e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:33.408741 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44034c90-7d93-4e35-a2b9-aadfd3a1dd1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:33.410096 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44034c90-7d93-4e35-a2b9-aadfd3a1dd1e None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:33.415289 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 405/820] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Aug 11 09:41:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:33.416047 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44034c90-7d93-4e35-a2b9-aadfd3a1dd1e None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:33.486813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 416/821] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:41:33 2022] POST /identity/v3/endpoints => generated 337 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:41:33.487962 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c42f4-2fdc-4c49-a687-30f6de7b0b3c None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:33.525304 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44034c90-7d93-4e35-a2b9-aadfd3a1dd1e None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:33.540951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:33.567543 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:33.573983 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975a808-1137-48a1-9f21-fc68e044f251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:33.574663 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975a808-1137-48a1-9f21-fc68e044f251 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:33.574929 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975a808-1137-48a1-9f21-fc68e044f251 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:33.575395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975a808-1137-48a1-9f21-fc68e044f251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:33.587200 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975a808-1137-48a1-9f21-fc68e044f251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:33.588675 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975a808-1137-48a1-9f21-fc68e044f251 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:33.604789 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-2975a808-1137-48a1-9f21-fc68e044f251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:33.604789 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:33.604789 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:33.604789 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:33.604789 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:33.604789 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:33.604789 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:33.604789 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:33.604789 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:33.604789 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:33.604789 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:33.604789 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:33.604789 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:33.604789 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:33.604789 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:33.604789 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:33.611582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:33.611582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:33.611582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:33.611582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:33.611582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:33.611582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:33.611582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:33.611582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:33.611582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:33.611582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:33.611582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:33.611582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:33.611582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:33.611582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:33.611582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:33.611582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:33.611582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:33.612696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:33.612696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:33.612696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:33.612696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 406/822] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:33.612696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975a808-1137-48a1-9f21-fc68e044f251 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:33.627710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c42f4-2fdc-4c49-a687-30f6de7b0b3c None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:33.671752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5fcf9-c409-4440-a265-238439b3cd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:33.672392 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5fcf9-c409-4440-a265-238439b3cd7c None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:33.672667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5fcf9-c409-4440-a265-238439b3cd7c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:33.672930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5fcf9-c409-4440-a265-238439b3cd7c None admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:33.673699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5fcf9-c409-4440-a265-238439b3cd7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:33.673895 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5fcf9-c409-4440-a265-238439b3cd7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:33.676854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5fcf9-c409-4440-a265-238439b3cd7c None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:33.689874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 417/823] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:33.691032 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5fcf9-c409-4440-a265-238439b3cd7c None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:33.732875 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975a808-1137-48a1-9f21-fc68e044f251 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:33.765963 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3be5d4-7e8c-4edf-b08b-07efa9c8c87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:33.766518 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3be5d4-7e8c-4edf-b08b-07efa9c8c87e None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:33.766790 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3be5d4-7e8c-4edf-b08b-07efa9c8c87e None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:33.767062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3be5d4-7e8c-4edf-b08b-07efa9c8c87e None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:33.767732 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3be5d4-7e8c-4edf-b08b-07efa9c8c87e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:33.768029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3be5d4-7e8c-4edf-b08b-07efa9c8c87e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:33.769445 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3be5d4-7e8c-4edf-b08b-07efa9c8c87e None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:33.781057 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 407/824] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:33.781830 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3be5d4-7e8c-4edf-b08b-07efa9c8c87e None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:33.791260 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5fcf9-c409-4440-a265-238439b3cd7c None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:33.803536 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:33.805958 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:33.825947 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31090f-2723-409e-91f7-97dba5234bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:33.826581 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31090f-2723-409e-91f7-97dba5234bdf None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:33.826859 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31090f-2723-409e-91f7-97dba5234bdf None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:33.827126 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31090f-2723-409e-91f7-97dba5234bdf None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:33.827764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31090f-2723-409e-91f7-97dba5234bdf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:33.828044 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31090f-2723-409e-91f7-97dba5234bdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:33.829396 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31090f-2723-409e-91f7-97dba5234bdf None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:33.833958 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 418/825] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Aug 11 09:41:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:33.834702 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31090f-2723-409e-91f7-97dba5234bdf None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:33.883880 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3be5d4-7e8c-4edf-b08b-07efa9c8c87e None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:33.917612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c86b01-86ef-4b57-83b8-41b919f5bd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:33.918237 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c86b01-86ef-4b57-83b8-41b919f5bd0e None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:33.918510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c86b01-86ef-4b57-83b8-41b919f5bd0e None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:33.918770 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c86b01-86ef-4b57-83b8-41b919f5bd0e None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:33.919392 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c86b01-86ef-4b57-83b8-41b919f5bd0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:33.919682 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c86b01-86ef-4b57-83b8-41b919f5bd0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:33.921159 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c86b01-86ef-4b57-83b8-41b919f5bd0e None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:33.932320 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 408/826] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:33.933162 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c86b01-86ef-4b57-83b8-41b919f5bd0e None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:33.939998 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31090f-2723-409e-91f7-97dba5234bdf None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:33.973600 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6564e-2a4a-4667-bece-b18df7eb151e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:33.974273 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6564e-2a4a-4667-bece-b18df7eb151e None admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:33.974555 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6564e-2a4a-4667-bece-b18df7eb151e None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:33.974819 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6564e-2a4a-4667-bece-b18df7eb151e None admin] PATH_INFO: `/v3/projects/a0211f5c0b174c8c998e3ad29f96baab/users/d392c30328a3491bb186bd7b55f4d99c/roles/b8d32893edf5475791d4c3b9aea5a3f6` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:33.989343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6564e-2a4a-4667-bece-b18df7eb151e None admin] RBAC: Authorizing `identity:create_grant(project_id=a0211f5c0b174c8c998e3ad29f96baab, user_id=d392c30328a3491bb186bd7b55f4d99c, role_id=b8d32893edf5475791d4c3b9aea5a3f6)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:33.990819 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6564e-2a4a-4667-bece-b18df7eb151e None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:34.011954 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:34.030395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c86b01-86ef-4b57-83b8-41b919f5bd0e None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:34.055959 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 419/827] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Aug 11 09:41:33 2022] PUT /identity/v3/projects/a0211f5c0b174c8c998e3ad29f96baab/users/d392c30328a3491bb186bd7b55f4d99c/roles/b8d32893edf5475791d4c3b9aea5a3f6 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:41:34.056614 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6564e-2a4a-4667-bece-b18df7eb151e None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:34.063661 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a06f2-86db-4fb9-8f6d-253b670d7c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:34.064388 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a06f2-86db-4fb9-8f6d-253b670d7c2b None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:34.065059 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a06f2-86db-4fb9-8f6d-253b670d7c2b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:34.065332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a06f2-86db-4fb9-8f6d-253b670d7c2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:34.066116 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a06f2-86db-4fb9-8f6d-253b670d7c2b None admin] RBAC: Adding query filter params (role.id=6aae1c66f3f04cec80ed72c20d7e033b, scope.project.id=a0211f5c0b174c8c998e3ad29f96baab, user.id=4c1dc8e0d9454ad98894ed1e8d31f931) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:34.066423 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a06f2-86db-4fb9-8f6d-253b670d7c2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:34.067929 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a06f2-86db-4fb9-8f6d-253b670d7c2b None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:34.088536 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 409/828] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:41:33 2022] GET /identity/v3/role_assignments?user.id=4c1dc8e0d9454ad98894ed1e8d31f931&scope.project.id=a0211f5c0b174c8c998e3ad29f96baab&role.id=6aae1c66f3f04cec80ed72c20d7e033b => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:34.088536 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a06f2-86db-4fb9-8f6d-253b670d7c2b None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:34.125826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:34.231751 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6564e-2a4a-4667-bece-b18df7eb151e None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:34.236021 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a06f2-86db-4fb9-8f6d-253b670d7c2b None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:34.277485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93479981-a65d-4753-ba03-b3646bc11f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:34.278282 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93479981-a65d-4753-ba03-b3646bc11f93 None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:34.278389 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93479981-a65d-4753-ba03-b3646bc11f93 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:34.278702 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93479981-a65d-4753-ba03-b3646bc11f93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:34.279311 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93479981-a65d-4753-ba03-b3646bc11f93 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:34.279768 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92897ca9-a6cd-4082-b583-9a8594ee53c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:34.280393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92897ca9-a6cd-4082-b583-9a8594ee53c8 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:34.280718 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92897ca9-a6cd-4082-b583-9a8594ee53c8 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:34.280825 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93479981-a65d-4753-ba03-b3646bc11f93 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:34.280911 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92897ca9-a6cd-4082-b583-9a8594ee53c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:34.288351 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92897ca9-a6cd-4082-b583-9a8594ee53c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:34.289861 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92897ca9-a6cd-4082-b583-9a8594ee53c8 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:34.301847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-92897ca9-a6cd-4082-b583-9a8594ee53c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:34.301847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:34.301847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:34.301847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:34.301847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:34.301847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:34.301847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:34.301847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:34.301847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:34.301847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:34.301847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:34.301847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:34.301847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:34.301847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:34.301847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:34.307746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:34.307746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:34.307746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:34.307746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:34.307746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:34.307746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:34.307746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:34.307746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:34.307746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:34.307746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:34.307746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:34.307746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:34.307746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:34.307746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:34.307746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:34.307746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:34.307746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:34.308653 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:34.308653 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:34.308653 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:34.308653 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:34.308653 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:34.308653 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:34.308653 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:34.308653 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:34.308653 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 410/829] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:34.309576 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92897ca9-a6cd-4082-b583-9a8594ee53c8 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:34.312852 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:34.356122 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 420/830] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:41:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:41:34.421693 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92897ca9-a6cd-4082-b583-9a8594ee53c8 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:34.471629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab208e-e8d6-48c3-8d19-2db524d06ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:34.472246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab208e-e8d6-48c3-8d19-2db524d06ac8 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:34.472516 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab208e-e8d6-48c3-8d19-2db524d06ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:34.472874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab208e-e8d6-48c3-8d19-2db524d06ac8 None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:34.473569 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab208e-e8d6-48c3-8d19-2db524d06ac8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:34.473869 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab208e-e8d6-48c3-8d19-2db524d06ac8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:34.475372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab208e-e8d6-48c3-8d19-2db524d06ac8 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:34.489508 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 411/831] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:41:34.495597 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93479981-a65d-4753-ba03-b3646bc11f93 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:34.586373 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:34.605676 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93479981-a65d-4753-ba03-b3646bc11f93 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:34.643046 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7768ea-7f83-4646-8e07-c990683de458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:34.643754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7768ea-7f83-4646-8e07-c990683de458 None admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:34.644089 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7768ea-7f83-4646-8e07-c990683de458 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:34.644358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7768ea-7f83-4646-8e07-c990683de458 None admin] PATH_INFO: `/v3/projects/a0211f5c0b174c8c998e3ad29f96baab/users/f7e3b1c5aec94673b391210ae51d4cc2/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:34.646281 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7768ea-7f83-4646-8e07-c990683de458 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0211f5c0b174c8c998e3ad29f96baab, user_id=f7e3b1c5aec94673b391210ae51d4cc2, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:34.647699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7768ea-7f83-4646-8e07-c990683de458 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:34.703468 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 421/832] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Aug 11 09:41:34 2022] PUT /identity/v3/projects/a0211f5c0b174c8c998e3ad29f96baab/users/f7e3b1c5aec94673b391210ae51d4cc2/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:41:36.155793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d77af-a5e2-4fd8-b82a-0b9fbb05eafc None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:36.156887 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d77af-a5e2-4fd8-b82a-0b9fbb05eafc None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:36.157389 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d77af-a5e2-4fd8-b82a-0b9fbb05eafc None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:36.159244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 412/833] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:36.165137 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00c7f5-0bfe-4555-8fc8-311924c14c8f None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:36.165923 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00c7f5-0bfe-4555-8fc8-311924c14c8f None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:36.166431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00c7f5-0bfe-4555-8fc8-311924c14c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:36.185484 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-7a00c7f5-0bfe-4555-8fc8-311924c14c8f None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:36.187047 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-7a00c7f5-0bfe-4555-8fc8-311924c14c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:36.258698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 422/834] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:41:36.279911 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d77af-a5e2-4fd8-b82a-0b9fbb05eafc None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:36.282152 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b6a2d-5db6-40a6-b197-6f7a85d76c91 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:36.282434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b6a2d-5db6-40a6-b197-6f7a85d76c91 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:36.282700 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b6a2d-5db6-40a6-b197-6f7a85d76c91 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:36.284344 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 423/835] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:36.289826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90c64f-bc2b-4a37-a09b-dab4e0bda635 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:36.290419 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90c64f-bc2b-4a37-a09b-dab4e0bda635 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:36.290871 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90c64f-bc2b-4a37-a09b-dab4e0bda635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:36.311112 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-5e90c64f-bc2b-4a37-a09b-dab4e0bda635 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:36.312606 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-5e90c64f-bc2b-4a37-a09b-dab4e0bda635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:36.345050 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:36.394120 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 424/836] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 09:41:36.395691 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d77af-a5e2-4fd8-b82a-0b9fbb05eafc None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:36.408022 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90c64f-bc2b-4a37-a09b-dab4e0bda635 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:36.412010 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:36.443993 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1b03a-b054-473f-9d0f-51f042af0153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:36.444623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1b03a-b054-473f-9d0f-51f042af0153 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:36.444896 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1b03a-b054-473f-9d0f-51f042af0153 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:36.445161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1b03a-b054-473f-9d0f-51f042af0153 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:36.455535 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1b03a-b054-473f-9d0f-51f042af0153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:36.460148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-e7e1b03a-b054-473f-9d0f-51f042af0153 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:36.460148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:36.460148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:36.460148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:36.460148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:36.460148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:36.460148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:36.460148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:36.460148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:36.460148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:36.460148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:36.460148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:36.460148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:36.460148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:36.460148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:36.460148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:36.461091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:36.461091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:36.461091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:36.461091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:36.461091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:36.461091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:36.461091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:36.461091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:36.461091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:36.461091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:36.461091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:36.461091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:36.461091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:36.461091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:36.461091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:36.461091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:36.461951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:36.461951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:36.461951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:36.461951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:36.461951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:36.461951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:36.461951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:36.461951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:36.461951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:36.461951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:36.461951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:41:36.461951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:36.461951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 413/837] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Aug 11 09:41:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:36.462734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d10db-3221-4223-824e-213116755c45 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:36.462806 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d10db-3221-4223-824e-213116755c45 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:36.463383 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d10db-3221-4223-824e-213116755c45 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:36.464395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 414/838] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:36.468057 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d10db-3221-4223-824e-213116755c45 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:36.520358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90c64f-bc2b-4a37-a09b-dab4e0bda635 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:36.560921 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44cf2c-e09d-4626-ac45-45d08fa57a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:36.561545 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44cf2c-e09d-4626-ac45-45d08fa57a2f None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:36.561819 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44cf2c-e09d-4626-ac45-45d08fa57a2f None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:36.562120 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44cf2c-e09d-4626-ac45-45d08fa57a2f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:36.562687 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44cf2c-e09d-4626-ac45-45d08fa57a2f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:36.564036 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44cf2c-e09d-4626-ac45-45d08fa57a2f None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:36.573224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-df44cf2c-e09d-4626-ac45-45d08fa57a2f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 09:41:36.573224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:36.573224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:41:36.573224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:41:36.573224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:41:36.573224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:41:36.573224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:41:36.573224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:36.573224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 09:41:36.573224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:36.573224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:41:36.573224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:36.573224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:36.573224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:36.573224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:36.573224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:36.574171 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:36.574171 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:36.574171 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:36.574171 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:36.574171 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:36.574171 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:36.574171 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:36.574171 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:41:36.574171 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:41:36.574171 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:41:36.574171 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:41:36.574171 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:36.574171 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:36.574171 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:36.574171 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:36.574171 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:36.574171 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:36.575080 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:36.575080 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:36.575080 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:36.575080 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:36.575080 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:36.575080 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:36.575080 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:36.575080 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:36.575080 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:36.575080 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:36.575080 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:41:36.575080 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:36.575080 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 09:41:36.575080 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:36.575080 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 425/839] 10.222.0.13 () {56 vars in 1132 bytes} [Thu Aug 11 09:41:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:41:36.575908 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e572426-0239-4e96-978e-b61aca6ef991 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:36.575908 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e572426-0239-4e96-978e-b61aca6ef991 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:36.575908 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e572426-0239-4e96-978e-b61aca6ef991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:36.582278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d10db-3221-4223-824e-213116755c45 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:36.593228 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-3e572426-0239-4e96-978e-b61aca6ef991 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:36.594529 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-3e572426-0239-4e96-978e-b61aca6ef991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:36.607049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:36.623013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6704b-5edf-40f9-bd99-ac206cbfaa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:36.623754 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6704b-5edf-40f9-bd99-ac206cbfaa17 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:36.624048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6704b-5edf-40f9-bd99-ac206cbfaa17 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:36.624315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6704b-5edf-40f9-bd99-ac206cbfaa17 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:36.624976 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6704b-5edf-40f9-bd99-ac206cbfaa17 None admin] RBAC: Adding query filter params (name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:36.625280 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6704b-5edf-40f9-bd99-ac206cbfaa17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:36.626685 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6704b-5edf-40f9-bd99-ac206cbfaa17 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:36.643804 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 415/840] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Aug 11 09:41:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:36.643804 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6704b-5edf-40f9-bd99-ac206cbfaa17 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:36.665304 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:36.682104 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 426/841] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:41:36.682104 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e572426-0239-4e96-978e-b61aca6ef991 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:36.768569 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6704b-5edf-40f9-bd99-ac206cbfaa17 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:36.775428 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e572426-0239-4e96-978e-b61aca6ef991 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:36.801533 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa583d-d863-4b28-9c26-03bc526595c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:36.802159 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa583d-d863-4b28-9c26-03bc526595c2 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:36.802432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa583d-d863-4b28-9c26-03bc526595c2 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:36.802696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa583d-d863-4b28-9c26-03bc526595c2 None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:36.803311 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa583d-d863-4b28-9c26-03bc526595c2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:36.803602 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa583d-d863-4b28-9c26-03bc526595c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:36.805778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa583d-d863-4b28-9c26-03bc526595c2 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:36.810061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56031d5b-1827-45ec-abf8-6b3c9d751dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:36.810299 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 416/842] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Aug 11 09:41:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:36.810719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56031d5b-1827-45ec-abf8-6b3c9d751dc5 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:36.810927 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa583d-d863-4b28-9c26-03bc526595c2 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:36.811029 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56031d5b-1827-45ec-abf8-6b3c9d751dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:36.811250 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56031d5b-1827-45ec-abf8-6b3c9d751dc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:36.823209 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56031d5b-1827-45ec-abf8-6b3c9d751dc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:36.824627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56031d5b-1827-45ec-abf8-6b3c9d751dc5 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:36.839482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-56031d5b-1827-45ec-abf8-6b3c9d751dc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:36.839482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:36.839482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:36.839482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:36.839482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:36.839482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:36.839482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:36.839482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:36.839482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:36.839482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:36.839482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:36.839482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:36.839482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:36.839482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:36.839482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:36.839482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:36.840575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:36.840575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:36.840575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:36.840575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:36.840575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:36.840575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:36.840575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:36.840575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:36.840575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:36.840575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:36.840575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:36.840575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:36.840575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:36.840575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:36.840575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:36.840575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:36.840575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:36.841509 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:36.841509 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:36.841509 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:36.841509 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 427/843] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:36.842048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aced68d-4065-4c9d-90e1-14c159469ff0 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:36.842346 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aced68d-4065-4c9d-90e1-14c159469ff0 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:36.842594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aced68d-4065-4c9d-90e1-14c159469ff0 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:36.843784 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 428/844] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:36.844455 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aced68d-4065-4c9d-90e1-14c159469ff0 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:36.861495 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:36.894878 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:36.912772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa583d-d863-4b28-9c26-03bc526595c2 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:36.945680 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc91331-3172-4772-ae63-e6fd19151526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:36.945846 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aced68d-4065-4c9d-90e1-14c159469ff0 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:36.946263 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc91331-3172-4772-ae63-e6fd19151526 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:36.946541 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc91331-3172-4772-ae63-e6fd19151526 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:36.946809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc91331-3172-4772-ae63-e6fd19151526 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:36.947379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc91331-3172-4772-ae63-e6fd19151526 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:36.948743 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc91331-3172-4772-ae63-e6fd19151526 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:36.957113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-9cc91331-3172-4772-ae63-e6fd19151526 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 09:41:36.957113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:36.957113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:41:36.957113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:41:36.957113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:41:36.957113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:41:36.957113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:41:36.957113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:36.957113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 09:41:36.957113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:36.957113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:41:36.957113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:36.957113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:36.957113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:36.957113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:36.957113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:36.957113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:36.958102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:36.958102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:36.958102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:36.958102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:36.958102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:36.958102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:36.958102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:41:36.958102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:41:36.958102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:41:36.958102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:41:36.958102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:36.958102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:36.958102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:36.958102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:36.958102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:36.958102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:36.964749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:36.964749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:36.964749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:36.964749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:36.964749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:36.964749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:36.964749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:36.964749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:36.964749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:36.964749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:36.964749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:41:36.964749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:36.964749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 09:41:36.964749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:36.964749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 417/845] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Aug 11 09:41:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:36.965561 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc91331-3172-4772-ae63-e6fd19151526 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:36.979605 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03c670-01af-4d9e-bf2e-c3ddd541fc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:36.980207 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03c670-01af-4d9e-bf2e-c3ddd541fc27 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:36.980480 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03c670-01af-4d9e-bf2e-c3ddd541fc27 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:36.980746 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03c670-01af-4d9e-bf2e-c3ddd541fc27 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:36.981356 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03c670-01af-4d9e-bf2e-c3ddd541fc27 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:36.981651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03c670-01af-4d9e-bf2e-c3ddd541fc27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:36.983026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03c670-01af-4d9e-bf2e-c3ddd541fc27 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:36.987418 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 429/846] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Aug 11 09:41:36 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:36.988692 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba9d1c-ac2f-451f-997d-53dc43639ca1 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:36.988979 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba9d1c-ac2f-451f-997d-53dc43639ca1 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:36.989253 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba9d1c-ac2f-451f-997d-53dc43639ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:37.016589 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-b6ba9d1c-ac2f-451f-997d-53dc43639ca1 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:37.017911 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-b6ba9d1c-ac2f-451f-997d-53dc43639ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:37.076496 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc91331-3172-4772-ae63-e6fd19151526 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:37.089687 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:37.102934 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 430/847] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:41:37.102934 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba9d1c-ac2f-451f-997d-53dc43639ca1 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:37.117893 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf99d10-f5fd-41f0-89fa-e9c9a1599076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:37.118559 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf99d10-f5fd-41f0-89fa-e9c9a1599076 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:37.118838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf99d10-f5fd-41f0-89fa-e9c9a1599076 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:37.119108 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf99d10-f5fd-41f0-89fa-e9c9a1599076 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:37.119764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf99d10-f5fd-41f0-89fa-e9c9a1599076 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:37.120061 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf99d10-f5fd-41f0-89fa-e9c9a1599076 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:37.121595 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf99d10-f5fd-41f0-89fa-e9c9a1599076 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:37.139323 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 418/848] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:37.140216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf99d10-f5fd-41f0-89fa-e9c9a1599076 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:37.165363 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:37.224365 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba9d1c-ac2f-451f-997d-53dc43639ca1 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:37.245435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf99d10-f5fd-41f0-89fa-e9c9a1599076 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:37.260122 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbc564-5a65-4f7f-82d0-782c661a14f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:37.260729 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbc564-5a65-4f7f-82d0-782c661a14f7 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:37.261011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbc564-5a65-4f7f-82d0-782c661a14f7 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:37.261309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbc564-5a65-4f7f-82d0-782c661a14f7 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:37.261962 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbc564-5a65-4f7f-82d0-782c661a14f7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:37.262307 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbc564-5a65-4f7f-82d0-782c661a14f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:37.263668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbc564-5a65-4f7f-82d0-782c661a14f7 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:37.268859 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 431/849] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Aug 11 09:41:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:37.269970 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbc564-5a65-4f7f-82d0-782c661a14f7 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:37.283685 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e29c3f-1b95-429f-8228-2ff5897f0600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:37.284766 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e29c3f-1b95-429f-8228-2ff5897f0600 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:37.285261 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e29c3f-1b95-429f-8228-2ff5897f0600 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:37.285808 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e29c3f-1b95-429f-8228-2ff5897f0600 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:37.296785 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e29c3f-1b95-429f-8228-2ff5897f0600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:37.302197 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-88e29c3f-1b95-429f-8228-2ff5897f0600 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:41:37.302197 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:37.302197 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:37.302197 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:37.302197 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:37.302197 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:37.302197 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:37.302197 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:37.302197 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:37.302197 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:37.302197 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:37.302197 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:37.302197 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:37.302197 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:37.302197 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:37.302197 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:37.303130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:37.303130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:37.303130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:37.303130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:37.303130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:37.303130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:37.303130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:37.303130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:37.303130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:37.303130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:37.303130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:37.303130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:37.303130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:37.303130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:37.303130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:37.303130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:37.303961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:37.303961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:37.303961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:37.303961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:37.303961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:37.303961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:37.303961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:37.303961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:37.303961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:37.303961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:37.303961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:41:37.303961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:37.306788 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 419/850] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:41:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:37.307846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e29c3f-1b95-429f-8228-2ff5897f0600 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:37.341433 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:37.381771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbc564-5a65-4f7f-82d0-782c661a14f7 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:37.390864 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:37.414214 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e29c3f-1b95-429f-8228-2ff5897f0600 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:37.419172 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d00af5-bb0b-4ae0-b17c-f66c40efefda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:37.419812 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d00af5-bb0b-4ae0-b17c-f66c40efefda None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:37.420087 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d00af5-bb0b-4ae0-b17c-f66c40efefda None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:37.420355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d00af5-bb0b-4ae0-b17c-f66c40efefda None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:37.428786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d00af5-bb0b-4ae0-b17c-f66c40efefda None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:37.430925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d00af5-bb0b-4ae0-b17c-f66c40efefda None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:37.442474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-f1d00af5-bb0b-4ae0-b17c-f66c40efefda None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 09:41:37.442474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:37.442474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:37.442474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:37.442474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:37.442474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:37.442474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:37.442474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:37.442474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:37.442474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:37.442474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:37.442474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:37.442474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:37.442474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:37.442474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:37.442474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:37.443434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:37.443434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:37.443434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:37.443434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:37.443434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:37.443434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:37.443434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:37.443434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:37.443434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:37.443434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:37.443434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:37.443434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:37.443434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:37.443434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:37.443434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:37.443434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:37.443434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:37.443434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:37.444387 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:37.444387 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:37.444387 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:37.444387 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:37.444387 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:37.444387 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:37.444387 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:37.444387 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:37.444387 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 09:41:37.444387 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:37.444387 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 432/851] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Aug 11 09:41:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:37.444387 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d00af5-bb0b-4ae0-b17c-f66c40efefda None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:37.457748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8b2f1-6321-4f86-a1b5-7ffaee0167fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:37.458383 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8b2f1-6321-4f86-a1b5-7ffaee0167fc None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:37.458661 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8b2f1-6321-4f86-a1b5-7ffaee0167fc None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:37.458946 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8b2f1-6321-4f86-a1b5-7ffaee0167fc None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:37.459551 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8b2f1-6321-4f86-a1b5-7ffaee0167fc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:37.459848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8b2f1-6321-4f86-a1b5-7ffaee0167fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:37.461834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8b2f1-6321-4f86-a1b5-7ffaee0167fc None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:37.474114 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 420/852] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Aug 11 09:41:37 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:37.474114 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8b2f1-6321-4f86-a1b5-7ffaee0167fc None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:37.591181 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:37.596200 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d00af5-bb0b-4ae0-b17c-f66c40efefda None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:37.598724 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8b2f1-6321-4f86-a1b5-7ffaee0167fc None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:37.643923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d2b80-2b12-4a90-8bf1-26004fac29fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:37.644901 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d2b80-2b12-4a90-8bf1-26004fac29fb None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:37.645375 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d2b80-2b12-4a90-8bf1-26004fac29fb None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:37.645956 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d2b80-2b12-4a90-8bf1-26004fac29fb None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:37.646910 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d2b80-2b12-4a90-8bf1-26004fac29fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:37.647261 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84911faa-fd84-40e4-852f-1114bdb98a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:37.647612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d2b80-2b12-4a90-8bf1-26004fac29fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:37.647998 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84911faa-fd84-40e4-852f-1114bdb98a36 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:37.648348 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84911faa-fd84-40e4-852f-1114bdb98a36 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:37.649459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84911faa-fd84-40e4-852f-1114bdb98a36 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:37.649459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84911faa-fd84-40e4-852f-1114bdb98a36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:37.649693 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84911faa-fd84-40e4-852f-1114bdb98a36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:37.650829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d2b80-2b12-4a90-8bf1-26004fac29fb None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:37.651249 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84911faa-fd84-40e4-852f-1114bdb98a36 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:37.672005 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 433/853] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:41:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:37.674293 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 421/854] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Aug 11 09:41:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:37.678149 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84911faa-fd84-40e4-852f-1114bdb98a36 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:37.685566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d2b80-2b12-4a90-8bf1-26004fac29fb None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:37.719517 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:37.808788 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d2b80-2b12-4a90-8bf1-26004fac29fb None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:37.826659 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84911faa-fd84-40e4-852f-1114bdb98a36 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:37.848571 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d116b-4305-453c-af20-54bb80b55ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:37.849766 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d116b-4305-453c-af20-54bb80b55ffa None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:37.850282 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d116b-4305-453c-af20-54bb80b55ffa None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:37.851019 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d116b-4305-453c-af20-54bb80b55ffa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:37.862804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac69e31-5f32-40c7-8f52-a4f08368e867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:37.863429 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac69e31-5f32-40c7-8f52-a4f08368e867 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:37.863700 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac69e31-5f32-40c7-8f52-a4f08368e867 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:37.863967 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac69e31-5f32-40c7-8f52-a4f08368e867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:37.875203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac69e31-5f32-40c7-8f52-a4f08368e867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:37.876620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac69e31-5f32-40c7-8f52-a4f08368e867 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:37.880524 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:37.891763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-eac69e31-5f32-40c7-8f52-a4f08368e867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:37.891763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:37.891763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:37.891763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:37.891763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:37.891763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:37.891763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:37.891763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:37.891763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:37.891763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:37.891763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:37.891763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:37.891763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:37.891763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:37.891763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:37.891763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:37.892719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:37.892719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:37.892719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:37.892719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:37.892719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:37.892719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:37.892719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:37.892719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:37.892719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:37.892719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:37.892719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:37.892719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:37.892719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:37.892719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:37.892719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:37.892719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:37.892719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:37.894200 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:37.894200 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:37.894200 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:37.894200 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 434/855] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:41:37.899300 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac69e31-5f32-40c7-8f52-a4f08368e867 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:37.934516 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d116b-4305-453c-af20-54bb80b55ffa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:37.935777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d116b-4305-453c-af20-54bb80b55ffa None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:38.011737 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:38.040229 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac69e31-5f32-40c7-8f52-a4f08368e867 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:38.047855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 422/856] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:41:37 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 09:41:38.048834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d116b-4305-453c-af20-54bb80b55ffa None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:38.085941 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a83ee-864b-45cb-a3a7-faed31ffe356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:38.086905 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a83ee-864b-45cb-a3a7-faed31ffe356 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:38.087526 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a83ee-864b-45cb-a3a7-faed31ffe356 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:38.087976 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a83ee-864b-45cb-a3a7-faed31ffe356 None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:38.088789 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a83ee-864b-45cb-a3a7-faed31ffe356 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:38.089266 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a83ee-864b-45cb-a3a7-faed31ffe356 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:38.091463 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a83ee-864b-45cb-a3a7-faed31ffe356 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:38.108505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:38.110822 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 435/857] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:38.116000 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a83ee-864b-45cb-a3a7-faed31ffe356 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:38.163226 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d116b-4305-453c-af20-54bb80b55ffa None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:38.205672 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e27cd-1768-4adb-b12e-ce4cbc88b38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:38.206482 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e27cd-1768-4adb-b12e-ce4cbc88b38a None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:38.206825 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e27cd-1768-4adb-b12e-ce4cbc88b38a None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:38.207200 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e27cd-1768-4adb-b12e-ce4cbc88b38a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:38.218543 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e27cd-1768-4adb-b12e-ce4cbc88b38a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:38.220235 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e27cd-1768-4adb-b12e-ce4cbc88b38a None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:38.237139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-154e27cd-1768-4adb-b12e-ce4cbc88b38a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:38.237139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:38.237139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:38.237139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:38.237139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:38.237139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:38.237139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:38.237139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:38.237139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:38.237139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:38.237139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:38.237139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:38.237139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:38.237139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:38.237139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:38.237139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:38.238129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:38.238129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:38.238129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:38.238129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:38.238129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:38.238129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:38.238129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:38.238129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:38.238129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:38.238129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:38.238129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:38.238129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:38.238129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:38.238129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:38.238129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:38.238129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:38.238129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:38.239043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:38.239043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:38.239043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:38.239043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 423/858] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:38.241576 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a83ee-864b-45cb-a3a7-faed31ffe356 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:38.244389 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e27cd-1768-4adb-b12e-ce4cbc88b38a None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:38.289757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa86da-8926-49fe-9612-5c11404777a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:38.290887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa86da-8926-49fe-9612-5c11404777a2 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:38.291172 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa86da-8926-49fe-9612-5c11404777a2 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:38.291439 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa86da-8926-49fe-9612-5c11404777a2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:38.300508 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa86da-8926-49fe-9612-5c11404777a2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:38.302468 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa86da-8926-49fe-9612-5c11404777a2 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:38.307235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:38.320942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-faaa86da-8926-49fe-9612-5c11404777a2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 11 09:41:38.320942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:38.320942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:38.320942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:38.320942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:38.320942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:38.320942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:38.320942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:38.320942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:38.320942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:38.320942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:38.320942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:38.320942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:38.320942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:38.320942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:38.320942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:38.327660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:38.327660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:38.327660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:38.327660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:38.327660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:38.327660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:38.327660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:38.327660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:38.327660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:38.327660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:38.327660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:38.327660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:38.327660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:38.327660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:38.327660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:38.327660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:38.327660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:38.327660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:38.328614 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:38.328614 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:38.328614 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:38.328614 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:38.328614 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:38.328614 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:38.328614 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:38.328614 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:38.328614 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 11 09:41:38.328614 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:38.328614 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 436/859] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:41:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:41:38.328614 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa86da-8926-49fe-9612-5c11404777a2 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:38.372807 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e27cd-1768-4adb-b12e-ce4cbc88b38a None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:38.376873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:38.421572 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad862e7-0b37-41dc-b0bf-1e7290e97827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:38.422935 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad862e7-0b37-41dc-b0bf-1e7290e97827 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:38.423469 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad862e7-0b37-41dc-b0bf-1e7290e97827 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:38.424076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad862e7-0b37-41dc-b0bf-1e7290e97827 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:38.424966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad862e7-0b37-41dc-b0bf-1e7290e97827 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:38.425666 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad862e7-0b37-41dc-b0bf-1e7290e97827 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:38.427865 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad862e7-0b37-41dc-b0bf-1e7290e97827 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:38.436794 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa86da-8926-49fe-9612-5c11404777a2 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:38.443552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 424/860] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:41:38.448637 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad862e7-0b37-41dc-b0bf-1e7290e97827 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:38.476217 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff54c7a-ad9a-4bd6-bc97-e19affe45a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:38.477573 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff54c7a-ad9a-4bd6-bc97-e19affe45a37 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:38.477963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff54c7a-ad9a-4bd6-bc97-e19affe45a37 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:38.478348 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff54c7a-ad9a-4bd6-bc97-e19affe45a37 None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:38.479294 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff54c7a-ad9a-4bd6-bc97-e19affe45a37 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:38.479559 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff54c7a-ad9a-4bd6-bc97-e19affe45a37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:38.481125 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff54c7a-ad9a-4bd6-bc97-e19affe45a37 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:38.504514 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 437/861] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Aug 11 09:41:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:38.505564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff54c7a-ad9a-4bd6-bc97-e19affe45a37 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:38.566455 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad862e7-0b37-41dc-b0bf-1e7290e97827 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:38.568523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:38.604267 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f10f5-3720-4be8-8424-92aa37be42d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:38.605176 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f10f5-3720-4be8-8424-92aa37be42d0 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:38.605640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f10f5-3720-4be8-8424-92aa37be42d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:38.606108 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f10f5-3720-4be8-8424-92aa37be42d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:38.613320 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f10f5-3720-4be8-8424-92aa37be42d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:38.614488 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff54c7a-ad9a-4bd6-bc97-e19affe45a37 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:38.615332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f10f5-3720-4be8-8424-92aa37be42d0 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:38.627504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-084f10f5-3720-4be8-8424-92aa37be42d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:38.627504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:38.627504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:38.627504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:38.627504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:38.627504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:38.627504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:38.627504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:38.627504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:38.627504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:38.627504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:38.627504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:38.627504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:38.627504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:38.627504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:38.628413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:38.628413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:38.628413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:38.628413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:38.628413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:38.628413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:38.628413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:38.628413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:38.628413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:38.628413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:38.628413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:38.628413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:38.628413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:38.628413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:38.628413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:38.628413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:38.628413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:38.629329 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:38.629329 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:38.629329 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:38.629329 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:38.629329 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:38.629329 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:38.629329 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:38.629329 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:38.631736 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 425/862] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:38.642106 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f10f5-3720-4be8-8424-92aa37be42d0 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:38.651729 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcf7de-70fa-4ff7-8039-4250d2415246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:38.652347 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcf7de-70fa-4ff7-8039-4250d2415246 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:38.652887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcf7de-70fa-4ff7-8039-4250d2415246 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:38.652887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcf7de-70fa-4ff7-8039-4250d2415246 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:38.675852 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:38.743865 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcf7de-70fa-4ff7-8039-4250d2415246 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:38.745714 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcf7de-70fa-4ff7-8039-4250d2415246 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:38.767070 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f10f5-3720-4be8-8424-92aa37be42d0 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:38.806958 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f972336-154d-400f-9c6a-b9965ca0fc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:38.807905 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f972336-154d-400f-9c6a-b9965ca0fc5b None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:38.808360 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f972336-154d-400f-9c6a-b9965ca0fc5b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:38.808800 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f972336-154d-400f-9c6a-b9965ca0fc5b None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:38.809676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f972336-154d-400f-9c6a-b9965ca0fc5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:38.810226 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f972336-154d-400f-9c6a-b9965ca0fc5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:38.811854 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f972336-154d-400f-9c6a-b9965ca0fc5b None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:38.816065 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:38.829898 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 426/863] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:38.831060 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f972336-154d-400f-9c6a-b9965ca0fc5b None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:38.874159 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 438/864] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:41:38 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 11 09:41:38.877242 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcf7de-70fa-4ff7-8039-4250d2415246 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:38.931441 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:38.948894 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f972336-154d-400f-9c6a-b9965ca0fc5b None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:38.985592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8d665-0bf4-4552-a86f-7f34b5cba5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:38.986728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8d665-0bf4-4552-a86f-7f34b5cba5c4 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:38.987269 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8d665-0bf4-4552-a86f-7f34b5cba5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:38.987778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8d665-0bf4-4552-a86f-7f34b5cba5c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:38.988682 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8d665-0bf4-4552-a86f-7f34b5cba5c4 None admin] RBAC: Adding query filter params (role.id=b8d32893edf5475791d4c3b9aea5a3f6, scope.project.id=a0211f5c0b174c8c998e3ad29f96baab, user.id=d392c30328a3491bb186bd7b55f4d99c) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:38.989183 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8d665-0bf4-4552-a86f-7f34b5cba5c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:38.991123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8d665-0bf4-4552-a86f-7f34b5cba5c4 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:38.993588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcf7de-70fa-4ff7-8039-4250d2415246 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:39.006210 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 427/865] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:41:38 2022] GET /identity/v3/role_assignments?user.id=d392c30328a3491bb186bd7b55f4d99c&scope.project.id=a0211f5c0b174c8c998e3ad29f96baab&role.id=b8d32893edf5475791d4c3b9aea5a3f6 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:39.035025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f19f5-7e51-4cff-8989-541085243cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:39.035680 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f19f5-7e51-4cff-8989-541085243cbe None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:39.035958 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f19f5-7e51-4cff-8989-541085243cbe None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:39.036412 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f19f5-7e51-4cff-8989-541085243cbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:39.037868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cafda-0de6-4e68-85fe-99e793f352b5 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:39.038204 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cafda-0de6-4e68-85fe-99e793f352b5 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:39.038483 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cafda-0de6-4e68-85fe-99e793f352b5 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:39.043036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 428/866] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:41:39.048449 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f19f5-7e51-4cff-8989-541085243cbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:39.049909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f19f5-7e51-4cff-8989-541085243cbe None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:39.051497 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175badc4-a7e1-42e8-91d5-1f5ec286bdd7 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:39.051782 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175badc4-a7e1-42e8-91d5-1f5ec286bdd7 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:39.052049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175badc4-a7e1-42e8-91d5-1f5ec286bdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:39.069162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-af8f19f5-7e51-4cff-8989-541085243cbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:39.069162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:39.069162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:39.069162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:39.069162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:39.069162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:39.069162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:39.069162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:39.069162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:39.069162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:39.069162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:39.069162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:39.069162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:39.069162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:39.069162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:39.069162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:39.070280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:39.070280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:39.070280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:39.070280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:39.070280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:39.070280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:39.070280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:39.070280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:39.070280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:39.070280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:39.070280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:39.070280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:39.070280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:39.070280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:39.070280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:39.070280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:39.070280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:39.071700 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:39.071700 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:39.071700 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:39.072367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-175badc4-a7e1-42e8-91d5-1f5ec286bdd7 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:39.073576 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-175badc4-a7e1-42e8-91d5-1f5ec286bdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:39.074356 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 439/867] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:39.080232 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f19f5-7e51-4cff-8989-541085243cbe None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:39.094468 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:39.152573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 429/868] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:41:39.175947 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175badc4-a7e1-42e8-91d5-1f5ec286bdd7 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:39.213730 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f19f5-7e51-4cff-8989-541085243cbe None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:39.266884 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e669244-dd1c-457f-b5f6-83f283e5b801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:39.268316 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e669244-dd1c-457f-b5f6-83f283e5b801 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:39.268684 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e669244-dd1c-457f-b5f6-83f283e5b801 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:39.269030 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e669244-dd1c-457f-b5f6-83f283e5b801 None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:39.269752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e669244-dd1c-457f-b5f6-83f283e5b801 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:39.270750 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e669244-dd1c-457f-b5f6-83f283e5b801 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:39.271630 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e669244-dd1c-457f-b5f6-83f283e5b801 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:39.273606 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:39.286309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 440/869] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:39.291418 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e669244-dd1c-457f-b5f6-83f283e5b801 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:39.299929 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175badc4-a7e1-42e8-91d5-1f5ec286bdd7 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:39.345282 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4defadc-0cd0-46c9-893d-aaf68272568b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:39.346474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4defadc-0cd0-46c9-893d-aaf68272568b None admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:39.346924 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4defadc-0cd0-46c9-893d-aaf68272568b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:39.347584 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4defadc-0cd0-46c9-893d-aaf68272568b None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:39.348771 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4defadc-0cd0-46c9-893d-aaf68272568b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:39.350341 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4defadc-0cd0-46c9-893d-aaf68272568b None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:39.369000 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:39.399318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e669244-dd1c-457f-b5f6-83f283e5b801 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:39.431106 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 430/870] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Aug 11 09:41:39 2022] POST /identity/v3/services => generated 269 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:41:39.445216 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28d9f2-9590-492e-93d3-774314f5c984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:39.445932 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28d9f2-9590-492e-93d3-774314f5c984 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:39.446249 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28d9f2-9590-492e-93d3-774314f5c984 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:39.446604 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28d9f2-9590-492e-93d3-774314f5c984 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:39.455210 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28d9f2-9590-492e-93d3-774314f5c984 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:39.456810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28d9f2-9590-492e-93d3-774314f5c984 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:39.469898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-3a28d9f2-9590-492e-93d3-774314f5c984 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:39.469898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:39.469898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:39.469898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:39.469898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:39.469898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:39.469898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:39.469898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:39.469898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:39.469898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:39.469898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:39.469898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:39.469898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:39.469898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:39.469898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:39.470891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:39.470891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:39.470891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:39.470891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:39.470891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:39.470891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:39.470891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:39.470891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:39.470891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:39.470891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:39.470891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:39.470891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:39.470891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:39.470891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:39.470891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:39.470891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:39.470891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:39.471806 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:39.471806 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:39.471806 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:39.471806 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:39.471806 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:39.471806 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:39.471806 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:39.471806 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:39.471806 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 441/871] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:41:39.477513 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4defadc-0cd0-46c9-893d-aaf68272568b None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:39.605249 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4defadc-0cd0-46c9-893d-aaf68272568b None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:39.644033 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf1e8a-4e2c-420e-9f4a-35b853eb2996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:39.644646 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf1e8a-4e2c-420e-9f4a-35b853eb2996 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:39.644925 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf1e8a-4e2c-420e-9f4a-35b853eb2996 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:39.645205 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf1e8a-4e2c-420e-9f4a-35b853eb2996 None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:39.645965 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf1e8a-4e2c-420e-9f4a-35b853eb2996 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:39.646305 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf1e8a-4e2c-420e-9f4a-35b853eb2996 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:39.647796 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf1e8a-4e2c-420e-9f4a-35b853eb2996 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:39.655479 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:39.661690 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 431/872] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:39.662113 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68660b24-5b16-4135-bcff-55954439abc5 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:39.662697 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68660b24-5b16-4135-bcff-55954439abc5 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:39.663162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68660b24-5b16-4135-bcff-55954439abc5 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:39.665439 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 442/873] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:39.669248 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf1e8a-4e2c-420e-9f4a-35b853eb2996 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:39.671213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd7214-312b-420a-8131-0387a139cedc None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:39.671719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd7214-312b-420a-8131-0387a139cedc None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:39.672181 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd7214-312b-420a-8131-0387a139cedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:39.691873 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-f8dd7214-312b-420a-8131-0387a139cedc None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:39.693951 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-f8dd7214-312b-420a-8131-0387a139cedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:39.771302 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 443/874] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:39 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:41:39.785162 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf1e8a-4e2c-420e-9f4a-35b853eb2996 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:39.799720 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd7214-312b-420a-8131-0387a139cedc None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:39.824125 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055664a-4e78-49ff-8537-7952385449fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:39.824731 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055664a-4e78-49ff-8537-7952385449fe None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:39.825010 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055664a-4e78-49ff-8537-7952385449fe None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:39.825282 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055664a-4e78-49ff-8537-7952385449fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:39.826061 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055664a-4e78-49ff-8537-7952385449fe None admin] RBAC: Adding query filter params (role.id=6aae1c66f3f04cec80ed72c20d7e033b, scope.project.id=a0211f5c0b174c8c998e3ad29f96baab, user.id=f7e3b1c5aec94673b391210ae51d4cc2) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:39.826414 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055664a-4e78-49ff-8537-7952385449fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:39.828038 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055664a-4e78-49ff-8537-7952385449fe None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:39.838173 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 432/875] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:41:39 2022] GET /identity/v3/role_assignments?user.id=f7e3b1c5aec94673b391210ae51d4cc2&scope.project.id=a0211f5c0b174c8c998e3ad29f96baab&role.id=6aae1c66f3f04cec80ed72c20d7e033b => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:39.872195 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:39.923160 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd7214-312b-420a-8131-0387a139cedc None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:39.965516 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa494c-52c9-4203-acba-4613dcd70112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:39.966219 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa494c-52c9-4203-acba-4613dcd70112 None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:39.966493 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa494c-52c9-4203-acba-4613dcd70112 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:39.966790 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa494c-52c9-4203-acba-4613dcd70112 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:39.967459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa494c-52c9-4203-acba-4613dcd70112 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:39.968905 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa494c-52c9-4203-acba-4613dcd70112 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:40.041173 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 444/876] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Aug 11 09:41:39 2022] POST /identity/v3/services => generated 251 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 09:41:41.237886 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddefdd-8cbd-4075-8833-f149a05b8232 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:41.238433 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddefdd-8cbd-4075-8833-f149a05b8232 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:41.238433 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddefdd-8cbd-4075-8833-f149a05b8232 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:41.240011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 433/877] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:41.245824 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50e655-44b1-4f2d-b4bc-d54957e2014e None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:41.246240 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50e655-44b1-4f2d-b4bc-d54957e2014e None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:41.246434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50e655-44b1-4f2d-b4bc-d54957e2014e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:41.264437 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-ff50e655-44b1-4f2d-b4bc-d54957e2014e None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:41.265625 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ff50e655-44b1-4f2d-b4bc-d54957e2014e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:41.343148 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 445/878] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:41:41.366109 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddefdd-8cbd-4075-8833-f149a05b8232 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:41.433122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:41.473852 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddefdd-8cbd-4075-8833-f149a05b8232 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:41.509798 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03386f2-cc8d-4a48-842d-dd6489109033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:41.510373 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03386f2-cc8d-4a48-842d-dd6489109033 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:41.510653 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03386f2-cc8d-4a48-842d-dd6489109033 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:41.510925 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03386f2-cc8d-4a48-842d-dd6489109033 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:41.521784 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03386f2-cc8d-4a48-842d-dd6489109033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:41.522057 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b686db-a6f6-431b-b39f-2071a7ec0f57 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:41.522351 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b686db-a6f6-431b-b39f-2071a7ec0f57 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:41.522627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b686db-a6f6-431b-b39f-2071a7ec0f57 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:41.524755 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 446/879] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:41:41.527118 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-b03386f2-cc8d-4a48-842d-dd6489109033 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 09:41:41.527118 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:41.527118 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:41.527118 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:41.527118 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:41.527118 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:41.527118 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:41.527118 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:41.527118 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:41.527118 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:41.527118 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:41.527118 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:41.527118 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:41.527118 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:41.527118 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:41.527118 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:41.528041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:41.528041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:41.528041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:41.528041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:41.528041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:41.528041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:41.528041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:41.528041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:41.528041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:41.528041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:41.528041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:41.528041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:41.528041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:41.528041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:41.528041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:41.528041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:41.528891 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:41.528891 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:41.528891 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:41.528891 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:41.528891 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:41.528891 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:41.528891 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:41.528891 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:41.528891 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:41.528891 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:41.528891 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 09:41:41.528891 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:41.528891 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 434/880] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Aug 11 09:41:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:41.530100 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969576c6-0884-420c-9985-5d23bcc60aa4 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:41.530100 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969576c6-0884-420c-9985-5d23bcc60aa4 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:41.530410 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969576c6-0884-420c-9985-5d23bcc60aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:41.534360 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03386f2-cc8d-4a48-842d-dd6489109033 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:41.549832 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-969576c6-0884-420c-9985-5d23bcc60aa4 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:41.551108 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-969576c6-0884-420c-9985-5d23bcc60aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:41.597515 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:41.648956 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 447/881] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 09:41:41.664835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03386f2-cc8d-4a48-842d-dd6489109033 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:41.678993 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969576c6-0884-420c-9985-5d23bcc60aa4 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:41.692071 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:41.707704 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0783d-1a80-4e67-85ac-623669f0ab7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:41.708874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0783d-1a80-4e67-85ac-623669f0ab7b None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:41.709825 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0783d-1a80-4e67-85ac-623669f0ab7b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:41.710635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0783d-1a80-4e67-85ac-623669f0ab7b None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:41.712390 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0783d-1a80-4e67-85ac-623669f0ab7b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:41.713328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0783d-1a80-4e67-85ac-623669f0ab7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:41.715476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0783d-1a80-4e67-85ac-623669f0ab7b None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:41.731476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 435/882] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Aug 11 09:41:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:41:41.732176 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0783d-1a80-4e67-85ac-623669f0ab7b None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:41.804966 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969576c6-0884-420c-9985-5d23bcc60aa4 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:41.843581 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66539bf-8180-4471-93d4-ab0417103036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:41.844601 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66539bf-8180-4471-93d4-ab0417103036 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:41.845084 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66539bf-8180-4471-93d4-ab0417103036 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:41.845263 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0783d-1a80-4e67-85ac-623669f0ab7b None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:41.845750 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66539bf-8180-4471-93d4-ab0417103036 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:41.846596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66539bf-8180-4471-93d4-ab0417103036 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:41.848320 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66539bf-8180-4471-93d4-ab0417103036 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:41.857936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-e66539bf-8180-4471-93d4-ab0417103036 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 09:41:41.857936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:41.857936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:41:41.857936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:41:41.857936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:41:41.857936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:41:41.857936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:41:41.857936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:41.857936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 09:41:41.857936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:41.857936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:41:41.857936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:41.857936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:41.857936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:41.857936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:41.857936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:41.858936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:41.858936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:41.858936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:41.858936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:41.858936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:41.858936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:41.858936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:41.858936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:41:41.858936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:41:41.858936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:41:41.858936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:41:41.858936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:41.858936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:41.858936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:41.858936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:41.858936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:41.858936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:41.859819 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:41.859819 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:41.859819 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:41.859819 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:41.859819 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:41.859819 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:41.859819 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:41.859819 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:41.859819 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:41.859819 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:41.859819 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:41:41.859819 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:41.859819 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 09:41:41.859819 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:41.867258 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 448/883] 10.222.0.13 () {56 vars in 1132 bytes} [Thu Aug 11 09:41:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:41:41.868325 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66539bf-8180-4471-93d4-ab0417103036 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:41.880322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571b64c-c7d2-4d03-b877-79c6e1bc9dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:41.881228 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571b64c-c7d2-4d03-b877-79c6e1bc9dd4 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:41.881343 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571b64c-c7d2-4d03-b877-79c6e1bc9dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:41.881544 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571b64c-c7d2-4d03-b877-79c6e1bc9dd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:41.893252 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571b64c-c7d2-4d03-b877-79c6e1bc9dd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:41.894809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571b64c-c7d2-4d03-b877-79c6e1bc9dd4 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:41.909371 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:41.909877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-5571b64c-c7d2-4d03-b877-79c6e1bc9dd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:41.909877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:41.909877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:41.909877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:41.909877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:41.909877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:41.909877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:41.909877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:41.909877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:41.909877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:41.909877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:41.909877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:41.909877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:41.909877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:41.909877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:41.909877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:41.910839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:41.910839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:41.910839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:41.910839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:41.910839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:41.910839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:41.910839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:41.910839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:41.910839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:41.910839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:41.910839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:41.910839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:41.910839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:41.910839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:41.910839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:41.910839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:41.910839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:41.911740 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:41.911740 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:41.911740 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:41.915959 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 436/884] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:41:41.916983 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571b64c-c7d2-4d03-b877-79c6e1bc9dd4 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:41.955666 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:41.983166 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66539bf-8180-4471-93d4-ab0417103036 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:42.019171 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a66b4-ada9-49f9-96d3-1b455d9b77c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:42.019730 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a66b4-ada9-49f9-96d3-1b455d9b77c4 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:42.020008 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a66b4-ada9-49f9-96d3-1b455d9b77c4 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:42.020285 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a66b4-ada9-49f9-96d3-1b455d9b77c4 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:42.020903 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a66b4-ada9-49f9-96d3-1b455d9b77c4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:42.021203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a66b4-ada9-49f9-96d3-1b455d9b77c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:42.022600 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a66b4-ada9-49f9-96d3-1b455d9b77c4 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:42.027892 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571b64c-c7d2-4d03-b877-79c6e1bc9dd4 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:42.028192 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 449/885] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Aug 11 09:41:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:42.029339 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575effe6-1484-4879-8d64-cb2f5ed2e5c0 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:42.029619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575effe6-1484-4879-8d64-cb2f5ed2e5c0 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:42.029890 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575effe6-1484-4879-8d64-cb2f5ed2e5c0 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:42.031256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 450/886] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:42.035818 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575effe6-1484-4879-8d64-cb2f5ed2e5c0 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:42.068516 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd840b-01bd-4b66-b724-acb83fb85f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:42.069801 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd840b-01bd-4b66-b724-acb83fb85f1a None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:42.070966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd840b-01bd-4b66-b724-acb83fb85f1a None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:42.071372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd840b-01bd-4b66-b724-acb83fb85f1a None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:42.072200 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd840b-01bd-4b66-b724-acb83fb85f1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:42.072657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd840b-01bd-4b66-b724-acb83fb85f1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:42.074201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd840b-01bd-4b66-b724-acb83fb85f1a None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:42.085898 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 437/887] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:41:42.087119 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9907d6f-489f-4328-ae33-b80f4ffcfc48 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:42.087403 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9907d6f-489f-4328-ae33-b80f4ffcfc48 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:42.087766 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9907d6f-489f-4328-ae33-b80f4ffcfc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:42.104502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-c9907d6f-489f-4328-ae33-b80f4ffcfc48 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:42.105694 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-c9907d6f-489f-4328-ae33-b80f4ffcfc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:42.135587 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:42.139513 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575effe6-1484-4879-8d64-cb2f5ed2e5c0 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:42.170416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 438/888] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:42 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:41:42.171511 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15906081-65ac-4834-b849-669869271f87 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:42.171787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15906081-65ac-4834-b849-669869271f87 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:42.172054 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15906081-65ac-4834-b849-669869271f87 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:42.173256 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 439/889] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:42.173928 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15906081-65ac-4834-b849-669869271f87 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:42.181764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb9981-e271-482d-a3b7-ccba02bfe2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:42.182387 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb9981-e271-482d-a3b7-ccba02bfe2f9 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:42.182658 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb9981-e271-482d-a3b7-ccba02bfe2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:42.182919 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb9981-e271-482d-a3b7-ccba02bfe2f9 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:42.183554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb9981-e271-482d-a3b7-ccba02bfe2f9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:42.183847 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb9981-e271-482d-a3b7-ccba02bfe2f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:42.185183 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb9981-e271-482d-a3b7-ccba02bfe2f9 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:42.191295 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 451/890] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Aug 11 09:41:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:42.192684 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96a541-c705-4120-8694-be7a2f8e0dbd None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:42.192968 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96a541-c705-4120-8694-be7a2f8e0dbd None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:42.193235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96a541-c705-4120-8694-be7a2f8e0dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:42.208918 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:42.211738 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-de96a541-c705-4120-8694-be7a2f8e0dbd None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:42.212924 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-de96a541-c705-4120-8694-be7a2f8e0dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:42.278274 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 452/891] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:42 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:41:42.279097 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96a541-c705-4120-8694-be7a2f8e0dbd None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:42.285522 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15906081-65ac-4834-b849-669869271f87 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:42.319392 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e88b19-66e2-4a07-8bc8-5abaa5f23e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:42.319940 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e88b19-66e2-4a07-8bc8-5abaa5f23e30 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:42.320760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e88b19-66e2-4a07-8bc8-5abaa5f23e30 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:42.321028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e88b19-66e2-4a07-8bc8-5abaa5f23e30 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:42.327848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e88b19-66e2-4a07-8bc8-5abaa5f23e30 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:42.329284 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e88b19-66e2-4a07-8bc8-5abaa5f23e30 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:42.341278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-a7e88b19-66e2-4a07-8bc8-5abaa5f23e30 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 09:41:42.341278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:42.341278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:42.341278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:42.341278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:42.341278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:42.341278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:42.341278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:42.341278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:42.341278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:42.341278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:42.341278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:42.341278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:42.341278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:42.341278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:42.341278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:42.342456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:42.342456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:42.342456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:42.342456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:42.342456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:42.342456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:42.342456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:42.342456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:42.342456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:42.342456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:42.342456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:42.342456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:42.342456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:42.342456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:42.342456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:42.342456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:42.342456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:42.342456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:42.343407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:42.343407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:42.343407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:42.343407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:42.343407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:42.343407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:42.343407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:42.343407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:42.343407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 09:41:42.343407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:42.343407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 440/892] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Aug 11 09:41:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:42.343407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e88b19-66e2-4a07-8bc8-5abaa5f23e30 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:42.387390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:42.394188 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96a541-c705-4120-8694-be7a2f8e0dbd None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:42.424689 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:42.428064 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69928fbb-8299-44b6-90f7-6ed9b3ece2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:42.428685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69928fbb-8299-44b6-90f7-6ed9b3ece2fa None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:42.428961 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69928fbb-8299-44b6-90f7-6ed9b3ece2fa None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:42.429231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69928fbb-8299-44b6-90f7-6ed9b3ece2fa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:42.430642 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69928fbb-8299-44b6-90f7-6ed9b3ece2fa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:42.431995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69928fbb-8299-44b6-90f7-6ed9b3ece2fa None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:42.439420 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e88b19-66e2-4a07-8bc8-5abaa5f23e30 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:42.440518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-69928fbb-8299-44b6-90f7-6ed9b3ece2fa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 09:41:42.440518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:42.440518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:41:42.440518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:41:42.440518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:41:42.440518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:41:42.440518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:41:42.440518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:42.440518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 09:41:42.440518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:42.440518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:41:42.440518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:42.440518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:42.440518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:42.440518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:42.440518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:42.440518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:42.441650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:42.441650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:42.441650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:42.441650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:42.441650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:42.441650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:42.441650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:41:42.441650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:41:42.441650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:41:42.441650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:41:42.441650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:42.441650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:42.441650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:42.441650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:42.441650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:42.441650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:42.442863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:42.442863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:42.442863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:42.442863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:42.442863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:42.442863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:42.442863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:42.442863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:42.442863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:42.442863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:42.442863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:41:42.442863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:42.442863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 09:41:42.442863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:42.442863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 453/893] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Aug 11 09:41:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:42.443767 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69928fbb-8299-44b6-90f7-6ed9b3ece2fa None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:42.476742 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5cdb9-4f38-4a42-af30-9f6dc7b70794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:42.477337 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5cdb9-4f38-4a42-af30-9f6dc7b70794 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:42.477612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5cdb9-4f38-4a42-af30-9f6dc7b70794 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:42.477879 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5cdb9-4f38-4a42-af30-9f6dc7b70794 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:42.478612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5cdb9-4f38-4a42-af30-9f6dc7b70794 None admin] RBAC: Adding query filter params (interface=public, service_id=fd0bda6592b343dc9dc1c299462669d9, region_id=RegionOne) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:42.478915 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5cdb9-4f38-4a42-af30-9f6dc7b70794 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:42.480275 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5cdb9-4f38-4a42-af30-9f6dc7b70794 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:42.485216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 441/894] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Aug 11 09:41:42 2022] GET /identity/v3/endpoints?service_id=fd0bda6592b343dc9dc1c299462669d9&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:42.485990 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5cdb9-4f38-4a42-af30-9f6dc7b70794 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:42.543635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69928fbb-8299-44b6-90f7-6ed9b3ece2fa None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:42.580617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5ba11-6f71-4a76-920d-7e105cf6b9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:42.581167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5ba11-6f71-4a76-920d-7e105cf6b9d3 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:42.581460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5ba11-6f71-4a76-920d-7e105cf6b9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:42.581567 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5cdb9-4f38-4a42-af30-9f6dc7b70794 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:42.581725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5ba11-6f71-4a76-920d-7e105cf6b9d3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:42.582381 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5ba11-6f71-4a76-920d-7e105cf6b9d3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:42.585800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5ba11-6f71-4a76-920d-7e105cf6b9d3 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:42.594726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-88e5ba11-6f71-4a76-920d-7e105cf6b9d3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 09:41:42.594726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:42.594726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:41:42.594726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:41:42.594726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:41:42.594726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:41:42.594726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:41:42.594726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:42.594726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 09:41:42.594726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:42.594726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:41:42.594726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:42.594726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:42.594726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:42.594726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:42.594726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:42.594726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:42.595911 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:42.595911 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:42.595911 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:42.595911 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:42.595911 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:42.595911 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:42.595911 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:41:42.595911 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:41:42.595911 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:41:42.595911 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:41:42.595911 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:42.595911 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:42.595911 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:42.595911 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:42.595911 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:42.595911 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:42.596761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:42.596761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:42.596761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:42.596761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:42.596761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:42.596761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:42.596761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:42.596761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:42.596761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:42.596761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:42.596761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:41:42.596761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:42.596761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 09:41:42.596761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:42.596761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 454/895] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Aug 11 09:41:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:42.597585 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5ba11-6f71-4a76-920d-7e105cf6b9d3 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:42.619816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ca359-3059-4adb-ba50-cd0deb0fa45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:42.620416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ca359-3059-4adb-ba50-cd0deb0fa45f None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:42.620686 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ca359-3059-4adb-ba50-cd0deb0fa45f None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:42.620951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ca359-3059-4adb-ba50-cd0deb0fa45f None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:42.621660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ca359-3059-4adb-ba50-cd0deb0fa45f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:42.621960 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ca359-3059-4adb-ba50-cd0deb0fa45f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:42.622742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:42.623420 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ca359-3059-4adb-ba50-cd0deb0fa45f None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:42.640103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 442/896] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Aug 11 09:41:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:42.640914 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ca359-3059-4adb-ba50-cd0deb0fa45f None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:42.651374 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:42.698502 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5ba11-6f71-4a76-920d-7e105cf6b9d3 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:42.732514 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d748358-2c15-46a1-bcd2-30a0f4b03897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:42.733114 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d748358-2c15-46a1-bcd2-30a0f4b03897 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:42.733389 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d748358-2c15-46a1-bcd2-30a0f4b03897 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:42.733658 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d748358-2c15-46a1-bcd2-30a0f4b03897 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:42.734420 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d748358-2c15-46a1-bcd2-30a0f4b03897 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:42.734728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d748358-2c15-46a1-bcd2-30a0f4b03897 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:42.736083 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d748358-2c15-46a1-bcd2-30a0f4b03897 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:42.739396 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ca359-3059-4adb-ba50-cd0deb0fa45f None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:42.740814 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 455/897] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Aug 11 09:41:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:42.741363 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d748358-2c15-46a1-bcd2-30a0f4b03897 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:42.776309 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912709e-d37f-4ddf-a9ee-b1f08961630b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:42.776895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912709e-d37f-4ddf-a9ee-b1f08961630b None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:42.777164 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912709e-d37f-4ddf-a9ee-b1f08961630b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:42.777428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912709e-d37f-4ddf-a9ee-b1f08961630b None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:42.778017 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912709e-d37f-4ddf-a9ee-b1f08961630b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:42.779389 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912709e-d37f-4ddf-a9ee-b1f08961630b None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:42.784779 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 443/898] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Aug 11 09:41:42 2022] GET /identity/v3/services => generated 1268 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:41:42.785530 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912709e-d37f-4ddf-a9ee-b1f08961630b None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:42.835564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:42.852166 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d748358-2c15-46a1-bcd2-30a0f4b03897 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:42.874047 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:42.899092 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c39ad-0fa8-429b-a832-aa64362f04f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:42.899725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c39ad-0fa8-429b-a832-aa64362f04f9 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:42.899999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c39ad-0fa8-429b-a832-aa64362f04f9 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:42.900264 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c39ad-0fa8-429b-a832-aa64362f04f9 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:42.900945 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c39ad-0fa8-429b-a832-aa64362f04f9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:42.901196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c39ad-0fa8-429b-a832-aa64362f04f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:42.902637 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c39ad-0fa8-429b-a832-aa64362f04f9 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:42.906469 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912709e-d37f-4ddf-a9ee-b1f08961630b None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:42.912542 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 456/899] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Aug 11 09:41:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:42.912542 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c39ad-0fa8-429b-a832-aa64362f04f9 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:42.955410 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ba969-67b2-49d8-a418-fbc1116a68e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:42.955623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ba969-67b2-49d8-a418-fbc1116a68e6 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:42.955863 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ba969-67b2-49d8-a418-fbc1116a68e6 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:42.956025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ba969-67b2-49d8-a418-fbc1116a68e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:43.020763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c39ad-0fa8-429b-a832-aa64362f04f9 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:43.026783 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ba969-67b2-49d8-a418-fbc1116a68e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:43.028247 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ba969-67b2-49d8-a418-fbc1116a68e6 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:43.057915 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0359d84-357c-43a8-a345-30b71b2a3e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:43.058877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0359d84-357c-43a8-a345-30b71b2a3e06 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:43.059322 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0359d84-357c-43a8-a345-30b71b2a3e06 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:43.059740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0359d84-357c-43a8-a345-30b71b2a3e06 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:43.060653 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0359d84-357c-43a8-a345-30b71b2a3e06 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:43.061194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0359d84-357c-43a8-a345-30b71b2a3e06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:43.062797 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0359d84-357c-43a8-a345-30b71b2a3e06 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:43.067455 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 457/900] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Aug 11 09:41:42 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:43.068543 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0359d84-357c-43a8-a345-30b71b2a3e06 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:43.093789 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:43.113497 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:43.161251 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 444/901] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:41:42 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 09:41:43.167286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ba969-67b2-49d8-a418-fbc1116a68e6 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:43.213958 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0359d84-357c-43a8-a345-30b71b2a3e06 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:43.254790 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089c137-ef93-4a5d-8183-30320477e492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:43.255332 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089c137-ef93-4a5d-8183-30320477e492 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:43.256247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089c137-ef93-4a5d-8183-30320477e492 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:43.256247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089c137-ef93-4a5d-8183-30320477e492 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:43.256506 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089c137-ef93-4a5d-8183-30320477e492 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:43.256783 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089c137-ef93-4a5d-8183-30320477e492 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:43.258751 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089c137-ef93-4a5d-8183-30320477e492 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:43.264017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 458/902] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Aug 11 09:41:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:43.271893 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089c137-ef93-4a5d-8183-30320477e492 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:43.291607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ba969-67b2-49d8-a418-fbc1116a68e6 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:43.331105 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b4d84-2607-4412-83c6-cb1dee7543cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:43.331846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b4d84-2607-4412-83c6-cb1dee7543cc None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:43.332124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b4d84-2607-4412-83c6-cb1dee7543cc None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:43.332499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b4d84-2607-4412-83c6-cb1dee7543cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:43.343989 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b4d84-2607-4412-83c6-cb1dee7543cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:43.345393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b4d84-2607-4412-83c6-cb1dee7543cc None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:43.360793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-9f4b4d84-2607-4412-83c6-cb1dee7543cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:43.360793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:43.360793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:43.360793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:43.360793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:43.360793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:43.360793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:43.360793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:43.360793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:43.360793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:43.360793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:43.360793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:43.360793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:43.360793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:43.360793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:43.360793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:43.361772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:43.361772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:43.361772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:43.361772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:43.361772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:43.361772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:43.361772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:43.361772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:43.361772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:43.361772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:43.361772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:43.361772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:43.361772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:43.361772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:43.361772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:43.361772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:43.361772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:43.362865 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:43.362865 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:43.362865 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:43.362865 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 445/903] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:43.367618 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:43.368183 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b4d84-2607-4412-83c6-cb1dee7543cc None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:43.391345 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089c137-ef93-4a5d-8183-30320477e492 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:43.418657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:43.428146 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a68b0a-e522-4e3c-8089-7d476adbeffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:43.428765 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a68b0a-e522-4e3c-8089-7d476adbeffe None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:43.429109 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a68b0a-e522-4e3c-8089-7d476adbeffe None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:43.429676 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a68b0a-e522-4e3c-8089-7d476adbeffe None admin] PATH_INFO: `/v3/endpoints` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:43.430433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a68b0a-e522-4e3c-8089-7d476adbeffe None admin] RBAC: Adding query filter params (interface=public, service_id=9cfefe14c5cc4fa4bc980ce77f2e1402, region_id=RegionOne) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:43.430742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a68b0a-e522-4e3c-8089-7d476adbeffe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:43.432107 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a68b0a-e522-4e3c-8089-7d476adbeffe None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:43.440352 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 459/904] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Aug 11 09:41:43 2022] GET /identity/v3/endpoints?service_id=9cfefe14c5cc4fa4bc980ce77f2e1402&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:43.446785 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a68b0a-e522-4e3c-8089-7d476adbeffe None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:43.500871 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b4d84-2607-4412-83c6-cb1dee7543cc None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:43.546822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e5d76-c63f-4dec-ae59-9676b4243c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:43.547444 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e5d76-c63f-4dec-ae59-9676b4243c0d None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:43.547716 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e5d76-c63f-4dec-ae59-9676b4243c0d None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:43.547985 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e5d76-c63f-4dec-ae59-9676b4243c0d None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:43.548628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e5d76-c63f-4dec-ae59-9676b4243c0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:43.549026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e5d76-c63f-4dec-ae59-9676b4243c0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:43.550682 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e5d76-c63f-4dec-ae59-9676b4243c0d None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:43.569275 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 446/905] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:43.570813 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e5d76-c63f-4dec-ae59-9676b4243c0d None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:43.572369 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a68b0a-e522-4e3c-8089-7d476adbeffe None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:43.616152 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc6c77-6db5-477c-a62f-6d8cb17bfb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:43.617359 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc6c77-6db5-477c-a62f-6d8cb17bfb3c None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:43.617742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc6c77-6db5-477c-a62f-6d8cb17bfb3c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:43.618100 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc6c77-6db5-477c-a62f-6d8cb17bfb3c None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:43.618799 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc6c77-6db5-477c-a62f-6d8cb17bfb3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:43.620275 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc6c77-6db5-477c-a62f-6d8cb17bfb3c None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:43.626708 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 460/906] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Aug 11 09:41:43 2022] GET /identity/v3/services => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:41:43.694577 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:43.712916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e5d76-c63f-4dec-ae59-9676b4243c0d None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:43.752538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeebc20-ee01-4bea-b5a5-6c620c716202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:43.753194 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeebc20-ee01-4bea-b5a5-6c620c716202 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:43.753473 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeebc20-ee01-4bea-b5a5-6c620c716202 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:43.753749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeebc20-ee01-4bea-b5a5-6c620c716202 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:43.762236 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeebc20-ee01-4bea-b5a5-6c620c716202 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:43.763717 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeebc20-ee01-4bea-b5a5-6c620c716202 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:43.776554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-afeebc20-ee01-4bea-b5a5-6c620c716202 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:43.776554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:43.776554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:43.776554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:43.776554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:43.776554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:43.776554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:43.776554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:43.776554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:43.776554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:43.776554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:43.776554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:43.776554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:43.776554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:43.776554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:43.777816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:43.777816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:43.777816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:43.777816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:43.777816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:43.777816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:43.777816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:43.777816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:43.777816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:43.777816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:43.777816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:43.777816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:43.777816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:43.777816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:43.777816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:43.777816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:43.777816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:43.779334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:43.779334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:43.779334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:43.779334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:43.779334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:43.779334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:43.779334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:43.779334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:43.779334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 447/907] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:43.783438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc6c77-6db5-477c-a62f-6d8cb17bfb3c None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:43.794028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:43.890190 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc6c77-6db5-477c-a62f-6d8cb17bfb3c None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:43.924986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba97cc5-2c7a-4a38-9d41-737ba0b64205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:43.925590 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba97cc5-2c7a-4a38-9d41-737ba0b64205 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:43.925869 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba97cc5-2c7a-4a38-9d41-737ba0b64205 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:43.926169 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba97cc5-2c7a-4a38-9d41-737ba0b64205 None admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:43.926861 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba97cc5-2c7a-4a38-9d41-737ba0b64205 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:43.927167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba97cc5-2c7a-4a38-9d41-737ba0b64205 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:43.928709 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba97cc5-2c7a-4a38-9d41-737ba0b64205 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:43.942284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 461/908] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:41:43.948563 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeebc20-ee01-4bea-b5a5-6c620c716202 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:44.056711 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeebc20-ee01-4bea-b5a5-6c620c716202 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:44.090805 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a49d8c-20db-46dc-8290-c8b0434ba2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:44.091402 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a49d8c-20db-46dc-8290-c8b0434ba2fc None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:44.091686 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a49d8c-20db-46dc-8290-c8b0434ba2fc None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:44.091937 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a49d8c-20db-46dc-8290-c8b0434ba2fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:44.092643 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a49d8c-20db-46dc-8290-c8b0434ba2fc None admin] RBAC: Adding query filter params (role.id=4bbbd0046bb94973a14f7273d3e23c0c, scope.project.id=a0211f5c0b174c8c998e3ad29f96baab, user.id=d392c30328a3491bb186bd7b55f4d99c) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:44.092943 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a49d8c-20db-46dc-8290-c8b0434ba2fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:44.094397 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a49d8c-20db-46dc-8290-c8b0434ba2fc None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:44.100217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 448/909] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:41:43 2022] GET /identity/v3/role_assignments?user.id=d392c30328a3491bb186bd7b55f4d99c&scope.project.id=a0211f5c0b174c8c998e3ad29f96baab&role.id=4bbbd0046bb94973a14f7273d3e23c0c => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:44.872602 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a585a7-0756-4543-88e9-4cdfd7957019 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:44.873124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a585a7-0756-4543-88e9-4cdfd7957019 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:44.873124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a585a7-0756-4543-88e9-4cdfd7957019 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:44.874764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 462/910] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:44.879843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32c49b-75ee-47da-91b4-936b6265ab81 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:44.880260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32c49b-75ee-47da-91b4-936b6265ab81 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:44.880470 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32c49b-75ee-47da-91b4-936b6265ab81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:44.899861 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-9d32c49b-75ee-47da-91b4-936b6265ab81 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:44.901054 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-9d32c49b-75ee-47da-91b4-936b6265ab81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:44.903275 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:44.974375 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 449/911] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:41:44.997145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a585a7-0756-4543-88e9-4cdfd7957019 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:45.069851 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:45.110045 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a585a7-0756-4543-88e9-4cdfd7957019 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:45.147808 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ceb311-0336-4909-a9e3-d117626392c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:45.149265 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceb311-0336-4909-a9e3-d117626392c6 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:45.149722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceb311-0336-4909-a9e3-d117626392c6 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:45.150193 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceb311-0336-4909-a9e3-d117626392c6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:45.150954 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ceb311-0336-4909-a9e3-d117626392c6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:45.152516 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ceb311-0336-4909-a9e3-d117626392c6 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:45.161833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-80ceb311-0336-4909-a9e3-d117626392c6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 09:41:45.161833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:45.161833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:41:45.161833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:41:45.161833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:41:45.161833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:41:45.161833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:41:45.161833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:45.161833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 09:41:45.161833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:45.161833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:41:45.161833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:45.161833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:45.161833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:45.161833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:45.161833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:45.162816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:45.162816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:45.162816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:45.162816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:45.162816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:45.162816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:45.162816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:45.162816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:41:45.162816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:41:45.162816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:41:45.162816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:41:45.162816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:45.162816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:45.162816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:45.162816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:45.162816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:45.162816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:45.164269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:45.164269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:45.164269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:45.164269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:45.164269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:45.164269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:45.164269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:45.164269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:45.164269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:45.164269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:45.164269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:41:45.164269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:45.164269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 09:41:45.164269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:45.166571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 463/912] 10.222.0.13 () {56 vars in 1132 bytes} [Thu Aug 11 09:41:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:45.172266 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32c49b-75ee-47da-91b4-936b6265ab81 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:45.259869 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d4ac0-1320-400b-a6be-07135e889a91 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:45.260049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d4ac0-1320-400b-a6be-07135e889a91 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:45.260326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d4ac0-1320-400b-a6be-07135e889a91 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:45.261777 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 464/913] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:41:45.267873 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc45049-74a0-4e3f-9f18-c5b1eccf0fe2 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:45.268154 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc45049-74a0-4e3f-9f18-c5b1eccf0fe2 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:45.268427 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc45049-74a0-4e3f-9f18-c5b1eccf0fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:45.288283 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-dfc45049-74a0-4e3f-9f18-c5b1eccf0fe2 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:45.289520 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-dfc45049-74a0-4e3f-9f18-c5b1eccf0fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:45.290003 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32c49b-75ee-47da-91b4-936b6265ab81 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:45.335061 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5e1de-bff7-4d91-bf4d-8e5cf9a860d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:45.335701 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5e1de-bff7-4d91-bf4d-8e5cf9a860d1 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:45.335981 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5e1de-bff7-4d91-bf4d-8e5cf9a860d1 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:45.336253 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5e1de-bff7-4d91-bf4d-8e5cf9a860d1 None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:45.337248 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5e1de-bff7-4d91-bf4d-8e5cf9a860d1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:45.337564 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5e1de-bff7-4d91-bf4d-8e5cf9a860d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:45.339293 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5e1de-bff7-4d91-bf4d-8e5cf9a860d1 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:45.346113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 450/914] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Aug 11 09:41:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:45.351284 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5e1de-bff7-4d91-bf4d-8e5cf9a860d1 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:45.354206 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:45.371440 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 465/915] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:45 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 09:41:45.399024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc45049-74a0-4e3f-9f18-c5b1eccf0fe2 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:45.462377 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:45.472959 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5e1de-bff7-4d91-bf4d-8e5cf9a860d1 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:45.508360 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc45049-74a0-4e3f-9f18-c5b1eccf0fe2 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:45.510262 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292ce5f-441c-464f-94c7-013deab69279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:45.511133 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292ce5f-441c-464f-94c7-013deab69279 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:45.511685 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292ce5f-441c-464f-94c7-013deab69279 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:45.512177 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292ce5f-441c-464f-94c7-013deab69279 None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:45.513004 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292ce5f-441c-464f-94c7-013deab69279 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:45.513521 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292ce5f-441c-464f-94c7-013deab69279 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:45.515119 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292ce5f-441c-464f-94c7-013deab69279 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:45.520930 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 451/916] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Aug 11 09:41:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:41:45.527757 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292ce5f-441c-464f-94c7-013deab69279 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:45.552269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae28aa-a9d9-4f4c-9c9c-f6f70d8ad2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:45.552887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae28aa-a9d9-4f4c-9c9c-f6f70d8ad2f4 None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:45.553167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae28aa-a9d9-4f4c-9c9c-f6f70d8ad2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:45.553441 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae28aa-a9d9-4f4c-9c9c-f6f70d8ad2f4 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:45.554109 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae28aa-a9d9-4f4c-9c9c-f6f70d8ad2f4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:45.556361 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae28aa-a9d9-4f4c-9c9c-f6f70d8ad2f4 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:45.607101 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:45.630306 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 466/917] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Aug 11 09:41:45 2022] POST /identity/v3/services => generated 241 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 09:41:45.662360 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292ce5f-441c-464f-94c7-013deab69279 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:45.711369 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f56ecf-2c4c-4665-a9c8-abcf1bc4f6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:45.711986 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f56ecf-2c4c-4665-a9c8-abcf1bc4f6f6 None admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:45.712322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f56ecf-2c4c-4665-a9c8-abcf1bc4f6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:45.712596 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f56ecf-2c4c-4665-a9c8-abcf1bc4f6f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:45.713330 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f56ecf-2c4c-4665-a9c8-abcf1bc4f6f6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:45.714767 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f56ecf-2c4c-4665-a9c8-abcf1bc4f6f6 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:45.778213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe9772-5e9f-4455-bce9-bba28c6f146c None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:45.778626 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe9772-5e9f-4455-bce9-bba28c6f146c None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:45.778903 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe9772-5e9f-4455-bce9-bba28c6f146c None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:45.780478 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 467/918] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:41:45.786241 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ebfeb-7677-44ad-a917-7877d92c2700 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:45.786559 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ebfeb-7677-44ad-a917-7877d92c2700 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:45.786891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ebfeb-7677-44ad-a917-7877d92c2700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:45.807995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-457ebfeb-7677-44ad-a917-7877d92c2700 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:45.809167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-457ebfeb-7677-44ad-a917-7877d92c2700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:45.831415 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 452/919] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:41:45 2022] POST /identity/v3/endpoints => generated 347 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:41:45.893585 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 468/920] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 09:41:45.917284 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f56ecf-2c4c-4665-a9c8-abcf1bc4f6f6 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:46.031970 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f56ecf-2c4c-4665-a9c8-abcf1bc4f6f6 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:46.052277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:46.071027 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc8586-68cf-4ac2-8e65-576bff759ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:46.071956 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc8586-68cf-4ac2-8e65-576bff759ac1 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:46.078799 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc8586-68cf-4ac2-8e65-576bff759ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:46.078799 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc8586-68cf-4ac2-8e65-576bff759ac1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:46.078799 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc8586-68cf-4ac2-8e65-576bff759ac1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:46.078799 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc8586-68cf-4ac2-8e65-576bff759ac1 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:46.083428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-90dc8586-68cf-4ac2-8e65-576bff759ac1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 09:41:46.083428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:46.083428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:41:46.083428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:41:46.083428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:41:46.083428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:41:46.083428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:41:46.083428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:46.083428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 09:41:46.083428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:46.083428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:41:46.083428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:46.083428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:46.083428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:46.083428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:46.083428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:46.083428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:46.084411 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:46.084411 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:46.084411 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:46.084411 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:46.084411 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:46.084411 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:46.084411 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:41:46.084411 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:41:46.084411 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:41:46.084411 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:41:46.084411 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:46.084411 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:46.084411 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:46.084411 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:46.084411 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:46.084411 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:46.086457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:46.086457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:46.086457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:46.086457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:46.086457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:46.086457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:46.086457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:46.086457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:46.086457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:46.086457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:46.086457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:41:46.086457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:46.086457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 09:41:46.086457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:46.086457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 453/921] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Aug 11 09:41:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:46.091084 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ebfeb-7677-44ad-a917-7877d92c2700 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:46.143637 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:46.174795 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c9fd6-457e-474e-82ac-8598b65dfdfb None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:46.175120 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c9fd6-457e-474e-82ac-8598b65dfdfb None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:46.175334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c9fd6-457e-474e-82ac-8598b65dfdfb None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:46.176919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 454/922] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:46.182421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c13c2-49d7-4e5a-8180-97de0b2cc5e9 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:46.182728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c13c2-49d7-4e5a-8180-97de0b2cc5e9 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:46.182974 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c13c2-49d7-4e5a-8180-97de0b2cc5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:46.205163 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-579c13c2-49d7-4e5a-8180-97de0b2cc5e9 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:46.206192 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ebfeb-7677-44ad-a917-7877d92c2700 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:46.207159 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-579c13c2-49d7-4e5a-8180-97de0b2cc5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:46.242807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa2e48-c5f4-4277-8599-8f031dfdc816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:46.243392 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa2e48-c5f4-4277-8599-8f031dfdc816 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:46.243671 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa2e48-c5f4-4277-8599-8f031dfdc816 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:46.243941 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa2e48-c5f4-4277-8599-8f031dfdc816 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:46.244575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa2e48-c5f4-4277-8599-8f031dfdc816 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:46.244868 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa2e48-c5f4-4277-8599-8f031dfdc816 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:46.246270 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa2e48-c5f4-4277-8599-8f031dfdc816 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:46.251608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 469/923] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Aug 11 09:41:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:46.256723 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa2e48-c5f4-4277-8599-8f031dfdc816 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:46.289817 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 455/924] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 09:41:46.311403 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c13c2-49d7-4e5a-8180-97de0b2cc5e9 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:46.372366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa2e48-c5f4-4277-8599-8f031dfdc816 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:46.387663 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:46.420324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84f742-bdc4-41c9-a04e-f65f088afa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:46.421090 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84f742-bdc4-41c9-a04e-f65f088afa77 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:46.421510 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84f742-bdc4-41c9-a04e-f65f088afa77 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:46.422185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84f742-bdc4-41c9-a04e-f65f088afa77 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:46.423052 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84f742-bdc4-41c9-a04e-f65f088afa77 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:46.423658 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84f742-bdc4-41c9-a04e-f65f088afa77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:46.424121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c13c2-49d7-4e5a-8180-97de0b2cc5e9 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:46.425454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84f742-bdc4-41c9-a04e-f65f088afa77 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:46.434223 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 470/925] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Aug 11 09:41:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:41:46.439000 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84f742-bdc4-41c9-a04e-f65f088afa77 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:46.445398 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:46.468706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28a305-160d-4cdd-8929-26e319b3d611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:46.469627 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28a305-160d-4cdd-8929-26e319b3d611 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:46.470188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28a305-160d-4cdd-8929-26e319b3d611 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:46.470612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28a305-160d-4cdd-8929-26e319b3d611 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:46.483079 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a28a305-160d-4cdd-8929-26e319b3d611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:46.488302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-8a28a305-160d-4cdd-8929-26e319b3d611 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 09:41:46.488302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:46.488302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:46.488302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:46.488302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:46.488302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:46.488302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:46.488302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:46.488302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:46.488302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:46.488302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:46.488302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:46.488302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:46.488302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:46.488302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:46.488302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:46.489463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:46.489463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:46.489463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:46.489463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:46.489463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:46.489463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:46.489463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:46.489463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:46.489463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:46.489463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:46.489463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:46.489463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:46.489463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:46.489463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:46.489463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:46.489463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:46.490533 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:46.490533 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:46.490533 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:46.490533 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:46.490533 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:46.490533 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:46.490533 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:46.490533 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:46.490533 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:46.490533 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:46.490533 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 09:41:46.490533 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:46.497734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 456/926] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Aug 11 09:41:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:41:46.498868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28a305-160d-4cdd-8929-26e319b3d611 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:46.570895 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84f742-bdc4-41c9-a04e-f65f088afa77 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:46.610933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2a21f-230d-4aa6-ab09-f42b5b3f381c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:46.611852 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2a21f-230d-4aa6-ab09-f42b5b3f381c None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:46.612298 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2a21f-230d-4aa6-ab09-f42b5b3f381c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:46.612770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2a21f-230d-4aa6-ab09-f42b5b3f381c None admin] PATH_INFO: `/v3/endpoints` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:46.613571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2a21f-230d-4aa6-ab09-f42b5b3f381c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:46.614431 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28a305-160d-4cdd-8929-26e319b3d611 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:46.615330 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2a21f-230d-4aa6-ab09-f42b5b3f381c None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:46.655276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405da99-7b41-45f0-94f8-804db8621263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:46.655276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405da99-7b41-45f0-94f8-804db8621263 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:46.655276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405da99-7b41-45f0-94f8-804db8621263 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:46.655276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405da99-7b41-45f0-94f8-804db8621263 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:46.655773 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405da99-7b41-45f0-94f8-804db8621263 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:46.655773 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405da99-7b41-45f0-94f8-804db8621263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:46.656958 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405da99-7b41-45f0-94f8-804db8621263 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:46.670141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 457/927] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Aug 11 09:41:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:46.674188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405da99-7b41-45f0-94f8-804db8621263 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:46.701376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 471/928] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:41:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:41:46.724829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:46.799732 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405da99-7b41-45f0-94f8-804db8621263 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:46.844371 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa953ed-daf9-4b47-a8b2-e47ca279c1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:46.845415 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa953ed-daf9-4b47-a8b2-e47ca279c1a8 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:46.845938 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa953ed-daf9-4b47-a8b2-e47ca279c1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:46.846474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa953ed-daf9-4b47-a8b2-e47ca279c1a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:46.859831 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa953ed-daf9-4b47-a8b2-e47ca279c1a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:46.861676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa953ed-daf9-4b47-a8b2-e47ca279c1a8 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:46.877709 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-faa953ed-daf9-4b47-a8b2-e47ca279c1a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:46.877709 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:46.877709 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:46.877709 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:46.877709 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:46.877709 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:46.877709 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:46.877709 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:46.877709 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:46.877709 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:46.877709 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:46.877709 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:46.877709 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:46.877709 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:46.877709 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:46.877709 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:46.878763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:46.878763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:46.878763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:46.878763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:46.878763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:46.878763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:46.878763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:46.878763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:46.878763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:46.878763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:46.878763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:46.878763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:46.878763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:46.878763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:46.878763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:46.878763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:46.878763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:46.879678 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:46.879678 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:46.879678 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:46.881734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 458/929] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:41:46.888129 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2a21f-230d-4aa6-ab09-f42b5b3f381c None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:46.920219 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:46.996624 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2a21f-230d-4aa6-ab09-f42b5b3f381c None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:47.033765 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b9996-ad0d-455f-8be5-01702f4a8775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:47.034770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b9996-ad0d-455f-8be5-01702f4a8775 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:47.035248 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b9996-ad0d-455f-8be5-01702f4a8775 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:47.035716 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b9996-ad0d-455f-8be5-01702f4a8775 None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:47.036549 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b9996-ad0d-455f-8be5-01702f4a8775 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:47.037084 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b9996-ad0d-455f-8be5-01702f4a8775 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:47.039215 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b9996-ad0d-455f-8be5-01702f4a8775 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:47.051499 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 472/930] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:47.058404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa953ed-daf9-4b47-a8b2-e47ca279c1a8 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:47.144649 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:47.162755 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa953ed-daf9-4b47-a8b2-e47ca279c1a8 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:47.198377 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca84c4-93ed-49e1-a451-7213ec6317f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:47.199060 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca84c4-93ed-49e1-a451-7213ec6317f9 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:47.199340 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca84c4-93ed-49e1-a451-7213ec6317f9 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:47.199609 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca84c4-93ed-49e1-a451-7213ec6317f9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:47.207382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca84c4-93ed-49e1-a451-7213ec6317f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:47.208916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca84c4-93ed-49e1-a451-7213ec6317f9 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:47.220074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-c8ca84c4-93ed-49e1-a451-7213ec6317f9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 09:41:47.220074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:47.220074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:47.220074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:47.220074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:47.220074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:47.220074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:47.220074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:47.220074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:47.220074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:47.220074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:47.220074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:47.220074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:47.220074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:47.220074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:47.220074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:47.221012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:47.221012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:47.221012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:47.221012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:47.221012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:47.221012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:47.221012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:47.221012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:47.221012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:47.221012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:47.221012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:47.221012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:47.221012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:47.221012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:47.221012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:47.221012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:47.221012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:47.221012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:47.221937 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:47.221937 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:47.221937 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:47.221937 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:47.221937 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:47.221937 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:47.221937 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:47.221937 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:47.221937 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 09:41:47.221937 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:47.221937 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 459/931] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Aug 11 09:41:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:47.227698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b9996-ad0d-455f-8be5-01702f4a8775 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:47.326769 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:47.337572 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b9996-ad0d-455f-8be5-01702f4a8775 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:47.372727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6557b-6ad6-461c-94ed-35c47fba1b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:47.373338 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6557b-6ad6-461c-94ed-35c47fba1b5d None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:47.373613 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6557b-6ad6-461c-94ed-35c47fba1b5d None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:47.373890 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6557b-6ad6-461c-94ed-35c47fba1b5d None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:47.374664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6557b-6ad6-461c-94ed-35c47fba1b5d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:47.375338 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6557b-6ad6-461c-94ed-35c47fba1b5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:47.376762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6557b-6ad6-461c-94ed-35c47fba1b5d None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:47.394946 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 473/932] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Aug 11 09:41:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:47.401015 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca84c4-93ed-49e1-a451-7213ec6317f9 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:47.507140 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca84c4-93ed-49e1-a451-7213ec6317f9 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:47.542530 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95573e-cf90-43ff-abf2-50136b20b3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:47.543250 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95573e-cf90-43ff-abf2-50136b20b3b9 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:47.543521 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95573e-cf90-43ff-abf2-50136b20b3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:47.543792 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95573e-cf90-43ff-abf2-50136b20b3b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:47.554859 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95573e-cf90-43ff-abf2-50136b20b3b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:47.556316 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95573e-cf90-43ff-abf2-50136b20b3b9 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:47.558163 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:47.570873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-3c95573e-cf90-43ff-abf2-50136b20b3b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:47.570873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:47.570873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:47.570873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:47.570873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:47.570873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:47.570873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:47.570873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:47.570873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:47.570873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:47.570873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:47.570873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:47.570873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:47.570873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:47.570873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:47.570873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:47.580667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:47.580667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:47.580667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:47.580667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:47.580667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:47.580667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:47.580667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:47.580667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:47.580667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:47.580667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:47.580667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:47.580667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:47.580667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:47.580667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:47.580667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:47.580667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:47.580667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:47.581578 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:47.581578 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:47.581578 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:47.581578 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 460/933] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:47.581802 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6557b-6ad6-461c-94ed-35c47fba1b5d None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:47.700219 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6557b-6ad6-461c-94ed-35c47fba1b5d None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:47.736408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76428e2a-4a9c-4725-b9e7-538403dc12fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:47.737019 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76428e2a-4a9c-4725-b9e7-538403dc12fc None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:47.737297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76428e2a-4a9c-4725-b9e7-538403dc12fc None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:47.737568 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76428e2a-4a9c-4725-b9e7-538403dc12fc None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:47.738235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76428e2a-4a9c-4725-b9e7-538403dc12fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:47.738535 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76428e2a-4a9c-4725-b9e7-538403dc12fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:47.739965 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76428e2a-4a9c-4725-b9e7-538403dc12fc None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:47.747839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba34c9d-f8f9-4296-905b-999e4bf25216 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:47.748106 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba34c9d-f8f9-4296-905b-999e4bf25216 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:47.748375 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba34c9d-f8f9-4296-905b-999e4bf25216 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:47.749935 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 461/934] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:47.752341 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 474/935] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:47.754961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31292608-ce53-4d99-906c-1486caab052a None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:47.755267 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31292608-ce53-4d99-906c-1486caab052a None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:47.755537 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31292608-ce53-4d99-906c-1486caab052a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:47.757970 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76428e2a-4a9c-4725-b9e7-538403dc12fc None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:47.777837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-31292608-ce53-4d99-906c-1486caab052a None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:47.779046 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-31292608-ce53-4d99-906c-1486caab052a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:47.786428 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:47.854331 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 462/936] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:41:47.867886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76428e2a-4a9c-4725-b9e7-538403dc12fc None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:47.870484 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31292608-ce53-4d99-906c-1486caab052a None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:47.904734 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef0d75-6929-4135-ba88-7f9c83922c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:47.905371 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef0d75-6929-4135-ba88-7f9c83922c8f None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:47.905650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef0d75-6929-4135-ba88-7f9c83922c8f None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:47.905921 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef0d75-6929-4135-ba88-7f9c83922c8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:47.913330 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef0d75-6929-4135-ba88-7f9c83922c8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:47.915311 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef0d75-6929-4135-ba88-7f9c83922c8f None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:47.928402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-0aef0d75-6929-4135-ba88-7f9c83922c8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:47.928402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:47.928402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:47.928402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:47.928402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:47.928402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:47.928402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:47.928402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:47.928402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:47.928402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:47.928402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:47.928402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:47.928402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:47.928402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:47.928402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:47.931925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:47.931925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:47.931925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:47.931925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:47.931925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:47.931925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:47.931925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:47.931925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:47.931925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:47.931925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:47.931925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:47.931925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:47.931925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:47.931925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:47.931925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:47.931925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:47.931925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:47.933009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:47.933009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:47.933009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:47.933009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:47.933009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:47.933009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:47.933009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:47.933009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:47.933009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 475/937] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:47.938194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef0d75-6929-4135-ba88-7f9c83922c8f None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:47.982555 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31292608-ce53-4d99-906c-1486caab052a None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:48.010534 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:48.021268 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:48.022848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c00076-31ab-4ab7-a55d-e565005e8931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:48.023470 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c00076-31ab-4ab7-a55d-e565005e8931 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:48.023735 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c00076-31ab-4ab7-a55d-e565005e8931 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:48.024000 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c00076-31ab-4ab7-a55d-e565005e8931 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:48.024572 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c00076-31ab-4ab7-a55d-e565005e8931 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:48.026036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c00076-31ab-4ab7-a55d-e565005e8931 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:48.034498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-92c00076-31ab-4ab7-a55d-e565005e8931 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 09:41:48.034498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:48.034498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:41:48.034498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:41:48.034498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:41:48.034498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:41:48.034498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:41:48.034498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:48.034498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 09:41:48.034498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:48.034498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:41:48.034498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:48.034498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:48.034498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:48.034498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:48.034498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:48.034498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:48.035498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:48.035498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:48.035498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:48.035498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:48.035498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:48.035498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:48.035498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:41:48.035498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:41:48.035498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:41:48.035498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:41:48.035498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:48.035498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:48.035498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:48.035498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:48.035498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:48.035498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:48.036353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:48.036353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:48.036353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:48.036353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:48.036353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:48.036353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:48.036353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:48.036353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:48.036353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:48.036353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:48.036353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:41:48.036353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:48.036353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 09:41:48.036353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:48.038261 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 463/938] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Aug 11 09:41:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:48.040941 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e598466-faeb-4139-829b-5d88a97caa8a None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:48.041472 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e598466-faeb-4139-829b-5d88a97caa8a None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:48.041748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e598466-faeb-4139-829b-5d88a97caa8a None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:48.043237 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 464/939] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:48.043851 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e598466-faeb-4139-829b-5d88a97caa8a None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:48.062805 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef0d75-6929-4135-ba88-7f9c83922c8f None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:48.099792 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32beb0bd-446b-4e4d-9a35-78b5194d84ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:48.100397 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32beb0bd-446b-4e4d-9a35-78b5194d84ef None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:48.100674 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32beb0bd-446b-4e4d-9a35-78b5194d84ef None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:48.101512 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32beb0bd-446b-4e4d-9a35-78b5194d84ef None admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:48.102225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32beb0bd-446b-4e4d-9a35-78b5194d84ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:48.102533 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32beb0bd-446b-4e4d-9a35-78b5194d84ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:48.103950 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32beb0bd-446b-4e4d-9a35-78b5194d84ef None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:48.121550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 476/940] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:48.122930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252fc88-6bbe-4663-a3b7-39f6972c2176 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:48.123212 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252fc88-6bbe-4663-a3b7-39f6972c2176 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:48.123479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252fc88-6bbe-4663-a3b7-39f6972c2176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:48.141284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-a252fc88-6bbe-4663-a3b7-39f6972c2176 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:48.142613 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-a252fc88-6bbe-4663-a3b7-39f6972c2176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:48.156861 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e598466-faeb-4139-829b-5d88a97caa8a None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:48.195202 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf781d-d429-48c6-a8ae-612937467f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:48.195746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf781d-d429-48c6-a8ae-612937467f8f None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:48.196048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf781d-d429-48c6-a8ae-612937467f8f None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:48.196318 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf781d-d429-48c6-a8ae-612937467f8f None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:48.196937 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf781d-d429-48c6-a8ae-612937467f8f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:48.197232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf781d-d429-48c6-a8ae-612937467f8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:48.199041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf781d-d429-48c6-a8ae-612937467f8f None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:48.204211 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 465/941] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Aug 11 09:41:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:48.204950 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf781d-d429-48c6-a8ae-612937467f8f None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:48.217818 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 477/942] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:41:48.218887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252fc88-6bbe-4663-a3b7-39f6972c2176 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:48.269737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:48.281155 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:48.321945 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf781d-d429-48c6-a8ae-612937467f8f None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:48.324909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252fc88-6bbe-4663-a3b7-39f6972c2176 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:48.359033 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f0e4c-fe65-4251-9152-2396f97e7fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:48.359255 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282dfb10-9623-4648-b50b-349e84a5caf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:48.359694 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f0e4c-fe65-4251-9152-2396f97e7fce None admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:48.359871 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282dfb10-9623-4648-b50b-349e84a5caf5 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:48.359966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f0e4c-fe65-4251-9152-2396f97e7fce None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:48.360125 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282dfb10-9623-4648-b50b-349e84a5caf5 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:48.360216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f0e4c-fe65-4251-9152-2396f97e7fce None admin] PATH_INFO: `/v3/projects/a0211f5c0b174c8c998e3ad29f96baab/users/d392c30328a3491bb186bd7b55f4d99c/roles/4bbbd0046bb94973a14f7273d3e23c0c` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:48.360363 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282dfb10-9623-4648-b50b-349e84a5caf5 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:48.360990 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282dfb10-9623-4648-b50b-349e84a5caf5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:48.361292 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282dfb10-9623-4648-b50b-349e84a5caf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:48.362393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f0e4c-fe65-4251-9152-2396f97e7fce None admin] RBAC: Authorizing `identity:create_grant(project_id=a0211f5c0b174c8c998e3ad29f96baab, user_id=d392c30328a3491bb186bd7b55f4d99c, role_id=4bbbd0046bb94973a14f7273d3e23c0c)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:48.362710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282dfb10-9623-4648-b50b-349e84a5caf5 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:48.364111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f0e4c-fe65-4251-9152-2396f97e7fce None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:48.373334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 478/943] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Aug 11 09:41:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:48.373334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282dfb10-9623-4648-b50b-349e84a5caf5 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:48.446421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 466/944] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Aug 11 09:41:48 2022] PUT /identity/v3/projects/a0211f5c0b174c8c998e3ad29f96baab/users/d392c30328a3491bb186bd7b55f4d99c/roles/4bbbd0046bb94973a14f7273d3e23c0c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:41:48.447700 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f0e4c-fe65-4251-9152-2396f97e7fce None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:48.487771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282dfb10-9623-4648-b50b-349e84a5caf5 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:48.527314 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:48.545185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c170e-4161-4af7-97fc-742de27dc8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:48.545874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c170e-4161-4af7-97fc-742de27dc8d6 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:48.546189 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c170e-4161-4af7-97fc-742de27dc8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:48.546525 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c170e-4161-4af7-97fc-742de27dc8d6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:48.547121 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c170e-4161-4af7-97fc-742de27dc8d6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:48.548548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c170e-4161-4af7-97fc-742de27dc8d6 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:48.562766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-604c170e-4161-4af7-97fc-742de27dc8d6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 09:41:48.562766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:48.562766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:41:48.562766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:41:48.562766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:41:48.562766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:41:48.562766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:41:48.562766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:48.562766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 09:41:48.562766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:48.562766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:41:48.562766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:48.562766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:48.562766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:48.562766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:48.562766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:48.562766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:48.563874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:48.563874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:48.563874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:48.563874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:48.563874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:48.563874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:48.563874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:41:48.563874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:41:48.563874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:41:48.563874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:41:48.563874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:48.563874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:48.563874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:48.563874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:48.563874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:48.563874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:48.564727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:48.564727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:48.564727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:48.564727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:48.564727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:48.564727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:48.564727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:48.564727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:48.564727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:48.564727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:48.564727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:41:48.564727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:48.564727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 09:41:48.564727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:48.564727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 479/945] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:48.570686 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c170e-4161-4af7-97fc-742de27dc8d6 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:48.606191 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f0e4c-fe65-4251-9152-2396f97e7fce None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:48.625198 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:48.666148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee4f6f-e247-49d7-8c74-279b41d5d731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:48.667222 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee4f6f-e247-49d7-8c74-279b41d5d731 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:48.668671 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee4f6f-e247-49d7-8c74-279b41d5d731 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:48.668950 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee4f6f-e247-49d7-8c74-279b41d5d731 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:48.669665 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee4f6f-e247-49d7-8c74-279b41d5d731 None admin] RBAC: Adding query filter params (interface=public, service_id=d87a735c59514496854c370257899670, region_id=RegionOne) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:48.669973 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee4f6f-e247-49d7-8c74-279b41d5d731 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:48.671386 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee4f6f-e247-49d7-8c74-279b41d5d731 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:48.677701 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 467/946] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Aug 11 09:41:48 2022] GET /identity/v3/endpoints?service_id=d87a735c59514496854c370257899670&interface=public®ion_id=RegionOne => generated 194 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:48.683403 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee4f6f-e247-49d7-8c74-279b41d5d731 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:48.700991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c170e-4161-4af7-97fc-742de27dc8d6 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:48.744854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e373dcf-ad18-4b48-a66a-c46f0a88246f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:48.745535 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e373dcf-ad18-4b48-a66a-c46f0a88246f None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:48.745912 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e373dcf-ad18-4b48-a66a-c46f0a88246f None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:48.746445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e373dcf-ad18-4b48-a66a-c46f0a88246f None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:48.747042 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e373dcf-ad18-4b48-a66a-c46f0a88246f None admin] RBAC: Adding query filter params (name=compute) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:48.747451 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e373dcf-ad18-4b48-a66a-c46f0a88246f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:48.748998 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e373dcf-ad18-4b48-a66a-c46f0a88246f None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:48.754330 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 480/947] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Aug 11 09:41:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:41:48.760469 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e373dcf-ad18-4b48-a66a-c46f0a88246f None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:48.797059 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee4f6f-e247-49d7-8c74-279b41d5d731 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:48.815639 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:48.833134 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48fa62-3aec-487c-8033-5de09956adf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:48.834121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48fa62-3aec-487c-8033-5de09956adf7 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:48.834121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48fa62-3aec-487c-8033-5de09956adf7 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:48.836044 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48fa62-3aec-487c-8033-5de09956adf7 None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:48.836044 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48fa62-3aec-487c-8033-5de09956adf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:48.836278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48fa62-3aec-487c-8033-5de09956adf7 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:48.846241 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 468/948] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Aug 11 09:41:48 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:41:48.872578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e373dcf-ad18-4b48-a66a-c46f0a88246f None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:48.886431 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a54e8-5c90-431a-9588-6376ea0976d1 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:48.886780 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a54e8-5c90-431a-9588-6376ea0976d1 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:48.886982 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a54e8-5c90-431a-9588-6376ea0976d1 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:48.888757 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 469/949] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:41:48.900336 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337665fb-03c0-4899-aaf3-64bd9ed9d939 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:48.900769 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337665fb-03c0-4899-aaf3-64bd9ed9d939 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:48.901170 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337665fb-03c0-4899-aaf3-64bd9ed9d939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:48.913083 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3ad64-6981-4763-8208-e53d7da31005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:48.913742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3ad64-6981-4763-8208-e53d7da31005 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:48.914016 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3ad64-6981-4763-8208-e53d7da31005 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:48.914320 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3ad64-6981-4763-8208-e53d7da31005 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:48.914962 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3ad64-6981-4763-8208-e53d7da31005 None admin] RBAC: Adding query filter params (type=compute) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:48.915259 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3ad64-6981-4763-8208-e53d7da31005 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:48.917523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3ad64-6981-4763-8208-e53d7da31005 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:48.922303 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-337665fb-03c0-4899-aaf3-64bd9ed9d939 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:48.923291 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 481/950] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Aug 11 09:41:48 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:41:48.923861 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-337665fb-03c0-4899-aaf3-64bd9ed9d939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:48.968616 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:49.009324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 470/951] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 09:41:49.033071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3ad64-6981-4763-8208-e53d7da31005 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:49.146890 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3ad64-6981-4763-8208-e53d7da31005 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:49.161845 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:49.184486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f2c9f-9861-4637-8d05-e4278022f94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:49.185091 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f2c9f-9861-4637-8d05-e4278022f94c None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:49.185412 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f2c9f-9861-4637-8d05-e4278022f94c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:49.185688 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f2c9f-9861-4637-8d05-e4278022f94c None admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:49.186453 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f2c9f-9861-4637-8d05-e4278022f94c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:49.187875 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f2c9f-9861-4637-8d05-e4278022f94c None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:49.190502 dv-cinder-815660-9-smb devstack@keystone.service[98478]: WARNING keystone.server.flask.common [None req-fa0f2c9f-9861-4637-8d05-e4278022f94c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 11 09:41:49.239805 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.sql.core [None req-fa0f2c9f-9861-4637-8d05-e4278022f94c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 11 09:41:49.239805 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 11 09:41:49.239805 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [parameters: {'id': '4c07d697a20e48b086293c9272bc6c3f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 11 09:41:49.239805 dv-cinder-815660-9-smb devstack@keystone.service[98478]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98478) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 11 09:41:49.256865 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-fa0f2c9f-9861-4637-8d05-e4278022f94c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4c07d697a20e48b086293c9272bc6c3f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4c07d697a20e48b086293c9272bc6c3f. Aug 11 09:41:49.256865 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:49.256865 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 11 09:41:49.256865 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 11 09:41:49.256865 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 11 09:41:49.256865 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 11 09:41:49.256865 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 11 09:41:49.256865 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application result = self._query(query) Aug 11 09:41:49.256865 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 11 09:41:49.256865 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application conn.query(q) Aug 11 09:41:49.256865 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 11 09:41:49.256865 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 11 09:41:49.256865 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 11 09:41:49.257757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application result.read() Aug 11 09:41:49.257757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 11 09:41:49.257757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 11 09:41:49.257757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 11 09:41:49.257757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 11 09:41:49.257757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 11 09:41:49.257757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 11 09:41:49.257757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 11 09:41:49.257757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 11 09:41:49.257757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 11 09:41:49.257757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:49.257757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 11 09:41:49.257757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:49.257757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:49.257757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 11 09:41:49.257757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 11 09:41:49.257757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 11 09:41:49.257757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 11 09:41:49.258753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 11 09:41:49.258753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application next(self.gen) Aug 11 09:41:49.258753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 11 09:41:49.258753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application yield resource Aug 11 09:41:49.258753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 11 09:41:49.258753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application next(self.gen) Aug 11 09:41:49.258753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 11 09:41:49.258753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self.session.rollback() Aug 11 09:41:49.258753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 11 09:41:49.258753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self.force_reraise() Aug 11 09:41:49.258753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 11 09:41:49.258753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise self.value Aug 11 09:41:49.258753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 11 09:41:49.258753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 11 09:41:49.258753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 11 09:41:49.258753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application session.commit() Aug 11 09:41:49.258753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 11 09:41:49.259673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 11 09:41:49.259673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 11 09:41:49.259673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._prepare_impl() Aug 11 09:41:49.259673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 11 09:41:49.259673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self.session.flush() Aug 11 09:41:49.259673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 11 09:41:49.259673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._flush(objects) Aug 11 09:41:49.259673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 11 09:41:49.259673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 11 09:41:49.259673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 11 09:41:49.259673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application compat.raise_( Aug 11 09:41:49.259673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 11 09:41:49.259673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception Aug 11 09:41:49.259673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 11 09:41:49.259673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application flush_context.execute() Aug 11 09:41:49.259673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 11 09:41:49.259673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rec.execute(self) Aug 11 09:41:49.260827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 11 09:41:49.260827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 11 09:41:49.260827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 11 09:41:49.260827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 11 09:41:49.260827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 11 09:41:49.260827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 11 09:41:49.260827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 11 09:41:49.260827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 11 09:41:49.260827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 11 09:41:49.260827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 11 09:41:49.260827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 11 09:41:49.260827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 11 09:41:49.260827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 11 09:41:49.260827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 11 09:41:49.260827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 11 09:41:49.261622 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 11 09:41:49.261622 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 11 09:41:49.261622 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception Aug 11 09:41:49.261622 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 11 09:41:49.261622 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 11 09:41:49.261622 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 11 09:41:49.261622 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 11 09:41:49.261622 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 11 09:41:49.261622 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application result = self._query(query) Aug 11 09:41:49.261622 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 11 09:41:49.261622 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application conn.query(q) Aug 11 09:41:49.261622 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 11 09:41:49.261622 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 11 09:41:49.261622 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 11 09:41:49.261622 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application result.read() Aug 11 09:41:49.261622 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 11 09:41:49.261622 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 11 09:41:49.262571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 11 09:41:49.262571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 11 09:41:49.262571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 11 09:41:49.262571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 11 09:41:49.262571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 11 09:41:49.262571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 11 09:41:49.262571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 11 09:41:49.262571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 11 09:41:49.262571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [parameters: {'id': '4c07d697a20e48b086293c9272bc6c3f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 11 09:41:49.262571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 11 09:41:49.262571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:49.262571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:41:49.262571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:49.262571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:49.262571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 11 09:41:49.263391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 11 09:41:49.263391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 11 09:41:49.263391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 11 09:41:49.263391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 11 09:41:49.263391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:49.263391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:41:49.263391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:49.263391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:49.263391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:49.263391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:49.263391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:49.263391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:49.263391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:49.263391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:49.263391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:49.263391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:49.263391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:49.269537 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:49.269537 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 11 09:41:49.269537 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 11 09:41:49.269537 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:49.269537 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:49.269537 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 11 09:41:49.269537 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 11 09:41:49.269537 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4c07d697a20e48b086293c9272bc6c3f. Aug 11 09:41:49.269537 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:49.269537 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 482/952] 10.222.0.13 () {60 vars in 1140 bytes} [Thu Aug 11 09:41:49 2022] POST /identity/v3/projects => generated 262 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:49.271040 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337665fb-03c0-4899-aaf3-64bd9ed9d939 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:49.372713 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337665fb-03c0-4899-aaf3-64bd9ed9d939 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:49.407543 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2ec0c-bed6-43cc-ab03-eb1e5f9e077d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:49.408534 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2ec0c-bed6-43cc-ab03-eb1e5f9e077d None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:49.409020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2ec0c-bed6-43cc-ab03-eb1e5f9e077d None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:49.409536 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2ec0c-bed6-43cc-ab03-eb1e5f9e077d None admin] PATH_INFO: `/v3/projects/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:49.417276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2ec0c-bed6-43cc-ab03-eb1e5f9e077d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:49.418981 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2ec0c-bed6-43cc-ab03-eb1e5f9e077d None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:49.431219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-08e2ec0c-bed6-43cc-ab03-eb1e5f9e077d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:49.431219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:49.431219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:49.431219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:49.431219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:49.431219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:49.431219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:49.431219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:49.431219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:49.431219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:49.431219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:49.431219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:49.431219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:49.431219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:49.431219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:49.432287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:49.432287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:49.432287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:49.432287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:49.432287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:49.432287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:49.432287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:49.432287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:49.432287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:49.432287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:49.432287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:49.432287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:49.432287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:49.432287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:49.432287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:49.432287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:49.432287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:49.433422 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:49.433422 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:49.433422 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:49.433422 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:49.433422 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:49.433422 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:49.433422 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:49.433422 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:49.435422 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 471/953] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:49.442016 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f2c9f-9861-4637-8d05-e4278022f94c None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:49.552361 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f2c9f-9861-4637-8d05-e4278022f94c None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:49.588034 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362a0e6-f6e4-472d-94d1-be1f3ea1134d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:49.589002 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362a0e6-f6e4-472d-94d1-be1f3ea1134d None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:49.589485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362a0e6-f6e4-472d-94d1-be1f3ea1134d None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:49.589956 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362a0e6-f6e4-472d-94d1-be1f3ea1134d None admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:49.590862 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362a0e6-f6e4-472d-94d1-be1f3ea1134d None admin] RBAC: Adding query filter params (name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:49.591383 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362a0e6-f6e4-472d-94d1-be1f3ea1134d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:49.593226 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362a0e6-f6e4-472d-94d1-be1f3ea1134d None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:49.623155 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 483/954] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Aug 11 09:41:49 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:50.607462 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5106f70-946f-4275-9eec-07f923ef7c49 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:50.608445 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5106f70-946f-4275-9eec-07f923ef7c49 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:50.608864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5106f70-946f-4275-9eec-07f923ef7c49 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:50.610598 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 472/955] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:50.616192 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c04c0-1c7f-43f4-9993-c3817ac5faf3 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:50.617465 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c04c0-1c7f-43f4-9993-c3817ac5faf3 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:50.617903 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c04c0-1c7f-43f4-9993-c3817ac5faf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:50.643404 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-584c04c0-1c7f-43f4-9993-c3817ac5faf3 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:50.645157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-584c04c0-1c7f-43f4-9993-c3817ac5faf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:50.677334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:50.721641 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 484/956] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 09:41:50.745665 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5106f70-946f-4275-9eec-07f923ef7c49 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:50.776597 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:50.858780 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5106f70-946f-4275-9eec-07f923ef7c49 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:50.868516 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0596081-b8d8-474c-bb4c-532a342fe7d0 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:50.868802 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0596081-b8d8-474c-bb4c-532a342fe7d0 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:50.869078 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0596081-b8d8-474c-bb4c-532a342fe7d0 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:50.870687 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 485/957] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:50.879430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d3bf6-76b5-41d7-ba59-ac1241cc18e2 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:50.879821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d3bf6-76b5-41d7-ba59-ac1241cc18e2 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:50.880420 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d3bf6-76b5-41d7-ba59-ac1241cc18e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:50.898781 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad91d5-310f-4d83-a9ec-5da96c933bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:50.899413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad91d5-310f-4d83-a9ec-5da96c933bb9 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:50.899692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad91d5-310f-4d83-a9ec-5da96c933bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:50.899964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad91d5-310f-4d83-a9ec-5da96c933bb9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:50.903529 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-a91d3bf6-76b5-41d7-ba59-ac1241cc18e2 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:50.905029 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-a91d3bf6-76b5-41d7-ba59-ac1241cc18e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:50.910737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad91d5-310f-4d83-a9ec-5da96c933bb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:50.916158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-95ad91d5-310f-4d83-a9ec-5da96c933bb9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 09:41:50.916158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:50.916158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:50.916158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:50.916158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:50.916158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:50.916158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:50.916158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:50.916158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:50.916158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:50.916158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:50.916158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:50.916158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:50.916158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:50.916158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:50.916158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:50.917476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:50.917476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:50.917476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:50.917476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:50.917476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:50.917476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:50.917476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:50.917476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:50.917476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:50.917476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:50.917476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:50.917476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:50.917476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:50.917476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:50.917476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:50.917476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:50.918764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:50.918764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:50.918764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:50.918764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:50.918764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:50.918764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:50.918764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:50.918764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:50.918764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:50.918764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:50.918764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 09:41:50.918764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:50.918764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 473/958] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Aug 11 09:41:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:50.924109 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad91d5-310f-4d83-a9ec-5da96c933bb9 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:50.990533 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 486/959] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:41:51.009190 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d3bf6-76b5-41d7-ba59-ac1241cc18e2 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:51.040421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:51.052509 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad91d5-310f-4d83-a9ec-5da96c933bb9 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:51.088959 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710edd1-70f9-45a2-a401-cb557a6321a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:51.089565 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710edd1-70f9-45a2-a401-cb557a6321a1 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:51.089841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710edd1-70f9-45a2-a401-cb557a6321a1 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:51.090138 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710edd1-70f9-45a2-a401-cb557a6321a1 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:51.090806 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710edd1-70f9-45a2-a401-cb557a6321a1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:51.091105 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710edd1-70f9-45a2-a401-cb557a6321a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:51.092466 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710edd1-70f9-45a2-a401-cb557a6321a1 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:51.106129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 474/960] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Aug 11 09:41:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:51.106129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8f66a-7f0f-4071-95c1-c585dbfbf2c2 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:51.106129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8f66a-7f0f-4071-95c1-c585dbfbf2c2 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:51.106129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8f66a-7f0f-4071-95c1-c585dbfbf2c2 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:51.106129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 475/961] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:51.107186 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:51.109057 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8f66a-7f0f-4071-95c1-c585dbfbf2c2 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:51.117039 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d3bf6-76b5-41d7-ba59-ac1241cc18e2 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:51.153412 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635aa65-f21a-417f-93fc-4b7dde13ced1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:51.154038 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635aa65-f21a-417f-93fc-4b7dde13ced1 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:51.154337 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635aa65-f21a-417f-93fc-4b7dde13ced1 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:51.154602 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635aa65-f21a-417f-93fc-4b7dde13ced1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:51.155184 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635aa65-f21a-417f-93fc-4b7dde13ced1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:51.156554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635aa65-f21a-417f-93fc-4b7dde13ced1 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:51.165800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-f635aa65-f21a-417f-93fc-4b7dde13ced1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 09:41:51.165800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:51.165800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:41:51.165800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:41:51.165800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:41:51.165800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:41:51.165800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:41:51.165800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:51.165800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 09:41:51.165800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:51.165800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:41:51.165800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:51.165800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:51.165800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:51.165800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:51.165800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:51.165800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:51.172082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:51.172082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:51.172082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:51.172082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:51.172082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:51.172082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:51.172082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:41:51.172082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:41:51.172082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:41:51.172082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:41:51.172082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:51.172082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:51.172082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:51.172082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:51.172082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:51.172082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:51.173023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:51.173023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:51.173023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:51.173023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:51.173023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:51.173023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:51.173023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:51.173023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:51.173023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:51.173023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:51.173023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:41:51.173023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:51.173023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 09:41:51.173023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:51.173023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 487/962] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Aug 11 09:41:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:51.173846 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b80d88-e492-4208-8e8d-ee3d20389c32 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:51.173846 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b80d88-e492-4208-8e8d-ee3d20389c32 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:51.173846 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b80d88-e492-4208-8e8d-ee3d20389c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:51.188767 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-75b80d88-e492-4208-8e8d-ee3d20389c32 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:51.189942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-75b80d88-e492-4208-8e8d-ee3d20389c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:51.221395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8f66a-7f0f-4071-95c1-c585dbfbf2c2 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:51.255063 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f60d3a-adc1-4a33-8af7-ebb294171431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:51.255694 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f60d3a-adc1-4a33-8af7-ebb294171431 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:51.255967 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f60d3a-adc1-4a33-8af7-ebb294171431 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:51.256234 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f60d3a-adc1-4a33-8af7-ebb294171431 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:51.261677 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 488/963] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:41:51.262528 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b80d88-e492-4208-8e8d-ee3d20389c32 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:51.269980 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f60d3a-adc1-4a33-8af7-ebb294171431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:51.272262 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f60d3a-adc1-4a33-8af7-ebb294171431 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:51.290706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-91f60d3a-adc1-4a33-8af7-ebb294171431 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:51.290706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:51.290706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:51.290706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:51.290706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:51.290706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:51.290706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:51.290706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:51.290706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:51.290706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:51.290706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:51.290706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:51.290706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:51.290706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:51.290706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:51.290706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:51.291734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:51.291734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:51.291734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:51.291734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:51.291734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:51.291734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:51.291734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:51.291734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:51.291734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:51.291734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:51.291734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:51.291734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:51.291734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:51.291734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:51.291734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:51.291734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:51.291734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:51.292622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:51.292622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:51.292622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:51.292622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 476/964] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:51.292622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f60d3a-adc1-4a33-8af7-ebb294171431 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:51.299790 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:51.354969 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:51.372037 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b80d88-e492-4208-8e8d-ee3d20389c32 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:51.400923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f60d3a-adc1-4a33-8af7-ebb294171431 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:51.407369 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab498b-9c4e-42e6-a918-c31cdcfb1815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:51.407973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab498b-9c4e-42e6-a918-c31cdcfb1815 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:51.408256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab498b-9c4e-42e6-a918-c31cdcfb1815 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:51.408526 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab498b-9c4e-42e6-a918-c31cdcfb1815 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:51.409182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab498b-9c4e-42e6-a918-c31cdcfb1815 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:51.409480 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab498b-9c4e-42e6-a918-c31cdcfb1815 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:51.410874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab498b-9c4e-42e6-a918-c31cdcfb1815 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:51.416564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 489/965] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Aug 11 09:41:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:51.417719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab498b-9c4e-42e6-a918-c31cdcfb1815 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:51.438997 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718db2ef-5a13-4cd6-a502-9e9f678d190d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:51.440016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718db2ef-5a13-4cd6-a502-9e9f678d190d None admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:51.440556 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718db2ef-5a13-4cd6-a502-9e9f678d190d None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:51.441024 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718db2ef-5a13-4cd6-a502-9e9f678d190d None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:51.441851 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718db2ef-5a13-4cd6-a502-9e9f678d190d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:51.443578 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718db2ef-5a13-4cd6-a502-9e9f678d190d None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:51.520254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab498b-9c4e-42e6-a918-c31cdcfb1815 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:51.539013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 477/966] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Aug 11 09:41:51 2022] POST /identity/v3/services => generated 242 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:41:51.540344 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718db2ef-5a13-4cd6-a502-9e9f678d190d None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:51.577780 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba3f94-b8ae-4225-a1ed-8ba843ce30be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:51.579014 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba3f94-b8ae-4225-a1ed-8ba843ce30be None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:51.580013 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba3f94-b8ae-4225-a1ed-8ba843ce30be None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:51.580753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba3f94-b8ae-4225-a1ed-8ba843ce30be None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:51.581620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba3f94-b8ae-4225-a1ed-8ba843ce30be None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:51.582391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba3f94-b8ae-4225-a1ed-8ba843ce30be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:51.585056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba3f94-b8ae-4225-a1ed-8ba843ce30be None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:51.601921 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 490/967] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:51.608192 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba3f94-b8ae-4225-a1ed-8ba843ce30be None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:51.614544 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:51.645266 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:51.695978 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718db2ef-5a13-4cd6-a502-9e9f678d190d None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:51.739324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef67e7-22d2-45a5-8066-7e1334dcf25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:51.739942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef67e7-22d2-45a5-8066-7e1334dcf25e None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:51.740223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef67e7-22d2-45a5-8066-7e1334dcf25e None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:51.740496 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef67e7-22d2-45a5-8066-7e1334dcf25e None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:51.741125 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef67e7-22d2-45a5-8066-7e1334dcf25e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:51.741988 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef67e7-22d2-45a5-8066-7e1334dcf25e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:51.743469 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef67e7-22d2-45a5-8066-7e1334dcf25e None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:51.750690 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 478/968] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Aug 11 09:41:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:51.751909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb84b4-6efe-4425-9fdb-1b992d6dc137 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:51.752189 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb84b4-6efe-4425-9fdb-1b992d6dc137 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:51.752464 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb84b4-6efe-4425-9fdb-1b992d6dc137 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:51.753666 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 479/969] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:51.756544 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba3f94-b8ae-4225-a1ed-8ba843ce30be None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:51.760434 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5f1f1-c504-45fc-ad6e-dad191a7feca None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:51.760718 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5f1f1-c504-45fc-ad6e-dad191a7feca None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:51.760995 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5f1f1-c504-45fc-ad6e-dad191a7feca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:51.780103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-72b5f1f1-c504-45fc-ad6e-dad191a7feca None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:51.781286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-72b5f1f1-c504-45fc-ad6e-dad191a7feca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:51.791442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd19ef-7ed4-40ce-b08c-b7e68e993a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:51.792068 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd19ef-7ed4-40ce-b08c-b7e68e993a58 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:51.792342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd19ef-7ed4-40ce-b08c-b7e68e993a58 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:51.792604 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd19ef-7ed4-40ce-b08c-b7e68e993a58 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:51.800563 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd19ef-7ed4-40ce-b08c-b7e68e993a58 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:51.801983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd19ef-7ed4-40ce-b08c-b7e68e993a58 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:51.813569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-9cfd19ef-7ed4-40ce-b08c-b7e68e993a58 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 09:41:51.813569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:51.813569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:51.813569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:51.813569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:51.813569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:51.813569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:51.813569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:51.813569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:51.813569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:51.813569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:51.813569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:51.813569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:51.813569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:51.813569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:51.813569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:51.814591 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:51.814591 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:51.814591 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:51.814591 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:51.814591 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:51.814591 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:51.814591 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:51.814591 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:51.814591 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:51.814591 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:51.814591 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:51.814591 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:51.814591 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:51.814591 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:51.814591 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:51.814591 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:51.814591 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:51.814591 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:51.816194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:51.816194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:51.816194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:51.816194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:51.816194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:51.816194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:51.816194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:51.816194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:51.816194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 09:41:51.816194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:51.816194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 491/970] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Aug 11 09:41:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:51.816194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd19ef-7ed4-40ce-b08c-b7e68e993a58 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:51.858920 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 480/971] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 09:41:51.859760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5f1f1-c504-45fc-ad6e-dad191a7feca None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:51.893593 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:51.923891 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:51.935140 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd19ef-7ed4-40ce-b08c-b7e68e993a58 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:51.968058 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5f1f1-c504-45fc-ad6e-dad191a7feca None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:51.970885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df14007-33ce-422b-8e0b-180095f89220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:51.971490 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df14007-33ce-422b-8e0b-180095f89220 None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:51.971762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df14007-33ce-422b-8e0b-180095f89220 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:51.972025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df14007-33ce-422b-8e0b-180095f89220 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:51.972661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df14007-33ce-422b-8e0b-180095f89220 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:51.974007 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df14007-33ce-422b-8e0b-180095f89220 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:52.002750 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295eba8-b9e1-4200-bd7b-2d81de9467af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:52.003350 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295eba8-b9e1-4200-bd7b-2d81de9467af None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:52.003620 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295eba8-b9e1-4200-bd7b-2d81de9467af None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:52.003883 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295eba8-b9e1-4200-bd7b-2d81de9467af None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:52.004598 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295eba8-b9e1-4200-bd7b-2d81de9467af None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:52.004899 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295eba8-b9e1-4200-bd7b-2d81de9467af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:52.006336 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295eba8-b9e1-4200-bd7b-2d81de9467af None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:52.023367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 481/972] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Aug 11 09:41:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:52.024129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295eba8-b9e1-4200-bd7b-2d81de9467af None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:52.066106 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 492/973] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:41:51 2022] POST /identity/v3/endpoints => generated 349 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:41:52.066106 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df14007-33ce-422b-8e0b-180095f89220 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:52.136821 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295eba8-b9e1-4200-bd7b-2d81de9467af None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:52.156109 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:52.181621 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40b44b-dbb0-4d2a-b2ab-2aebf65a3992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:52.182320 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40b44b-dbb0-4d2a-b2ab-2aebf65a3992 None admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:52.182691 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40b44b-dbb0-4d2a-b2ab-2aebf65a3992 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:52.183049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40b44b-dbb0-4d2a-b2ab-2aebf65a3992 None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:52.183769 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40b44b-dbb0-4d2a-b2ab-2aebf65a3992 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:52.185567 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40b44b-dbb0-4d2a-b2ab-2aebf65a3992 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:52.188500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: WARNING keystone.server.flask.common [None req-cc40b44b-dbb0-4d2a-b2ab-2aebf65a3992 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 11 09:41:52.206116 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df14007-33ce-422b-8e0b-180095f89220 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:52.229686 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:52.233061 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.sql.core [None req-cc40b44b-dbb0-4d2a-b2ab-2aebf65a3992 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 11 09:41:52.233061 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 11 09:41:52.233061 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [parameters: {'user_id': '35088fb0cd0f4bfc88f1178d232c6eb4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 11 09:41:52.233061 dv-cinder-815660-9-smb devstack@keystone.service[98479]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98479) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 11 09:41:52.240074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-cc40b44b-dbb0-4d2a-b2ab-2aebf65a3992 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 11 09:41:52.240074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:52.240074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 11 09:41:52.240074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 11 09:41:52.240074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 11 09:41:52.240074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 11 09:41:52.240074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 11 09:41:52.240074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application result = self._query(query) Aug 11 09:41:52.240074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 11 09:41:52.240074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application conn.query(q) Aug 11 09:41:52.240074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 11 09:41:52.240074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 11 09:41:52.240074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 11 09:41:52.240074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application result.read() Aug 11 09:41:52.240074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 11 09:41:52.241009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 11 09:41:52.241009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 11 09:41:52.241009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 11 09:41:52.241009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 11 09:41:52.241009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 11 09:41:52.241009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 11 09:41:52.241009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 11 09:41:52.241009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 11 09:41:52.241009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:52.241009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 11 09:41:52.241009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:52.241009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:52.241009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 11 09:41:52.241009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 11 09:41:52.241009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 11 09:41:52.241009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 11 09:41:52.241009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 11 09:41:52.241009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application next(self.gen) Aug 11 09:41:52.242026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 11 09:41:52.242026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application yield resource Aug 11 09:41:52.242026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 11 09:41:52.242026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application next(self.gen) Aug 11 09:41:52.242026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 11 09:41:52.242026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self.session.rollback() Aug 11 09:41:52.242026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 11 09:41:52.242026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self.force_reraise() Aug 11 09:41:52.242026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 11 09:41:52.242026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise self.value Aug 11 09:41:52.242026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 11 09:41:52.242026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 11 09:41:52.242026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 11 09:41:52.242026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application session.commit() Aug 11 09:41:52.242026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 11 09:41:52.242026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 11 09:41:52.242026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 11 09:41:52.242987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._prepare_impl() Aug 11 09:41:52.242987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 11 09:41:52.242987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self.session.flush() Aug 11 09:41:52.242987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 11 09:41:52.242987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._flush(objects) Aug 11 09:41:52.242987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 11 09:41:52.242987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 11 09:41:52.242987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 11 09:41:52.242987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application compat.raise_( Aug 11 09:41:52.242987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 11 09:41:52.242987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception Aug 11 09:41:52.242987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 11 09:41:52.242987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application flush_context.execute() Aug 11 09:41:52.242987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 11 09:41:52.242987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rec.execute(self) Aug 11 09:41:52.242987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 11 09:41:52.242987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 11 09:41:52.243884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 11 09:41:52.243884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 11 09:41:52.243884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 11 09:41:52.243884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 11 09:41:52.243884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 11 09:41:52.243884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 11 09:41:52.243884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 11 09:41:52.243884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 11 09:41:52.243884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 11 09:41:52.243884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 11 09:41:52.243884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 11 09:41:52.243884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 11 09:41:52.243884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 11 09:41:52.243884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 11 09:41:52.243884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 11 09:41:52.243884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception Aug 11 09:41:52.244730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 11 09:41:52.244730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 11 09:41:52.244730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 11 09:41:52.244730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 11 09:41:52.244730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 11 09:41:52.244730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application result = self._query(query) Aug 11 09:41:52.244730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 11 09:41:52.244730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application conn.query(q) Aug 11 09:41:52.244730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 11 09:41:52.244730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 11 09:41:52.244730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 11 09:41:52.244730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application result.read() Aug 11 09:41:52.244730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 11 09:41:52.244730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 11 09:41:52.244730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 11 09:41:52.244730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 11 09:41:52.245592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 11 09:41:52.245592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 11 09:41:52.245592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 11 09:41:52.245592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 11 09:41:52.245592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 11 09:41:52.245592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 11 09:41:52.245592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [parameters: {'user_id': '35088fb0cd0f4bfc88f1178d232c6eb4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 11 09:41:52.245592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 11 09:41:52.245592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:52.245592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:41:52.245592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:52.245592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:52.245592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:52.245592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:52.245592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:52.249185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:52.249185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:52.249185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:52.249185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:52.249185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:52.249185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:52.249185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:52.249185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 11 09:41:52.249185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 11 09:41:52.249185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:52.249185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:52.249185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:52.249185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:52.249185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:52.249185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:52.249185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 11 09:41:52.249185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 11 09:41:52.251447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 11 09:41:52.251447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 11 09:41:52.251447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 11 09:41:52.251447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 11 09:41:52.251447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 11 09:41:52.251447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:52.251447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 482/974] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Aug 11 09:41:52 2022] POST /identity/v3/users => generated 160 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:52.251447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40b44b-dbb0-4d2a-b2ab-2aebf65a3992 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:52.263730 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb97fb3-1925-41a6-b38f-15e5c550ebe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:52.264347 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb97fb3-1925-41a6-b38f-15e5c550ebe6 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:52.264624 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb97fb3-1925-41a6-b38f-15e5c550ebe6 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:52.264894 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb97fb3-1925-41a6-b38f-15e5c550ebe6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:52.363541 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb97fb3-1925-41a6-b38f-15e5c550ebe6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:52.365277 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb97fb3-1925-41a6-b38f-15e5c550ebe6 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:52.372635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40b44b-dbb0-4d2a-b2ab-2aebf65a3992 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:52.417672 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f1e20-f9ba-4711-8a74-b0300ec23b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:52.418333 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f1e20-f9ba-4711-8a74-b0300ec23b34 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:52.418613 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f1e20-f9ba-4711-8a74-b0300ec23b34 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:52.418948 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f1e20-f9ba-4711-8a74-b0300ec23b34 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:52.426999 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f1e20-f9ba-4711-8a74-b0300ec23b34 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:52.428598 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f1e20-f9ba-4711-8a74-b0300ec23b34 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:52.441640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-cd7f1e20-f9ba-4711-8a74-b0300ec23b34 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 09:41:52.441640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:52.441640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:52.441640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:52.441640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:52.441640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:52.441640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:52.441640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:52.441640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:52.441640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:52.441640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:52.441640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:52.441640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:41:52.441640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:41:52.441640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:41:52.441640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:41:52.442635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:52.442635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:52.442635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:41:52.442635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:52.442635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:41:52.442635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:41:52.442635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:52.442635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:52.442635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:52.442635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:52.442635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:52.442635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:52.442635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:52.442635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:52.442635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:52.442635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:52.442635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:52.442635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:52.443566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:52.443566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:52.443566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:41:52.443566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:41:52.443566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:41:52.443566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:41:52.443566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:41:52.443566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:41:52.443566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 09:41:52.443566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:52.448059 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 483/975] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:41:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:41:52.449421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f1e20-f9ba-4711-8a74-b0300ec23b34 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:52.486803 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:52.490915 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 493/976] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:41:52 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 09:41:52.497099 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb97fb3-1925-41a6-b38f-15e5c550ebe6 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:52.524140 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:52.569995 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f1e20-f9ba-4711-8a74-b0300ec23b34 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:52.618735 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941fdc8-807a-4736-96bc-23872fb3633b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:52.619344 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941fdc8-807a-4736-96bc-23872fb3633b None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:52.619619 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941fdc8-807a-4736-96bc-23872fb3633b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:52.619886 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941fdc8-807a-4736-96bc-23872fb3633b None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:52.620586 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941fdc8-807a-4736-96bc-23872fb3633b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:52.620886 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941fdc8-807a-4736-96bc-23872fb3633b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:52.622366 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941fdc8-807a-4736-96bc-23872fb3633b None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:52.628473 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb97fb3-1925-41a6-b38f-15e5c550ebe6 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:52.675210 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 484/977] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Aug 11 09:41:52 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:52.681427 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee5522-bdc9-48ad-b045-8d2f06b434d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:52.687629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee5522-bdc9-48ad-b045-8d2f06b434d5 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:52.687629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee5522-bdc9-48ad-b045-8d2f06b434d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:52.687629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee5522-bdc9-48ad-b045-8d2f06b434d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:52.696615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee5522-bdc9-48ad-b045-8d2f06b434d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:52.698485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee5522-bdc9-48ad-b045-8d2f06b434d5 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:52.716731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-94ee5522-bdc9-48ad-b045-8d2f06b434d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:52.716731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:52.716731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:52.716731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:52.716731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:52.716731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:52.716731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:52.716731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:52.716731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:52.716731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:52.716731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:52.716731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:52.716731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:41:52.716731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:41:52.716731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:41:52.716731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:41:52.718056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:52.718056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:52.718056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:52.718056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:52.718056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:52.718056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:52.718056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:52.718056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:52.718056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:52.718056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:52.718056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:52.718056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:52.718056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:52.718056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:52.718056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:52.718056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:52.718056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:41:52.719247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:41:52.719247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:41:52.719247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:52.721113 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 494/978] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:41:52.726786 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941fdc8-807a-4736-96bc-23872fb3633b None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:52.837680 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:52.847676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941fdc8-807a-4736-96bc-23872fb3633b None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:52.886748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87782b64-6273-447e-8526-a9560fdf9643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:52.887364 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87782b64-6273-447e-8526-a9560fdf9643 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:52.887774 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87782b64-6273-447e-8526-a9560fdf9643 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:52.888042 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87782b64-6273-447e-8526-a9560fdf9643 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:52.888688 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87782b64-6273-447e-8526-a9560fdf9643 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:52.888985 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87782b64-6273-447e-8526-a9560fdf9643 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:52.890377 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87782b64-6273-447e-8526-a9560fdf9643 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:52.905379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 485/979] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:52.908491 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee5522-bdc9-48ad-b045-8d2f06b434d5 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:52.986414 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:53.016718 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee5522-bdc9-48ad-b045-8d2f06b434d5 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:53.052164 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac0938-b319-4a75-886c-a8f245324141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:53.052784 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac0938-b319-4a75-886c-a8f245324141 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:53.053059 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac0938-b319-4a75-886c-a8f245324141 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:53.053325 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac0938-b319-4a75-886c-a8f245324141 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:53.060642 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac0938-b319-4a75-886c-a8f245324141 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:53.062070 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac0938-b319-4a75-886c-a8f245324141 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:53.073082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-2dac0938-b319-4a75-886c-a8f245324141 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:53.073082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:53.073082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:53.073082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:53.073082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:53.073082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:53.073082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:53.073082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:53.073082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:53.073082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:53.073082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:53.073082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:53.073082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:41:53.073082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:41:53.073082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:41:53.073983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:41:53.073983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:53.073983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:53.073983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:53.073983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:53.073983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:53.073983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:53.073983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:53.073983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:53.073983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:53.073983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:53.073983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:53.073983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:53.073983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:53.073983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:53.073983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:53.073983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:53.079986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:41:53.079986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:41:53.079986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:41:53.079986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:41:53.079986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:41:53.079986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:41:53.079986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:41:53.079986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:53.079986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 495/980] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:53.082113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87782b64-6273-447e-8526-a9560fdf9643 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:53.186234 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87782b64-6273-447e-8526-a9560fdf9643 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:53.218777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596b291-e40f-4c31-8736-e6f6dc97ed58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:53.219535 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596b291-e40f-4c31-8736-e6f6dc97ed58 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:53.219652 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596b291-e40f-4c31-8736-e6f6dc97ed58 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:53.219920 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596b291-e40f-4c31-8736-e6f6dc97ed58 None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:53.220578 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596b291-e40f-4c31-8736-e6f6dc97ed58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:53.220938 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596b291-e40f-4c31-8736-e6f6dc97ed58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:53.222318 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596b291-e40f-4c31-8736-e6f6dc97ed58 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:53.234944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 486/981] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:41:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:41:53.240675 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac0938-b319-4a75-886c-a8f245324141 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:53.342156 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac0938-b319-4a75-886c-a8f245324141 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:53.370946 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:53.376226 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3577f-7c18-46ae-b536-db0e674d8233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:53.376832 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3577f-7c18-46ae-b536-db0e674d8233 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:53.377105 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3577f-7c18-46ae-b536-db0e674d8233 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:53.377380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3577f-7c18-46ae-b536-db0e674d8233 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:53.378115 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3577f-7c18-46ae-b536-db0e674d8233 None admin] RBAC: Adding query filter params (role.id=4bbbd0046bb94973a14f7273d3e23c0c, scope.project.id=a0211f5c0b174c8c998e3ad29f96baab, user.id=d392c30328a3491bb186bd7b55f4d99c) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:53.378425 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3577f-7c18-46ae-b536-db0e674d8233 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:53.379853 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3577f-7c18-46ae-b536-db0e674d8233 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:53.390211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 496/982] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:41:53 2022] GET /identity/v3/role_assignments?user.id=d392c30328a3491bb186bd7b55f4d99c&scope.project.id=a0211f5c0b174c8c998e3ad29f96baab&role.id=4bbbd0046bb94973a14f7273d3e23c0c => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:53.615299 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c9504-fdc4-4425-8faa-a6c871434c31 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:53.615674 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c9504-fdc4-4425-8faa-a6c871434c31 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:53.615882 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c9504-fdc4-4425-8faa-a6c871434c31 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:53.617393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 487/983] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:53.622377 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cf868-4f03-438e-9e68-26c06758b3db None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:53.622716 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cf868-4f03-438e-9e68-26c06758b3db None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:53.622997 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cf868-4f03-438e-9e68-26c06758b3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:53.641450 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-b78cf868-4f03-438e-9e68-26c06758b3db None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:53.642675 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-b78cf868-4f03-438e-9e68-26c06758b3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:53.719016 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 497/984] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:41:53.741323 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c9504-fdc4-4425-8faa-a6c871434c31 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:53.756532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:53.846448 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c9504-fdc4-4425-8faa-a6c871434c31 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:53.882476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287c5ce-db70-48bc-b793-ad38412fc535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:53.883020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287c5ce-db70-48bc-b793-ad38412fc535 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:53.883298 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287c5ce-db70-48bc-b793-ad38412fc535 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:53.883559 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287c5ce-db70-48bc-b793-ad38412fc535 None admin] PATH_INFO: `/v3/services/compute` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:53.884135 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287c5ce-db70-48bc-b793-ad38412fc535 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:53.885489 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287c5ce-db70-48bc-b793-ad38412fc535 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:53.894088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-4287c5ce-db70-48bc-b793-ad38412fc535 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 09:41:53.894088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:53.894088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:41:53.894088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:41:53.894088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:41:53.894088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:41:53.894088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:41:53.894088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:53.894088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 09:41:53.894088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:53.894088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:41:53.894088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:53.894088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:53.894088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:53.894088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:53.894088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:53.894088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:53.895123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:53.895123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:53.895123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:53.895123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:53.895123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:53.895123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:53.895123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:41:53.895123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:41:53.895123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:41:53.895123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:41:53.895123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:53.895123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:53.895123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:53.895123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:53.895123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:53.895123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:53.895961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:53.895961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:53.895961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:53.895961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:53.895961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:53.895961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:53.895961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:53.895961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:53.895961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:53.895961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:53.895961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:41:53.895961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:53.895961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 09:41:53.895961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:53.898410 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 488/985] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:53.901564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cf868-4f03-438e-9e68-26c06758b3db None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:53.998955 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cf868-4f03-438e-9e68-26c06758b3db None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:54.025068 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:54.034015 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5496be6-35aa-4161-b9de-a99cb1d305a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:54.037624 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5496be6-35aa-4161-b9de-a99cb1d305a6 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:54.037624 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5496be6-35aa-4161-b9de-a99cb1d305a6 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:54.037624 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5496be6-35aa-4161-b9de-a99cb1d305a6 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:54.037624 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5496be6-35aa-4161-b9de-a99cb1d305a6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:54.037624 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5496be6-35aa-4161-b9de-a99cb1d305a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:54.037624 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5496be6-35aa-4161-b9de-a99cb1d305a6 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:54.046922 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 498/986] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Aug 11 09:41:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:54.048298 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287c5ce-db70-48bc-b793-ad38412fc535 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:54.126466 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:54.149877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287c5ce-db70-48bc-b793-ad38412fc535 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:54.160804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb3bfd-64f5-48fb-b99d-df34ee0e6e1d None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:54.161079 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb3bfd-64f5-48fb-b99d-df34ee0e6e1d None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:54.161341 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb3bfd-64f5-48fb-b99d-df34ee0e6e1d None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:54.162977 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 499/987] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:54.167667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631a5e6-9a9b-4f9a-bb28-f7cb9c3631fa None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:54.167947 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631a5e6-9a9b-4f9a-bb28-f7cb9c3631fa None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:54.168386 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631a5e6-9a9b-4f9a-bb28-f7cb9c3631fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:54.186715 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-b631a5e6-9a9b-4f9a-bb28-f7cb9c3631fa None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:54.187314 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0dd2e-91b9-4d1a-804e-2d6bdadc8e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:54.187865 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-b631a5e6-9a9b-4f9a-bb28-f7cb9c3631fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:54.188093 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0dd2e-91b9-4d1a-804e-2d6bdadc8e39 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:54.188373 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0dd2e-91b9-4d1a-804e-2d6bdadc8e39 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:54.188640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0dd2e-91b9-4d1a-804e-2d6bdadc8e39 None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:54.189264 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0dd2e-91b9-4d1a-804e-2d6bdadc8e39 None admin] RBAC: Adding query filter params (type=compute) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:54.189566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0dd2e-91b9-4d1a-804e-2d6bdadc8e39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:54.190966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0dd2e-91b9-4d1a-804e-2d6bdadc8e39 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:54.196490 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 489/988] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Aug 11 09:41:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:41:54.202150 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0dd2e-91b9-4d1a-804e-2d6bdadc8e39 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:54.262807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 500/989] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:54 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 09:41:54.284502 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631a5e6-9a9b-4f9a-bb28-f7cb9c3631fa None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:54.308861 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0dd2e-91b9-4d1a-804e-2d6bdadc8e39 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:54.344353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4bf20-1976-4759-9618-1b6f06bfbc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:54.345160 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4bf20-1976-4759-9618-1b6f06bfbc85 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:54.345618 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4bf20-1976-4759-9618-1b6f06bfbc85 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:54.346141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4bf20-1976-4759-9618-1b6f06bfbc85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:54.347095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4bf20-1976-4759-9618-1b6f06bfbc85 None admin] RBAC: Adding query filter params (interface=public, service_id=df4d2d7620934b888bef20bac46fdcbf, region_id=RegionOne) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:54.347682 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4bf20-1976-4759-9618-1b6f06bfbc85 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:54.349062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4bf20-1976-4759-9618-1b6f06bfbc85 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:54.358235 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 490/990] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Aug 11 09:41:54 2022] GET /identity/v3/endpoints?service_id=df4d2d7620934b888bef20bac46fdcbf&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:41:54.359759 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4bf20-1976-4759-9618-1b6f06bfbc85 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:54.363517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:54.382683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631a5e6-9a9b-4f9a-bb28-f7cb9c3631fa None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:54.404214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:54.418102 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d18df-a21d-48e1-9ac9-56ca0ba2c6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:54.418735 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d18df-a21d-48e1-9ac9-56ca0ba2c6db None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:54.419052 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d18df-a21d-48e1-9ac9-56ca0ba2c6db None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:54.419330 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d18df-a21d-48e1-9ac9-56ca0ba2c6db None admin] PATH_INFO: `/v3/services/object-store` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:54.419904 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d18df-a21d-48e1-9ac9-56ca0ba2c6db None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:54.421257 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d18df-a21d-48e1-9ac9-56ca0ba2c6db None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:54.430487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-0f4d18df-a21d-48e1-9ac9-56ca0ba2c6db None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 09:41:54.430487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:54.430487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:41:54.430487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:41:54.430487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:41:54.430487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:41:54.430487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:41:54.430487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:54.430487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 09:41:54.430487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:54.430487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:41:54.430487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:54.430487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:54.430487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:54.430487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:54.430487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:54.430487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:54.434376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:54.434376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:54.434376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:54.434376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:54.434376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:54.434376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:54.434376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:41:54.434376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:41:54.434376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:41:54.434376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:41:54.434376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:54.434376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:54.434376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:54.434376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:54.434376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:54.434376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:54.435451 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:54.435451 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:54.435451 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:54.435451 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:54.435451 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:54.435451 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:54.435451 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:54.435451 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:54.435451 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:54.435451 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:54.435451 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:41:54.435451 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:54.435451 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 09:41:54.435451 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:54.435451 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 501/991] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Aug 11 09:41:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:41:54.437463 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d18df-a21d-48e1-9ac9-56ca0ba2c6db None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:54.470308 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4bf20-1976-4759-9618-1b6f06bfbc85 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:54.505936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16550980-0ba4-4283-a4b8-5c44c1427e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:54.506572 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16550980-0ba4-4283-a4b8-5c44c1427e50 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:54.506883 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16550980-0ba4-4283-a4b8-5c44c1427e50 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:54.507152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16550980-0ba4-4283-a4b8-5c44c1427e50 None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:54.507758 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16550980-0ba4-4283-a4b8-5c44c1427e50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:54.509153 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16550980-0ba4-4283-a4b8-5c44c1427e50 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:54.526114 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 491/992] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Aug 11 09:41:54 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 09:41:54.560054 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d18df-a21d-48e1-9ac9-56ca0ba2c6db None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:54.608905 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d80ce5-1d85-4a1a-99f6-0d7a59cf16d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:54.609845 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d80ce5-1d85-4a1a-99f6-0d7a59cf16d7 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:54.610317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d80ce5-1d85-4a1a-99f6-0d7a59cf16d7 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:54.610620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d80ce5-1d85-4a1a-99f6-0d7a59cf16d7 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:54.611245 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d80ce5-1d85-4a1a-99f6-0d7a59cf16d7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:54.611543 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d80ce5-1d85-4a1a-99f6-0d7a59cf16d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:54.612954 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d80ce5-1d85-4a1a-99f6-0d7a59cf16d7 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:54.620954 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 502/993] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Aug 11 09:41:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:54.626864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16550980-0ba4-4283-a4b8-5c44c1427e50 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:54.704441 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:54.739450 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16550980-0ba4-4283-a4b8-5c44c1427e50 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:54.775539 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911d6ce-15cb-42be-bf39-bb4339e5c88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:54.776216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d6ce-15cb-42be-bf39-bb4339e5c88a None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:54.776531 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d6ce-15cb-42be-bf39-bb4339e5c88a None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:54.776717 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d6ce-15cb-42be-bf39-bb4339e5c88a None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:54.777333 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911d6ce-15cb-42be-bf39-bb4339e5c88a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:54.777630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911d6ce-15cb-42be-bf39-bb4339e5c88a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:54.779024 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911d6ce-15cb-42be-bf39-bb4339e5c88a None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:54.789447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 492/994] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Aug 11 09:41:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:54.790731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d80ce5-1d85-4a1a-99f6-0d7a59cf16d7 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:54.841389 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:54.893011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d80ce5-1d85-4a1a-99f6-0d7a59cf16d7 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:54.933441 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088896c-f2a4-4958-b495-3df1c4ec923e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:54.933969 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088896c-f2a4-4958-b495-3df1c4ec923e None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:54.934275 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088896c-f2a4-4958-b495-3df1c4ec923e None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:54.934550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088896c-f2a4-4958-b495-3df1c4ec923e None admin] PATH_INFO: `/v3/endpoints` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:54.935249 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088896c-f2a4-4958-b495-3df1c4ec923e None admin] RBAC: Adding query filter params (interface=admin, service_id=d87a735c59514496854c370257899670, region_id=RegionOne) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:54.935557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088896c-f2a4-4958-b495-3df1c4ec923e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:54.936905 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088896c-f2a4-4958-b495-3df1c4ec923e None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:54.942182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 503/995] 10.222.0.13 () {56 vars in 1249 bytes} [Thu Aug 11 09:41:54 2022] GET /identity/v3/endpoints?service_id=d87a735c59514496854c370257899670&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:54.947733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911d6ce-15cb-42be-bf39-bb4339e5c88a None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:55.049708 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911d6ce-15cb-42be-bf39-bb4339e5c88a None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:55.078984 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:55.084448 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af7942-8ad9-40e4-8885-02f0b0aa535a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:55.092066 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af7942-8ad9-40e4-8885-02f0b0aa535a None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:55.092066 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af7942-8ad9-40e4-8885-02f0b0aa535a None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:55.092066 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af7942-8ad9-40e4-8885-02f0b0aa535a None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:55.092066 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af7942-8ad9-40e4-8885-02f0b0aa535a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:55.092066 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af7942-8ad9-40e4-8885-02f0b0aa535a None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:55.100497 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 493/996] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Aug 11 09:41:54 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:41:55.429232 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc48bd-544b-404d-b642-7800ff8de2de None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:55.429789 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc48bd-544b-404d-b642-7800ff8de2de None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:55.429789 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc48bd-544b-404d-b642-7800ff8de2de None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:55.431294 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 504/997] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:55.436072 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4d9d9-5fc8-43d2-874f-b7237f7f2044 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:55.436352 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4d9d9-5fc8-43d2-874f-b7237f7f2044 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:55.436616 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4d9d9-5fc8-43d2-874f-b7237f7f2044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:55.454300 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-4ab4d9d9-5fc8-43d2-874f-b7237f7f2044 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:55.455796 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-4ab4d9d9-5fc8-43d2-874f-b7237f7f2044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:55.519538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 494/998] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:55 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:41:55.541052 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc48bd-544b-404d-b642-7800ff8de2de None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:55.647021 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc48bd-544b-404d-b642-7800ff8de2de None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:55.664455 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:55.685933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387713b-737a-4b24-9764-8c4194a1ce05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:55.686515 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387713b-737a-4b24-9764-8c4194a1ce05 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:55.686784 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387713b-737a-4b24-9764-8c4194a1ce05 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:55.687043 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387713b-737a-4b24-9764-8c4194a1ce05 None admin] PATH_INFO: `/v3/services/image` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:55.687604 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387713b-737a-4b24-9764-8c4194a1ce05 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:55.688962 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387713b-737a-4b24-9764-8c4194a1ce05 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:55.698326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-f387713b-737a-4b24-9764-8c4194a1ce05 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 09:41:55.698326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:55.698326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:41:55.698326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:41:55.698326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:41:55.698326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:41:55.698326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:41:55.698326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:55.698326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 09:41:55.698326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:55.698326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:41:55.698326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:55.698326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:55.698326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:55.698326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:55.698326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:55.698326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:55.699324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:55.699324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:55.699324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:55.699324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:55.699324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:55.699324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:55.699324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:41:55.699324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:41:55.699324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:41:55.699324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:41:55.699324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:55.699324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:55.699324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:55.699324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:55.699324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:55.699324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:55.700167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:55.700167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:55.700167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:55.700167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:55.700167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:55.700167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:55.700167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:55.700167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:55.700167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:55.700167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:55.700167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:41:55.700167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:55.700167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 09:41:55.700167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:55.702717 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 505/999] 10.222.0.13 () {56 vars in 1105 bytes} [Thu Aug 11 09:41:55 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:55.705330 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4d9d9-5fc8-43d2-874f-b7237f7f2044 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:55.807239 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4d9d9-5fc8-43d2-874f-b7237f7f2044 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:55.832909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:55.841781 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32238b-f117-4d40-8307-787a9fdf30ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:55.842405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32238b-f117-4d40-8307-787a9fdf30ba None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:55.842679 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32238b-f117-4d40-8307-787a9fdf30ba None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:55.842947 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32238b-f117-4d40-8307-787a9fdf30ba None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:55.843585 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32238b-f117-4d40-8307-787a9fdf30ba None admin] RBAC: Adding query filter params (name=image) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:55.843881 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32238b-f117-4d40-8307-787a9fdf30ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:55.845240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32238b-f117-4d40-8307-787a9fdf30ba None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:55.854422 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 495/1000] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:41:55.855642 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387713b-737a-4b24-9764-8c4194a1ce05 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:55.955888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387713b-737a-4b24-9764-8c4194a1ce05 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:55.988691 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70058abe-2083-41ec-9a94-00d5c0821589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:55.989336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70058abe-2083-41ec-9a94-00d5c0821589 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:55.989612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70058abe-2083-41ec-9a94-00d5c0821589 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:55.989876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70058abe-2083-41ec-9a94-00d5c0821589 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:55.990513 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70058abe-2083-41ec-9a94-00d5c0821589 None admin] RBAC: Adding query filter params (type=image) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:55.990811 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70058abe-2083-41ec-9a94-00d5c0821589 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:55.992756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70058abe-2083-41ec-9a94-00d5c0821589 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:55.998755 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 506/1001] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:41:55 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:56.571822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afc985-8419-47e0-8e15-eb0c1c0fab8e None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:56.572149 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afc985-8419-47e0-8e15-eb0c1c0fab8e None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:56.572372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afc985-8419-47e0-8e15-eb0c1c0fab8e None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:56.573859 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 496/1002] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:56.578951 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655825cf-d0db-4df9-91b2-0a14190d2d4e None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:56.579431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655825cf-d0db-4df9-91b2-0a14190d2d4e None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:56.579520 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655825cf-d0db-4df9-91b2-0a14190d2d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:56.597648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-655825cf-d0db-4df9-91b2-0a14190d2d4e None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:56.598843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-655825cf-d0db-4df9-91b2-0a14190d2d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:56.632655 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:56.673114 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 507/1003] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:41:56.696171 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afc985-8419-47e0-8e15-eb0c1c0fab8e None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:56.798436 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afc985-8419-47e0-8e15-eb0c1c0fab8e None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:56.833086 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b8a0b-a4b9-4dd0-afa5-715047dab576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:56.833720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b8a0b-a4b9-4dd0-afa5-715047dab576 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:56.833937 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b8a0b-a4b9-4dd0-afa5-715047dab576 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:56.834180 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b8a0b-a4b9-4dd0-afa5-715047dab576 None admin] PATH_INFO: `/v3/services/compute` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:56.835314 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b8a0b-a4b9-4dd0-afa5-715047dab576 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:56.836685 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b8a0b-a4b9-4dd0-afa5-715047dab576 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:56.845328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-6f8b8a0b-a4b9-4dd0-afa5-715047dab576 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 09:41:56.845328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:56.845328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:41:56.845328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:41:56.845328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:41:56.845328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:41:56.845328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:41:56.845328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:56.845328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 09:41:56.845328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:56.845328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:41:56.845328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:56.845328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:56.845328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:56.845328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:56.845328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:56.845328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:56.846582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:56.846582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:56.846582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:56.846582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:56.846582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:56.846582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:56.846582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:41:56.846582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:41:56.846582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:41:56.846582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:41:56.846582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:56.846582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:56.846582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:56.846582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:56.846582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:56.846582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:56.847486 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:56.847486 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:56.847486 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:56.847486 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:56.847486 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:56.847486 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:56.847486 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:56.847486 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:56.847486 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:56.847486 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:56.847486 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:41:56.847486 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:56.847486 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 09:41:56.847486 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:41:56.850409 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 497/1004] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:41:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:56.852464 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655825cf-d0db-4df9-91b2-0a14190d2d4e None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:56.952582 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655825cf-d0db-4df9-91b2-0a14190d2d4e None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:56.986715 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2b80d-5673-4be0-9f87-61184fa8335d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:56.987319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2b80d-5673-4be0-9f87-61184fa8335d None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:56.987596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2b80d-5673-4be0-9f87-61184fa8335d None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:56.987867 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2b80d-5673-4be0-9f87-61184fa8335d None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:56.988482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2b80d-5673-4be0-9f87-61184fa8335d None admin] RBAC: Adding query filter params (name=compute) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:56.988781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2b80d-5673-4be0-9f87-61184fa8335d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:56.990154 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2b80d-5673-4be0-9f87-61184fa8335d None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:56.999410 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 508/1005] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Aug 11 09:41:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:57.000915 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b8a0b-a4b9-4dd0-afa5-715047dab576 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:57.058194 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:57.105668 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b8a0b-a4b9-4dd0-afa5-715047dab576 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:57.107969 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf413eb-2acf-4aee-aa33-41bc40e91c46 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:57.108251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf413eb-2acf-4aee-aa33-41bc40e91c46 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:57.108517 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf413eb-2acf-4aee-aa33-41bc40e91c46 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:57.109856 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 509/1006] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:41:57.114682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935b91b-71c5-413b-be95-b6cf9ee88ab4 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:57.114965 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935b91b-71c5-413b-be95-b6cf9ee88ab4 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:57.115232 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935b91b-71c5-413b-be95-b6cf9ee88ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:57.134159 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-2935b91b-71c5-413b-be95-b6cf9ee88ab4 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:57.135359 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-2935b91b-71c5-413b-be95-b6cf9ee88ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:57.143567 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef98ca4-d4e2-4047-89df-f1191c2e533c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:57.144378 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef98ca4-d4e2-4047-89df-f1191c2e533c None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:57.144931 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef98ca4-d4e2-4047-89df-f1191c2e533c None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:57.145208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef98ca4-d4e2-4047-89df-f1191c2e533c None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:57.145829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef98ca4-d4e2-4047-89df-f1191c2e533c None admin] RBAC: Adding query filter params (type=compute) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:57.146155 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef98ca4-d4e2-4047-89df-f1191c2e533c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:57.147659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef98ca4-d4e2-4047-89df-f1191c2e533c None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:57.157553 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 498/1007] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Aug 11 09:41:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:57.159371 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef98ca4-d4e2-4047-89df-f1191c2e533c None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:57.165783 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:57.209735 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 510/1008] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 09:41:57.232358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935b91b-71c5-413b-be95-b6cf9ee88ab4 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:57.266005 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef98ca4-d4e2-4047-89df-f1191c2e533c None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:57.285396 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:57.302170 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7292d4b-b0f3-4d75-807c-82b533af11cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:57.302775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7292d4b-b0f3-4d75-807c-82b533af11cb None admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:57.303056 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7292d4b-b0f3-4d75-807c-82b533af11cb None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:57.304175 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7292d4b-b0f3-4d75-807c-82b533af11cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:57.304820 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7292d4b-b0f3-4d75-807c-82b533af11cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:57.306305 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7292d4b-b0f3-4d75-807c-82b533af11cb None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:57.337433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935b91b-71c5-413b-be95-b6cf9ee88ab4 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:57.370219 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60aab16-94cd-4159-81b5-7b69663014ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:57.370775 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60aab16-94cd-4159-81b5-7b69663014ec None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:57.371049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60aab16-94cd-4159-81b5-7b69663014ec None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:57.371314 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60aab16-94cd-4159-81b5-7b69663014ec None admin] PATH_INFO: `/v3/services/object-store` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:57.371885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60aab16-94cd-4159-81b5-7b69663014ec None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:57.373224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60aab16-94cd-4159-81b5-7b69663014ec None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:57.382117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-b60aab16-94cd-4159-81b5-7b69663014ec None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 09:41:57.382117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:57.382117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:41:57.382117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:41:57.382117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:41:57.382117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:41:57.382117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:41:57.382117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:57.382117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 09:41:57.382117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:57.382117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:41:57.382117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:57.382117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:57.382117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:57.382117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:57.382117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:57.382117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:57.388757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:57.388757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:57.388757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:57.388757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:57.388757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:57.388757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:57.388757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:41:57.388757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:41:57.388757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:41:57.388757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:41:57.388757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:57.388757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:57.388757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:57.388757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:57.388757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:57.388757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:57.389670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:57.389670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:57.389670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:57.389670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:57.389670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:57.389670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:57.389670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:57.389670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:57.389670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:57.389670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:57.389670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:41:57.389670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:41:57.389670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 09:41:57.389670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:57.389670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 511/1009] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Aug 11 09:41:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:41:57.390716 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60aab16-94cd-4159-81b5-7b69663014ec None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:57.424189 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 499/1010] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:41:57 2022] POST /identity/v3/endpoints => generated 334 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 09:41:57.428208 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:57.508903 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60aab16-94cd-4159-81b5-7b69663014ec None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:57.551199 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955803b-9095-462f-b831-157d246221b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:57.551813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955803b-9095-462f-b831-157d246221b8 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:57.552086 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955803b-9095-462f-b831-157d246221b8 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:57.552350 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955803b-9095-462f-b831-157d246221b8 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:57.552970 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955803b-9095-462f-b831-157d246221b8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:57.553266 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955803b-9095-462f-b831-157d246221b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:57.555470 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955803b-9095-462f-b831-157d246221b8 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:57.560866 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 512/1011] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Aug 11 09:41:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:41:57.566690 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7292d4b-b0f3-4d75-807c-82b533af11cb None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:57.681084 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7292d4b-b0f3-4d75-807c-82b533af11cb None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:57.724278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda12525-ec7d-4f53-b215-4e60fb1bb805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:57.724875 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda12525-ec7d-4f53-b215-4e60fb1bb805 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:57.725144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda12525-ec7d-4f53-b215-4e60fb1bb805 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:57.725931 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda12525-ec7d-4f53-b215-4e60fb1bb805 None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:57.726582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda12525-ec7d-4f53-b215-4e60fb1bb805 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:41:57.727031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda12525-ec7d-4f53-b215-4e60fb1bb805 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:57.728429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda12525-ec7d-4f53-b215-4e60fb1bb805 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:57.733860 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 500/1012] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Aug 11 09:41:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:41:57.739312 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955803b-9095-462f-b831-157d246221b8 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:57.826895 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:57.839896 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955803b-9095-462f-b831-157d246221b8 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:57.879189 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fe246-6a41-4980-9fdf-31aec9da043e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:57.879791 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fe246-6a41-4980-9fdf-31aec9da043e None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:57.880064 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fe246-6a41-4980-9fdf-31aec9da043e None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:57.880329 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fe246-6a41-4980-9fdf-31aec9da043e None admin] PATH_INFO: `/v3/endpoints` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:57.880981 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fe246-6a41-4980-9fdf-31aec9da043e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:57.882396 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fe246-6a41-4980-9fdf-31aec9da043e None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:57.971504 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 513/1013] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:41:57 2022] POST /identity/v3/endpoints => generated 325 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 09:41:58.000055 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66452133-2dbe-44d7-899e-c4745182af54 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:58.000609 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66452133-2dbe-44d7-899e-c4745182af54 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:58.000609 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66452133-2dbe-44d7-899e-c4745182af54 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:58.002178 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 501/1014] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:58.007817 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa98f7e-3079-42bb-aa8f-5a176a910904 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:58.008105 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa98f7e-3079-42bb-aa8f-5a176a910904 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:58.008366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa98f7e-3079-42bb-aa8f-5a176a910904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:58.031214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-dfa98f7e-3079-42bb-aa8f-5a176a910904 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:58.032444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-dfa98f7e-3079-42bb-aa8f-5a176a910904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:58.112836 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 514/1015] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:58 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:41:58.135295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66452133-2dbe-44d7-899e-c4745182af54 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:58.177580 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:58.239309 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66452133-2dbe-44d7-899e-c4745182af54 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:58.275663 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ca649-c6e3-4cbd-9c0c-29e9cf3ed04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:58.276268 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ca649-c6e3-4cbd-9c0c-29e9cf3ed04e None admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:58.276543 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ca649-c6e3-4cbd-9c0c-29e9cf3ed04e None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:58.276809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ca649-c6e3-4cbd-9c0c-29e9cf3ed04e None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:58.277436 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ca649-c6e3-4cbd-9c0c-29e9cf3ed04e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:41:58.278833 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ca649-c6e3-4cbd-9c0c-29e9cf3ed04e None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:41:58.352625 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 502/1016] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Aug 11 09:41:58 2022] POST /identity/v3/services => generated 242 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:41:59.571645 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63528b-d622-4db0-834c-98a3a4fce994 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:59.572172 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63528b-d622-4db0-834c-98a3a4fce994 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:59.572172 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63528b-d622-4db0-834c-98a3a4fce994 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:59.573532 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 515/1017] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:41:59.578464 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dca5c9-52f9-4530-b603-a863c1526a9f None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:59.578842 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dca5c9-52f9-4530-b603-a863c1526a9f None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:59.579023 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dca5c9-52f9-4530-b603-a863c1526a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:59.597349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-62dca5c9-52f9-4530-b603-a863c1526a9f None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:41:59.598557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-62dca5c9-52f9-4530-b603-a863c1526a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:41:59.677808 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 503/1018] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:41:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:41:59.701959 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63528b-d622-4db0-834c-98a3a4fce994 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:59.779109 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:59.805722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63528b-d622-4db0-834c-98a3a4fce994 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:41:59.839552 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3629a97-7600-4098-8d7f-c2f1fe443d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:41:59.840495 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3629a97-7600-4098-8d7f-c2f1fe443d6b None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:41:59.840781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3629a97-7600-4098-8d7f-c2f1fe443d6b None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:41:59.841044 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3629a97-7600-4098-8d7f-c2f1fe443d6b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:41:59.851375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3629a97-7600-4098-8d7f-c2f1fe443d6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:41:59.855920 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-d3629a97-7600-4098-8d7f-c2f1fe443d6b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 09:41:59.855920 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:41:59.855920 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:41:59.855920 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:41:59.855920 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:41:59.855920 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:41:59.855920 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:41:59.855920 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:41:59.855920 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:41:59.855920 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:41:59.855920 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:41:59.855920 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:41:59.855920 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:41:59.855920 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:41:59.855920 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:41:59.855920 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:41:59.856855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:41:59.856855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:41:59.856855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:41:59.856855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:41:59.856855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:41:59.856855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:41:59.856855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:41:59.856855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:41:59.856855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:41:59.856855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:41:59.856855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:41:59.856855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:41:59.856855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:41:59.856855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:41:59.856855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:41:59.856855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:41:59.857713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:41:59.857713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:41:59.857713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:41:59.857713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:41:59.857713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:41:59.857713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:41:59.857713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:41:59.857713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:41:59.857713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:41:59.857713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:41:59.857713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 09:41:59.857713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:41:59.865176 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 516/1019] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Aug 11 09:41:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:41:59.865320 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dca5c9-52f9-4530-b603-a863c1526a9f None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:41:59.889421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:41:59.978095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dca5c9-52f9-4530-b603-a863c1526a9f None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:00.018605 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06197dc4-47b5-4066-9c0c-021b02fadbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:00.019219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06197dc4-47b5-4066-9c0c-021b02fadbbd None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:00.019501 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06197dc4-47b5-4066-9c0c-021b02fadbbd None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:00.019770 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06197dc4-47b5-4066-9c0c-021b02fadbbd None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:00.020435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06197dc4-47b5-4066-9c0c-021b02fadbbd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:00.020731 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06197dc4-47b5-4066-9c0c-021b02fadbbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:00.022178 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06197dc4-47b5-4066-9c0c-021b02fadbbd None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:00.035092 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 504/1020] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Aug 11 09:41:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:00.036543 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3629a97-7600-4098-8d7f-c2f1fe443d6b None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:00.130807 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda5e49-f0cf-49bf-b6ba-446d2cb00a56 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:00.130982 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda5e49-f0cf-49bf-b6ba-446d2cb00a56 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:00.131280 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda5e49-f0cf-49bf-b6ba-446d2cb00a56 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:00.132610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 505/1021] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:42:00.137481 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b57494-aa1d-4ddc-b90c-50474ebdc45c None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:00.137756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b57494-aa1d-4ddc-b90c-50474ebdc45c None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:00.138026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b57494-aa1d-4ddc-b90c-50474ebdc45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:00.141571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3629a97-7600-4098-8d7f-c2f1fe443d6b None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:00.156818 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-35b57494-aa1d-4ddc-b90c-50474ebdc45c None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:00.158121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-35b57494-aa1d-4ddc-b90c-50474ebdc45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:00.179064 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cec94-b15b-458a-88c6-495d049bf82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:00.179680 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cec94-b15b-458a-88c6-495d049bf82a None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:00.179951 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cec94-b15b-458a-88c6-495d049bf82a None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:00.180211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cec94-b15b-458a-88c6-495d049bf82a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:00.182593 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:00.191708 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29cec94-b15b-458a-88c6-495d049bf82a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:00.193178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29cec94-b15b-458a-88c6-495d049bf82a None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:00.207026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-b29cec94-b15b-458a-88c6-495d049bf82a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:42:00.207026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:00.207026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:00.207026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:00.207026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:00.207026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:00.207026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:00.207026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:00.207026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:00.207026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:00.207026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:00.207026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:00.207026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:42:00.207026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:42:00.207026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:42:00.207026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:42:00.208017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:00.208017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:00.208017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:00.208017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:00.208017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:00.208017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:00.208017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:00.208017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:00.208017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:00.208017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:00.208017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:00.208017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:00.208017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:00.208017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:00.208017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:00.208017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:00.208017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:42:00.209051 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:42:00.209051 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:42:00.209051 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:42:00.209051 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 517/1022] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:42:00.214418 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cec94-b15b-458a-88c6-495d049bf82a None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:00.232612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 506/1023] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 09:42:00.255449 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b57494-aa1d-4ddc-b90c-50474ebdc45c None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:00.273009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:00.327373 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cec94-b15b-458a-88c6-495d049bf82a None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:00.367653 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b57494-aa1d-4ddc-b90c-50474ebdc45c None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:00.369519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22b9ad-65e5-4f27-a910-e3d7981daef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:00.370148 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22b9ad-65e5-4f27-a910-e3d7981daef4 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:00.370428 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22b9ad-65e5-4f27-a910-e3d7981daef4 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:00.370697 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22b9ad-65e5-4f27-a910-e3d7981daef4 None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:00.371336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22b9ad-65e5-4f27-a910-e3d7981daef4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:00.371632 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22b9ad-65e5-4f27-a910-e3d7981daef4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:00.372991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22b9ad-65e5-4f27-a910-e3d7981daef4 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:00.385563 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 518/1024] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:42:00.386677 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40200822-b8bc-4ac7-b1ad-27a070ef2949 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:00.386955 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40200822-b8bc-4ac7-b1ad-27a070ef2949 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:00.387224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40200822-b8bc-4ac7-b1ad-27a070ef2949 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:00.388401 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 519/1025] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:42:00.392820 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40200822-b8bc-4ac7-b1ad-27a070ef2949 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:00.410902 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c83dde-9164-447d-ac49-43c1ebd5b63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:00.411528 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c83dde-9164-447d-ac49-43c1ebd5b63e None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:00.411802 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c83dde-9164-447d-ac49-43c1ebd5b63e None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:00.412060 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c83dde-9164-447d-ac49-43c1ebd5b63e None admin] PATH_INFO: `/v3/domains/default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:00.413746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c83dde-9164-447d-ac49-43c1ebd5b63e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:00.415179 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c83dde-9164-447d-ac49-43c1ebd5b63e None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:00.416720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 507/1026] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:42:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:42:00.419890 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5d42a-2ef6-4fc5-a42f-93ec418d4bbb None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:00.420277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5d42a-2ef6-4fc5-a42f-93ec418d4bbb None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:00.420551 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5d42a-2ef6-4fc5-a42f-93ec418d4bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:00.438635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-24f5d42a-2ef6-4fc5-a42f-93ec418d4bbb None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:00.439817 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-24f5d42a-2ef6-4fc5-a42f-93ec418d4bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:00.441235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:00.496823 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40200822-b8bc-4ac7-b1ad-27a070ef2949 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:00.508093 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 508/1027] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:42:00.508890 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5d42a-2ef6-4fc5-a42f-93ec418d4bbb None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:00.524169 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:00.535268 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40cf9d-7b02-409b-84cf-89c9cc4e7cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:00.536017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40cf9d-7b02-409b-84cf-89c9cc4e7cff None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:00.536293 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40cf9d-7b02-409b-84cf-89c9cc4e7cff None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:00.536560 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40cf9d-7b02-409b-84cf-89c9cc4e7cff None admin] PATH_INFO: `/v3/users/nova` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:00.543648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40cf9d-7b02-409b-84cf-89c9cc4e7cff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:00.545181 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40cf9d-7b02-409b-84cf-89c9cc4e7cff None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:00.556610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-af40cf9d-7b02-409b-84cf-89c9cc4e7cff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 09:42:00.556610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:00.556610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:00.556610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:00.556610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:00.556610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:00.556610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:00.556610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:00.556610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:00.556610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:00.556610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:00.556610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:00.556610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:42:00.556610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:42:00.556610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:42:00.556610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:42:00.557807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:00.557807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:00.557807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:42:00.557807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:42:00.557807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:42:00.557807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:42:00.557807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:00.557807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:00.557807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:00.557807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:00.557807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:00.557807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:00.557807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:00.557807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:00.557807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:00.557807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:00.557807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:00.557807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:00.558872 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:00.558872 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:00.558872 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:42:00.558872 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:42:00.558872 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:42:00.558872 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:42:00.558872 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:42:00.558872 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:42:00.558872 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 09:42:00.558872 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:42:00.558872 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 520/1028] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Aug 11 09:42:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:42:00.558872 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40cf9d-7b02-409b-84cf-89c9cc4e7cff None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:00.608347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5d42a-2ef6-4fc5-a42f-93ec418d4bbb None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:00.642409 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ca876-9502-4ed7-8dc7-2ee0cb9b60c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:00.642943 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ca876-9502-4ed7-8dc7-2ee0cb9b60c0 None admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:00.643212 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ca876-9502-4ed7-8dc7-2ee0cb9b60c0 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:00.643475 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ca876-9502-4ed7-8dc7-2ee0cb9b60c0 None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:00.644105 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ca876-9502-4ed7-8dc7-2ee0cb9b60c0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:00.645511 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ca876-9502-4ed7-8dc7-2ee0cb9b60c0 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:00.663036 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40cf9d-7b02-409b-84cf-89c9cc4e7cff None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:00.670627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:00.704042 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccbf16-9793-49c8-94c7-53472ef02bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:00.704667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccbf16-9793-49c8-94c7-53472ef02bf1 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:00.704943 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccbf16-9793-49c8-94c7-53472ef02bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:00.705212 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccbf16-9793-49c8-94c7-53472ef02bf1 None admin] PATH_INFO: `/v3/services/image` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:00.705788 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccbf16-9793-49c8-94c7-53472ef02bf1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:00.710744 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccbf16-9793-49c8-94c7-53472ef02bf1 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:00.716395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-2bccbf16-9793-49c8-94c7-53472ef02bf1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 09:42:00.716395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:00.716395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:42:00.716395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:42:00.716395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:42:00.716395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:42:00.716395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:42:00.716395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:42:00.716395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 09:42:00.716395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:42:00.716395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:42:00.716395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:42:00.716395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:00.716395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:00.716395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:00.716395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:00.716395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:00.717479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:00.717479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:00.717479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:00.717479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:00.717479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:00.717479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:00.717479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:42:00.717479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:42:00.717479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:42:00.717479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:42:00.717479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:00.717479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:00.717479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:00.717479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:00.717479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:00.717479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:00.718336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:00.718336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:00.718336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:00.718336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:00.718336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:00.718336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:00.718336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:00.718336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:00.718336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:00.718336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:00.718336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:42:00.718336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:42:00.718336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 09:42:00.718336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:42:00.718336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 521/1029] 10.222.0.13 () {56 vars in 1105 bytes} [Thu Aug 11 09:42:00 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:42:00.719155 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccbf16-9793-49c8-94c7-53472ef02bf1 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:00.770098 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 509/1030] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Aug 11 09:42:00 2022] POST /identity/v3/projects => generated 311 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:42:00.770935 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ca876-9502-4ed7-8dc7-2ee0cb9b60c0 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:00.826002 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccbf16-9793-49c8-94c7-53472ef02bf1 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:00.845885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:00.863941 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e15ef-af7a-4e17-9aba-98c90c84d649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:00.864557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e15ef-af7a-4e17-9aba-98c90c84d649 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:00.864826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e15ef-af7a-4e17-9aba-98c90c84d649 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:00.865093 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e15ef-af7a-4e17-9aba-98c90c84d649 None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:00.866396 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e15ef-af7a-4e17-9aba-98c90c84d649 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:00.866657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e15ef-af7a-4e17-9aba-98c90c84d649 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:00.868069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e15ef-af7a-4e17-9aba-98c90c84d649 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:00.887725 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ca876-9502-4ed7-8dc7-2ee0cb9b60c0 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:00.892566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 522/1031] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Aug 11 09:42:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:00.898421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e15ef-af7a-4e17-9aba-98c90c84d649 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:00.925104 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618a5df-4250-4b24-9556-4c6992b592a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:00.925855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618a5df-4250-4b24-9556-4c6992b592a8 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:00.926159 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618a5df-4250-4b24-9556-4c6992b592a8 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:00.926429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618a5df-4250-4b24-9556-4c6992b592a8 None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:00.927058 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618a5df-4250-4b24-9556-4c6992b592a8 None admin] RBAC: Adding query filter params (name=image) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:00.927356 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618a5df-4250-4b24-9556-4c6992b592a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:00.927779 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:00.929855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618a5df-4250-4b24-9556-4c6992b592a8 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:00.934518 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 510/1032] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:42:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:00.940128 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618a5df-4250-4b24-9556-4c6992b592a8 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:01.021977 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e15ef-af7a-4e17-9aba-98c90c84d649 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:01.051925 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618a5df-4250-4b24-9556-4c6992b592a8 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:01.059727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fbe47-85e2-4498-b5ed-b54150e489b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:01.060336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fbe47-85e2-4498-b5ed-b54150e489b1 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:01.060610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fbe47-85e2-4498-b5ed-b54150e489b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:01.060876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fbe47-85e2-4498-b5ed-b54150e489b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:01.080517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:01.086411 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25a055-b7b1-413b-94ce-03899ecee669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:01.087013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25a055-b7b1-413b-94ce-03899ecee669 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:01.088833 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25a055-b7b1-413b-94ce-03899ecee669 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:01.088833 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25a055-b7b1-413b-94ce-03899ecee669 None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:01.088833 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25a055-b7b1-413b-94ce-03899ecee669 None admin] RBAC: Adding query filter params (type=image) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:01.088833 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25a055-b7b1-413b-94ce-03899ecee669 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:01.089841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25a055-b7b1-413b-94ce-03899ecee669 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:01.094630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 511/1033] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:42:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:42:01.100470 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25a055-b7b1-413b-94ce-03899ecee669 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:01.141728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fbe47-85e2-4498-b5ed-b54150e489b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:01.143407 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fbe47-85e2-4498-b5ed-b54150e489b1 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:01.171510 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:01.209581 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25a055-b7b1-413b-94ce-03899ecee669 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:01.246631 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c11b6e-8d13-4e21-9634-c33508f7decb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:01.251688 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 523/1034] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:42:00 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 11 09:42:01.251821 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c11b6e-8d13-4e21-9634-c33508f7decb None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:01.251821 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c11b6e-8d13-4e21-9634-c33508f7decb None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:01.251821 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c11b6e-8d13-4e21-9634-c33508f7decb None admin] PATH_INFO: `/v3/endpoints` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:01.251821 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c11b6e-8d13-4e21-9634-c33508f7decb None admin] RBAC: Adding query filter params (interface=public, service_id=9ba4eb08c8fd4122bc6b4e25c554c241, region_id=RegionOne) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:01.251821 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c11b6e-8d13-4e21-9634-c33508f7decb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:01.251821 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c11b6e-8d13-4e21-9634-c33508f7decb None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:01.252496 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fbe47-85e2-4498-b5ed-b54150e489b1 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:01.256924 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 512/1035] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Aug 11 09:42:01 2022] GET /identity/v3/endpoints?service_id=9ba4eb08c8fd4122bc6b4e25c554c241&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:42:01.262612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c11b6e-8d13-4e21-9634-c33508f7decb None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:01.328255 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:01.358432 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fbe47-85e2-4498-b5ed-b54150e489b1 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:01.377156 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c11b6e-8d13-4e21-9634-c33508f7decb None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:01.385962 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:01.395628 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088eb9a-70de-4c3a-8de9-92d453fc702d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:01.396313 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088eb9a-70de-4c3a-8de9-92d453fc702d None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:01.396594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088eb9a-70de-4c3a-8de9-92d453fc702d None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:01.397411 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088eb9a-70de-4c3a-8de9-92d453fc702d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:01.408820 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088eb9a-70de-4c3a-8de9-92d453fc702d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:01.410762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088eb9a-70de-4c3a-8de9-92d453fc702d None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:01.413216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d49226-2bc2-4a67-b12c-c59e8c4cbbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:01.413812 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d49226-2bc2-4a67-b12c-c59e8c4cbbee None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:01.414107 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d49226-2bc2-4a67-b12c-c59e8c4cbbee None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:01.414374 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d49226-2bc2-4a67-b12c-c59e8c4cbbee None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:01.415039 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d49226-2bc2-4a67-b12c-c59e8c4cbbee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:01.416375 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d49226-2bc2-4a67-b12c-c59e8c4cbbee None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:01.423376 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 513/1036] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Aug 11 09:42:01 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 09:42:01.425446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-3088eb9a-70de-4c3a-8de9-92d453fc702d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:42:01.425446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:01.425446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:01.425446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:01.425446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:01.425446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:01.425446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:01.425446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:01.425446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:01.425446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:01.425446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:01.425446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:01.425446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:42:01.425446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:42:01.425446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:42:01.425446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:42:01.426621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:01.426621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:01.426621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:01.426621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:01.426621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:01.426621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:01.426621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:01.426621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:01.426621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:01.426621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:01.426621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:01.426621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:01.426621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:01.426621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:01.426621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:01.426621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:01.426621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:42:01.427522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:42:01.427522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:42:01.427522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:42:01.427522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 524/1037] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:42:01.432468 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d49226-2bc2-4a67-b12c-c59e8c4cbbee None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:01.541984 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d49226-2bc2-4a67-b12c-c59e8c4cbbee None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:01.567087 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:01.580456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c302a-9877-4a86-8ec3-f4c072e88a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:01.582688 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c302a-9877-4a86-8ec3-f4c072e88a55 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:01.582688 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c302a-9877-4a86-8ec3-f4c072e88a55 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:01.582688 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c302a-9877-4a86-8ec3-f4c072e88a55 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:01.582688 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c302a-9877-4a86-8ec3-f4c072e88a55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:01.582688 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c302a-9877-4a86-8ec3-f4c072e88a55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:01.584729 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c302a-9877-4a86-8ec3-f4c072e88a55 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:01.597044 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 514/1038] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:42:01.602899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088eb9a-70de-4c3a-8de9-92d453fc702d None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:01.713896 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088eb9a-70de-4c3a-8de9-92d453fc702d None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:01.748284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fc74e-e2ce-4e18-82eb-b3df58781022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:01.748903 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fc74e-e2ce-4e18-82eb-b3df58781022 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:01.749175 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fc74e-e2ce-4e18-82eb-b3df58781022 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:01.749438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fc74e-e2ce-4e18-82eb-b3df58781022 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:01.756148 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fc74e-e2ce-4e18-82eb-b3df58781022 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:01.758138 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fc74e-e2ce-4e18-82eb-b3df58781022 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:01.769133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-8b0fc74e-e2ce-4e18-82eb-b3df58781022 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:42:01.769133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:01.769133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:01.769133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:01.769133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:01.769133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:01.769133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:01.769133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:01.769133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:01.769133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:01.769133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:01.769133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:01.769133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:42:01.769133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:42:01.769133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:42:01.770025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:42:01.770025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:01.770025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:01.770025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:01.770025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:01.770025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:01.770025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:01.770025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:01.770025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:01.770025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:01.770025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:01.770025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:01.770025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:01.770025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:01.770025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:01.770025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:01.770025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:01.770988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:42:01.770988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:42:01.770988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:42:01.770988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:42:01.770988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:42:01.770988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:42:01.770988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:42:01.770988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:42:01.770988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 525/1039] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:42:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:42:01.776015 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c302a-9877-4a86-8ec3-f4c072e88a55 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:01.875329 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c302a-9877-4a86-8ec3-f4c072e88a55 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:01.910804 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c90ca1-8d30-412e-b082-d2aadf730599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:01.911330 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c90ca1-8d30-412e-b082-d2aadf730599 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:01.911605 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c90ca1-8d30-412e-b082-d2aadf730599 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:01.911868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c90ca1-8d30-412e-b082-d2aadf730599 None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:01.913086 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c90ca1-8d30-412e-b082-d2aadf730599 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:01.913448 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c90ca1-8d30-412e-b082-d2aadf730599 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:01.914913 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c90ca1-8d30-412e-b082-d2aadf730599 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:01.933075 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 515/1040] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:42:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:01.934993 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fc74e-e2ce-4e18-82eb-b3df58781022 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:01.977836 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:02.034560 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fc74e-e2ce-4e18-82eb-b3df58781022 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:02.067830 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19038cb6-6b49-4128-b0ca-ebf08b8cefd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:02.068486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19038cb6-6b49-4128-b0ca-ebf08b8cefd4 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:02.068788 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19038cb6-6b49-4128-b0ca-ebf08b8cefd4 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:02.069051 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19038cb6-6b49-4128-b0ca-ebf08b8cefd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:02.069758 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19038cb6-6b49-4128-b0ca-ebf08b8cefd4 None admin] RBAC: Adding query filter params (role.id=4bbbd0046bb94973a14f7273d3e23c0c, scope.project.id=a0211f5c0b174c8c998e3ad29f96baab, user.id=4c1dc8e0d9454ad98894ed1e8d31f931) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:02.070208 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19038cb6-6b49-4128-b0ca-ebf08b8cefd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:02.071616 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19038cb6-6b49-4128-b0ca-ebf08b8cefd4 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:02.082321 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 526/1041] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:42:01 2022] GET /identity/v3/role_assignments?user.id=4c1dc8e0d9454ad98894ed1e8d31f931&scope.project.id=a0211f5c0b174c8c998e3ad29f96baab&role.id=4bbbd0046bb94973a14f7273d3e23c0c => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:02.824308 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b0f14-7803-4f3a-ab9c-e52ebd3eef89 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:02.824829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b0f14-7803-4f3a-ab9c-e52ebd3eef89 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:02.824829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b0f14-7803-4f3a-ab9c-e52ebd3eef89 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:02.826205 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 516/1042] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:42:02.831151 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2844b9-26bd-4ff3-819c-70f9b04259ec None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:02.831526 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2844b9-26bd-4ff3-819c-70f9b04259ec None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:02.831699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2844b9-26bd-4ff3-819c-70f9b04259ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:02.849160 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-ba2844b9-26bd-4ff3-819c-70f9b04259ec None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:02.850875 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ba2844b9-26bd-4ff3-819c-70f9b04259ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:02.915269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 527/1043] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:42:02.939408 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b0f14-7803-4f3a-ab9c-e52ebd3eef89 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:02.988387 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:03.046281 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b0f14-7803-4f3a-ab9c-e52ebd3eef89 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:03.080995 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe00764-ebfb-49ab-b763-197807198bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:03.081975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe00764-ebfb-49ab-b763-197807198bc1 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:03.082493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe00764-ebfb-49ab-b763-197807198bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:03.083108 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe00764-ebfb-49ab-b763-197807198bc1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:03.084958 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe00764-ebfb-49ab-b763-197807198bc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:03.086623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe00764-ebfb-49ab-b763-197807198bc1 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:03.088473 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 517/1044] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:42:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:03.094285 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2844b9-26bd-4ff3-819c-70f9b04259ec None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:03.128947 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:03.201099 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2844b9-26bd-4ff3-819c-70f9b04259ec None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:03.234452 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c35b7-0d05-439e-9052-741032f1fb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:03.235062 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c35b7-0d05-439e-9052-741032f1fb2d None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:03.235336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c35b7-0d05-439e-9052-741032f1fb2d None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:03.235602 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c35b7-0d05-439e-9052-741032f1fb2d None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:03.236248 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c35b7-0d05-439e-9052-741032f1fb2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:03.237664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c35b7-0d05-439e-9052-741032f1fb2d None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:03.314120 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 528/1045] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Aug 11 09:42:03 2022] POST /identity/v3/users => generated 285 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:42:03.467544 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6abb8b-40b5-4332-84f6-205edfad024a None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:03.468046 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6abb8b-40b5-4332-84f6-205edfad024a None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:03.468318 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6abb8b-40b5-4332-84f6-205edfad024a None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:03.469648 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 518/1046] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:42:03.475580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcc460-274c-47bb-a79d-2535c57ed7b5 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:03.475868 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcc460-274c-47bb-a79d-2535c57ed7b5 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:03.476141 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcc460-274c-47bb-a79d-2535c57ed7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:03.495416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-96fcc460-274c-47bb-a79d-2535c57ed7b5 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:03.496607 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-96fcc460-274c-47bb-a79d-2535c57ed7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:03.565540 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 529/1047] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:42:03.587702 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6abb8b-40b5-4332-84f6-205edfad024a None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:03.699512 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6abb8b-40b5-4332-84f6-205edfad024a None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:03.711215 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:03.734650 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb930b7e-88b3-46e6-a9ab-07b43c382d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:03.735190 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb930b7e-88b3-46e6-a9ab-07b43c382d82 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:03.735461 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb930b7e-88b3-46e6-a9ab-07b43c382d82 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:03.735722 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb930b7e-88b3-46e6-a9ab-07b43c382d82 None admin] PATH_INFO: `/v3/services/image` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:03.736289 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb930b7e-88b3-46e6-a9ab-07b43c382d82 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:03.737641 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb930b7e-88b3-46e6-a9ab-07b43c382d82 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:03.747659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-fb930b7e-88b3-46e6-a9ab-07b43c382d82 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 09:42:03.747659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:03.747659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:42:03.747659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:42:03.747659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:42:03.747659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:42:03.747659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:42:03.747659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:42:03.747659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 09:42:03.747659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:42:03.747659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:42:03.747659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:42:03.747659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:03.747659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:03.747659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:03.747659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:03.747659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:03.748647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:03.748647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:03.748647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:03.748647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:03.748647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:03.748647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:03.748647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:42:03.748647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:42:03.748647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:42:03.748647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:42:03.748647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:03.748647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:03.748647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:03.748647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:03.748647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:03.748647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:03.750270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:03.750270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:03.750270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:03.750270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:03.750270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:03.750270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:03.750270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:03.750270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:03.750270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:03.750270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:03.750270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:42:03.750270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:42:03.750270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 09:42:03.750270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:42:03.751277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 519/1048] 10.222.0.13 () {56 vars in 1105 bytes} [Thu Aug 11 09:42:03 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:42:03.754820 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcc460-274c-47bb-a79d-2535c57ed7b5 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:03.776903 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:03.854822 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcc460-274c-47bb-a79d-2535c57ed7b5 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:03.887532 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112c4f4-cee3-4d91-bc88-095ed5327c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:03.888131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112c4f4-cee3-4d91-bc88-095ed5327c7d None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:03.888401 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112c4f4-cee3-4d91-bc88-095ed5327c7d None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:03.888664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112c4f4-cee3-4d91-bc88-095ed5327c7d None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:03.889277 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112c4f4-cee3-4d91-bc88-095ed5327c7d None admin] RBAC: Adding query filter params (name=image) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:03.889571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112c4f4-cee3-4d91-bc88-095ed5327c7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:03.890948 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112c4f4-cee3-4d91-bc88-095ed5327c7d None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:03.895931 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 530/1049] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:42:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:03.901785 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb930b7e-88b3-46e6-a9ab-07b43c382d82 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:03.999797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb930b7e-88b3-46e6-a9ab-07b43c382d82 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:04.033589 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bcb9c-8b40-49e0-a405-b7509e6158e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:04.034224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bcb9c-8b40-49e0-a405-b7509e6158e1 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:04.034499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bcb9c-8b40-49e0-a405-b7509e6158e1 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:04.034761 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bcb9c-8b40-49e0-a405-b7509e6158e1 None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:04.035372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08bcb9c-8b40-49e0-a405-b7509e6158e1 None admin] RBAC: Adding query filter params (type=image) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:04.035663 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08bcb9c-8b40-49e0-a405-b7509e6158e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:04.037016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08bcb9c-8b40-49e0-a405-b7509e6158e1 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:04.042530 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 520/1050] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:42:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:04.048337 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112c4f4-cee3-4d91-bc88-095ed5327c7d None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:04.091889 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f2a4c-050c-499d-bd3e-80d3d74960ee None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:04.092242 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f2a4c-050c-499d-bd3e-80d3d74960ee None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:04.092438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f2a4c-050c-499d-bd3e-80d3d74960ee None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:04.094152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 521/1051] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:42:04.099117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efdf5c-dda4-4ff8-bf62-a852afa27cda None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:04.099389 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efdf5c-dda4-4ff8-bf62-a852afa27cda None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:04.099653 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efdf5c-dda4-4ff8-bf62-a852afa27cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:04.117942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-76efdf5c-dda4-4ff8-bf62-a852afa27cda None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:04.119153 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-76efdf5c-dda4-4ff8-bf62-a852afa27cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:04.140480 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:04.151459 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:04.156800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112c4f4-cee3-4d91-bc88-095ed5327c7d None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:04.188052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 522/1052] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 09:42:04.198172 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d092663-e51a-4645-8ce0-a79a9a1aecea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:04.198878 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d092663-e51a-4645-8ce0-a79a9a1aecea None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:04.199241 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d092663-e51a-4645-8ce0-a79a9a1aecea None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:04.199578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d092663-e51a-4645-8ce0-a79a9a1aecea None admin] PATH_INFO: `/v3/endpoints` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:04.200305 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d092663-e51a-4645-8ce0-a79a9a1aecea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:04.201850 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d092663-e51a-4645-8ce0-a79a9a1aecea None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:04.211508 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efdf5c-dda4-4ff8-bf62-a852afa27cda None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:04.294109 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 531/1053] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:42:04 2022] POST /identity/v3/endpoints => generated 327 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 09:42:04.313529 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efdf5c-dda4-4ff8-bf62-a852afa27cda None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:04.359677 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce8613-d3a1-4199-be3c-0eced742625c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:04.360342 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce8613-d3a1-4199-be3c-0eced742625c None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:04.360642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce8613-d3a1-4199-be3c-0eced742625c None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:04.360914 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce8613-d3a1-4199-be3c-0eced742625c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:04.372863 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce8613-d3a1-4199-be3c-0eced742625c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:42:04.377723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-1fce8613-d3a1-4199-be3c-0eced742625c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 09:42:04.377723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:04.377723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:04.377723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:04.377723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:04.377723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:04.377723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:04.377723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:04.377723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:04.377723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:04.377723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:04.377723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:04.377723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:42:04.377723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:42:04.377723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:42:04.377723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:42:04.378755 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:42:04.378755 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:42:04.378755 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:42:04.378755 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:42:04.378755 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:04.378755 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:04.378755 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:04.378755 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:04.378755 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:04.378755 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:04.378755 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:04.378755 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:04.378755 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:04.378755 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:04.378755 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:04.378755 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:04.380404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:04.380404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:04.380404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:04.380404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:04.380404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:42:04.380404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:42:04.380404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:42:04.380404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:42:04.380404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:42:04.380404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:42:04.380404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 09:42:04.380404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:42:04.380404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 523/1054] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Aug 11 09:42:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:42:04.385641 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d092663-e51a-4645-8ce0-a79a9a1aecea None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:04.496407 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d092663-e51a-4645-8ce0-a79a9a1aecea None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:04.531134 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638c40c-0b2e-460c-aca9-5e6050adf95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:04.531879 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638c40c-0b2e-460c-aca9-5e6050adf95e None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:04.532273 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638c40c-0b2e-460c-aca9-5e6050adf95e None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:04.532641 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638c40c-0b2e-460c-aca9-5e6050adf95e None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:04.533399 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638c40c-0b2e-460c-aca9-5e6050adf95e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:04.533794 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638c40c-0b2e-460c-aca9-5e6050adf95e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:04.535285 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638c40c-0b2e-460c-aca9-5e6050adf95e None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:04.543659 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 532/1055] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Aug 11 09:42:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:04.549761 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce8613-d3a1-4199-be3c-0eced742625c None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:04.577573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:04.659073 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce8613-d3a1-4199-be3c-0eced742625c None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:04.695290 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a2971-e2dd-4d6b-b0f3-e3fe1cea7b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:04.696060 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a2971-e2dd-4d6b-b0f3-e3fe1cea7b02 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:04.696338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a2971-e2dd-4d6b-b0f3-e3fe1cea7b02 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:04.696600 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a2971-e2dd-4d6b-b0f3-e3fe1cea7b02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:04.706776 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a2971-e2dd-4d6b-b0f3-e3fe1cea7b02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:04.708213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a2971-e2dd-4d6b-b0f3-e3fe1cea7b02 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:04.722538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-d10a2971-e2dd-4d6b-b0f3-e3fe1cea7b02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:42:04.722538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:04.722538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:04.722538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:04.722538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:04.722538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:04.722538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:04.722538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:04.722538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:04.722538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:04.722538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:04.722538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:04.722538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:42:04.722538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:42:04.722538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:42:04.722538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:42:04.723510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:04.723510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:04.723510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:04.723510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:04.723510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:04.723510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:04.723510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:04.723510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:04.723510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:04.723510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:04.723510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:04.723510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:04.723510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:04.723510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:04.723510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:04.723510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:04.723510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:42:04.724436 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:42:04.724436 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:42:04.724436 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:42:04.724436 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 524/1056] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:42:04.730453 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638c40c-0b2e-460c-aca9-5e6050adf95e None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:04.733465 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:04.833105 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638c40c-0b2e-460c-aca9-5e6050adf95e None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:04.865854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34a2d0-3cbf-4797-a7e0-1a19491ad956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:04.866508 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34a2d0-3cbf-4797-a7e0-1a19491ad956 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:04.866761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34a2d0-3cbf-4797-a7e0-1a19491ad956 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:04.867002 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34a2d0-3cbf-4797-a7e0-1a19491ad956 None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:04.867622 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34a2d0-3cbf-4797-a7e0-1a19491ad956 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:04.867916 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34a2d0-3cbf-4797-a7e0-1a19491ad956 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:04.869314 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34a2d0-3cbf-4797-a7e0-1a19491ad956 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:04.880913 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 533/1057] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:42:04.887015 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a2971-e2dd-4d6b-b0f3-e3fe1cea7b02 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:04.963431 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:04.986686 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a2971-e2dd-4d6b-b0f3-e3fe1cea7b02 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:05.021008 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f029c3-a035-4353-b059-5da9bfa01bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:05.021670 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f029c3-a035-4353-b059-5da9bfa01bda None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:05.021944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f029c3-a035-4353-b059-5da9bfa01bda None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:05.022236 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f029c3-a035-4353-b059-5da9bfa01bda None admin] PATH_INFO: `/v3/users/nova` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:05.029603 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f029c3-a035-4353-b059-5da9bfa01bda None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:05.031062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f029c3-a035-4353-b059-5da9bfa01bda None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:05.042349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-e0f029c3-a035-4353-b059-5da9bfa01bda None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 09:42:05.042349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:05.042349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:05.042349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:05.042349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:05.042349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:05.042349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:05.042349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:05.042349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:05.042349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:05.042349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:05.042349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:05.042349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:42:05.042349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:42:05.042349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:42:05.042349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:42:05.043322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:05.043322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:05.043322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:42:05.043322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:42:05.043322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:42:05.043322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:42:05.043322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:05.043322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:05.043322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:05.043322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:05.043322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:05.043322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:05.043322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:05.043322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:05.043322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:05.043322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:05.043322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:05.043322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:05.044276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:05.044276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:05.044276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:42:05.044276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:42:05.044276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:42:05.044276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:42:05.044276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:42:05.044276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:42:05.044276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 09:42:05.044276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:42:05.046399 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 525/1058] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Aug 11 09:42:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:42:05.049207 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34a2d0-3cbf-4797-a7e0-1a19491ad956 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:05.112610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:05.151756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34a2d0-3cbf-4797-a7e0-1a19491ad956 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:05.186408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d79923-8176-425f-8731-92fb90df52ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:05.187062 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d79923-8176-425f-8731-92fb90df52ea None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:05.187343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d79923-8176-425f-8731-92fb90df52ea None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:05.187779 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d79923-8176-425f-8731-92fb90df52ea None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:05.188494 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d79923-8176-425f-8731-92fb90df52ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:05.188798 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d79923-8176-425f-8731-92fb90df52ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:05.190298 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d79923-8176-425f-8731-92fb90df52ea None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:05.211999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 534/1059] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Aug 11 09:42:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:05.213541 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f029c3-a035-4353-b059-5da9bfa01bda None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:05.316936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f029c3-a035-4353-b059-5da9bfa01bda None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:05.350789 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0d23d-d025-453c-a2e1-ce906afa42df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:05.351416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0d23d-d025-453c-a2e1-ce906afa42df None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:05.351687 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0d23d-d025-453c-a2e1-ce906afa42df None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:05.351952 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0d23d-d025-453c-a2e1-ce906afa42df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:05.354667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:05.363210 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0d23d-d025-453c-a2e1-ce906afa42df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:05.364591 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0d23d-d025-453c-a2e1-ce906afa42df None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:05.378552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-f3f0d23d-d025-453c-a2e1-ce906afa42df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:42:05.378552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:05.378552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:05.378552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:05.378552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:05.378552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:05.378552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:05.378552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:05.378552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:05.378552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:05.378552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:05.378552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:05.378552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:42:05.378552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:42:05.378552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:42:05.378552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:42:05.379517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:05.379517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:05.379517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:05.379517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:05.379517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:05.379517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:05.379517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:05.379517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:05.379517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:05.379517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:05.379517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:05.379517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:05.379517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:05.379517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:05.379517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:05.379517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:05.379517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:42:05.380429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:42:05.380429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:42:05.380429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:42:05.382410 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 526/1060] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:42:05.384972 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0207796-7163-4940-84b9-d1c05f430d1f None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:05.385256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0207796-7163-4940-84b9-d1c05f430d1f None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:05.385367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0d23d-d025-453c-a2e1-ce906afa42df None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:05.385527 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0207796-7163-4940-84b9-d1c05f430d1f None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:05.387285 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 535/1061] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:42:05.392877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aaf1ca-ddb1-4745-bdb3-3f1cd45e5b2b None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:05.393156 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aaf1ca-ddb1-4745-bdb3-3f1cd45e5b2b None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:05.393426 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aaf1ca-ddb1-4745-bdb3-3f1cd45e5b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:05.414885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-e9aaf1ca-ddb1-4745-bdb3-3f1cd45e5b2b None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:05.416120 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-e9aaf1ca-ddb1-4745-bdb3-3f1cd45e5b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:05.491362 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 536/1062] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 09:42:05.498288 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0d23d-d025-453c-a2e1-ce906afa42df None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:05.518917 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aaf1ca-ddb1-4745-bdb3-3f1cd45e5b2b None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:05.529702 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e2190-523a-400c-bf34-9035c386b2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:05.530383 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e2190-523a-400c-bf34-9035c386b2bf None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:05.530659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e2190-523a-400c-bf34-9035c386b2bf None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:05.530925 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e2190-523a-400c-bf34-9035c386b2bf None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:05.531666 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e2190-523a-400c-bf34-9035c386b2bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:05.531982 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e2190-523a-400c-bf34-9035c386b2bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:05.533475 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e2190-523a-400c-bf34-9035c386b2bf None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:05.546649 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 527/1063] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:42:05.553992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e2190-523a-400c-bf34-9035c386b2bf None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:05.577689 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:05.606392 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:05.630065 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aaf1ca-ddb1-4745-bdb3-3f1cd45e5b2b None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:05.664224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e2190-523a-400c-bf34-9035c386b2bf None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:05.670482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9d1f5-5e3c-4fab-964b-b988d80a477e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:05.671140 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9d1f5-5e3c-4fab-964b-b988d80a477e None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:05.671417 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9d1f5-5e3c-4fab-964b-b988d80a477e None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:05.671737 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9d1f5-5e3c-4fab-964b-b988d80a477e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:05.682409 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9d1f5-5e3c-4fab-964b-b988d80a477e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:42:05.687206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-ede9d1f5-5e3c-4fab-964b-b988d80a477e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:42:05.687206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:05.687206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:05.687206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:05.687206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:05.687206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:05.687206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:05.687206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:05.687206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:05.687206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:05.687206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:05.687206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:05.687206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:42:05.687206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:42:05.687206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:42:05.687206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:42:05.688145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:42:05.688145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:42:05.688145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:42:05.688145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:42:05.688145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:05.688145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:05.688145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:05.688145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:05.688145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:05.688145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:05.688145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:05.688145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:05.688145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:05.688145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:05.688145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:05.688145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:05.691076 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:05.691076 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:05.691076 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:05.691076 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:05.691076 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:42:05.691076 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:42:05.691076 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:42:05.691076 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:42:05.691076 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:42:05.691076 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:42:05.691076 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:42:05.691076 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:42:05.691076 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 537/1064] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:42:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:42:05.694753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9d1f5-5e3c-4fab-964b-b988d80a477e None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:05.707933 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23aa56-6760-4e33-be75-83d3b0cb8de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:05.710198 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23aa56-6760-4e33-be75-83d3b0cb8de1 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:05.711237 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23aa56-6760-4e33-be75-83d3b0cb8de1 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:05.722274 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23aa56-6760-4e33-be75-83d3b0cb8de1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:05.722274 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23aa56-6760-4e33-be75-83d3b0cb8de1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:05.722274 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23aa56-6760-4e33-be75-83d3b0cb8de1 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:05.733217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-ff23aa56-6760-4e33-be75-83d3b0cb8de1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:42:05.733217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:05.733217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:05.733217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:05.733217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:05.733217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:05.733217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:05.733217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:05.733217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:05.733217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:05.733217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:05.733217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:05.733217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:42:05.733217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:42:05.733217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:42:05.734166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:42:05.734166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:05.734166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:05.734166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:05.734166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:05.734166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:05.734166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:05.734166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:05.734166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:05.734166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:05.734166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:05.734166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:05.734166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:05.734166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:05.734166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:05.734166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:05.734166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:05.735117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:42:05.735117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:42:05.735117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:42:05.735117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:42:05.735117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:42:05.735117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:42:05.735117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:42:05.735117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:42:05.735117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 528/1065] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:42:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:42:05.739938 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23aa56-6760-4e33-be75-83d3b0cb8de1 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:05.810788 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9d1f5-5e3c-4fab-964b-b988d80a477e None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:05.826815 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:05.854044 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23aa56-6760-4e33-be75-83d3b0cb8de1 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:05.854292 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408b582-3d93-4d83-9637-b1af9d47faf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:05.854822 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408b582-3d93-4d83-9637-b1af9d47faf1 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:05.855495 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408b582-3d93-4d83-9637-b1af9d47faf1 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:05.855764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408b582-3d93-4d83-9637-b1af9d47faf1 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:05.856431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408b582-3d93-4d83-9637-b1af9d47faf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:05.857835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408b582-3d93-4d83-9637-b1af9d47faf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:05.859301 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408b582-3d93-4d83-9637-b1af9d47faf1 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:05.863848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:05.868809 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 538/1066] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:42:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:42:05.874303 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408b582-3d93-4d83-9637-b1af9d47faf1 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:05.894245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574cb63-fba7-45fb-a82d-14f20fe240e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:05.894793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574cb63-fba7-45fb-a82d-14f20fe240e3 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:05.895442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574cb63-fba7-45fb-a82d-14f20fe240e3 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:05.896058 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574cb63-fba7-45fb-a82d-14f20fe240e3 None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:05.897987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574cb63-fba7-45fb-a82d-14f20fe240e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:05.898593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574cb63-fba7-45fb-a82d-14f20fe240e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:05.900698 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574cb63-fba7-45fb-a82d-14f20fe240e3 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:05.914027 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 529/1067] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:42:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:42:05.919540 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574cb63-fba7-45fb-a82d-14f20fe240e3 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:05.982736 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408b582-3d93-4d83-9637-b1af9d47faf1 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:06.019443 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87b4b3-fbff-42e4-aa17-9c3f724c30f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:06.020424 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87b4b3-fbff-42e4-aa17-9c3f724c30f2 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:06.020741 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574cb63-fba7-45fb-a82d-14f20fe240e3 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:06.021514 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87b4b3-fbff-42e4-aa17-9c3f724c30f2 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:06.022580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87b4b3-fbff-42e4-aa17-9c3f724c30f2 None admin] PATH_INFO: `/v3/users/82545d4c4cf9480d81bd4b2a7cec69bd` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:06.036811 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87b4b3-fbff-42e4-aa17-9c3f724c30f2 None admin] RBAC: Authorizing `identity:get_user(user_id=82545d4c4cf9480d81bd4b2a7cec69bd)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:06.038868 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87b4b3-fbff-42e4-aa17-9c3f724c30f2 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:06.040994 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 539/1068] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:42:05 2022] GET /identity/v3/users/82545d4c4cf9480d81bd4b2a7cec69bd => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:42:06.046281 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87b4b3-fbff-42e4-aa17-9c3f724c30f2 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:06.060765 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567dccc-3369-4705-9885-3f4dde2f153d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:06.061424 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567dccc-3369-4705-9885-3f4dde2f153d None admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:06.061709 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567dccc-3369-4705-9885-3f4dde2f153d None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:06.061980 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567dccc-3369-4705-9885-3f4dde2f153d None admin] PATH_INFO: `/v3/projects/a0211f5c0b174c8c998e3ad29f96baab/users/4c1dc8e0d9454ad98894ed1e8d31f931/roles/4bbbd0046bb94973a14f7273d3e23c0c` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:06.064204 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567dccc-3369-4705-9885-3f4dde2f153d None admin] RBAC: Authorizing `identity:create_grant(project_id=a0211f5c0b174c8c998e3ad29f96baab, user_id=4c1dc8e0d9454ad98894ed1e8d31f931, role_id=4bbbd0046bb94973a14f7273d3e23c0c)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:06.065629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567dccc-3369-4705-9885-3f4dde2f153d None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:06.078862 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:06.150124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87b4b3-fbff-42e4-aa17-9c3f724c30f2 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:06.182488 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 530/1069] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Aug 11 09:42:05 2022] PUT /identity/v3/projects/a0211f5c0b174c8c998e3ad29f96baab/users/4c1dc8e0d9454ad98894ed1e8d31f931/roles/4bbbd0046bb94973a14f7273d3e23c0c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 09:42:06.184686 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfde05-2356-410e-9a12-a85b74d357d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:06.186190 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfde05-2356-410e-9a12-a85b74d357d8 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:06.186470 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfde05-2356-410e-9a12-a85b74d357d8 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:06.186739 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfde05-2356-410e-9a12-a85b74d357d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:06.262733 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfde05-2356-410e-9a12-a85b74d357d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:06.264215 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfde05-2356-410e-9a12-a85b74d357d8 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:06.295461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:06.325233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9522459-1a6c-4f89-879a-cb53b4ca38e7 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:06.325539 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9522459-1a6c-4f89-879a-cb53b4ca38e7 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:06.325926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9522459-1a6c-4f89-879a-cb53b4ca38e7 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:06.329424 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 531/1070] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:42:06.334430 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cfe96-1bcc-4de5-95ca-bef67b130351 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:06.334834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cfe96-1bcc-4de5-95ca-bef67b130351 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:06.335224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cfe96-1bcc-4de5-95ca-bef67b130351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:06.358494 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-a39cfe96-1bcc-4de5-95ca-bef67b130351 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:06.359673 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-a39cfe96-1bcc-4de5-95ca-bef67b130351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:06.376416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 540/1071] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:42:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 11 09:42:06.382779 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfde05-2356-410e-9a12-a85b74d357d8 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:06.383683 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:06.431704 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 532/1072] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:42:06.452792 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cfe96-1bcc-4de5-95ca-bef67b130351 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:06.495438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfde05-2356-410e-9a12-a85b74d357d8 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:06.523849 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:06.529398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94cb06-a3fd-4fa2-92d8-92aa36050175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:06.540320 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94cb06-a3fd-4fa2-92d8-92aa36050175 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:06.540320 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94cb06-a3fd-4fa2-92d8-92aa36050175 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:06.540320 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94cb06-a3fd-4fa2-92d8-92aa36050175 None admin] PATH_INFO: `/v3/projects/48aafd02f10443a582d45779194f0b36` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:06.540320 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94cb06-a3fd-4fa2-92d8-92aa36050175 None admin] RBAC: Authorizing `identity:get_project(project_id=48aafd02f10443a582d45779194f0b36)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:06.540320 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94cb06-a3fd-4fa2-92d8-92aa36050175 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:06.540320 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 541/1073] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:42:06 2022] GET /identity/v3/projects/48aafd02f10443a582d45779194f0b36 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:42:06.541151 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94cb06-a3fd-4fa2-92d8-92aa36050175 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:06.561528 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cfe96-1bcc-4de5-95ca-bef67b130351 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:06.597520 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcff099-97fa-4fae-985c-8fc8d2736562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:06.598154 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcff099-97fa-4fae-985c-8fc8d2736562 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:06.598441 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcff099-97fa-4fae-985c-8fc8d2736562 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:06.598708 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcff099-97fa-4fae-985c-8fc8d2736562 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:06.627686 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:06.652353 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94cb06-a3fd-4fa2-92d8-92aa36050175 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:06.673182 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcff099-97fa-4fae-985c-8fc8d2736562 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:06.674780 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcff099-97fa-4fae-985c-8fc8d2736562 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:06.691147 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ef27b-5ba8-445e-92a9-045976dcc890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:06.691680 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ef27b-5ba8-445e-92a9-045976dcc890 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:06.691954 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ef27b-5ba8-445e-92a9-045976dcc890 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:06.692224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ef27b-5ba8-445e-92a9-045976dcc890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:06.692965 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ef27b-5ba8-445e-92a9-045976dcc890 None admin] RBAC: Adding query filter params (role.id=6aae1c66f3f04cec80ed72c20d7e033b, scope.project.id=48aafd02f10443a582d45779194f0b36, user.id=82545d4c4cf9480d81bd4b2a7cec69bd) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:06.693270 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ef27b-5ba8-445e-92a9-045976dcc890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:06.694806 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ef27b-5ba8-445e-92a9-045976dcc890 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:06.710119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 542/1074] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:42:06 2022] GET /identity/v3/role_assignments?user.id=82545d4c4cf9480d81bd4b2a7cec69bd&scope.project.id=48aafd02f10443a582d45779194f0b36&role.id=6aae1c66f3f04cec80ed72c20d7e033b => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:42:06.783698 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 533/1075] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:42:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 11 09:42:06.790362 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ef27b-5ba8-445e-92a9-045976dcc890 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:06.857413 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:06.897038 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ef27b-5ba8-445e-92a9-045976dcc890 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:06.932144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310338fe-8874-460d-90ec-eb62f47f5c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:06.932774 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310338fe-8874-460d-90ec-eb62f47f5c43 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:06.933051 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310338fe-8874-460d-90ec-eb62f47f5c43 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:06.933402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310338fe-8874-460d-90ec-eb62f47f5c43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:06.944006 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310338fe-8874-460d-90ec-eb62f47f5c43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:06.945381 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310338fe-8874-460d-90ec-eb62f47f5c43 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:06.959615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-310338fe-8874-460d-90ec-eb62f47f5c43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:42:06.959615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:06.959615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:06.959615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:06.959615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:06.959615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:06.959615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:06.959615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:06.959615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:06.959615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:06.959615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:06.959615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:06.959615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:42:06.959615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:42:06.959615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:42:06.959615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:42:06.960557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:06.960557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:06.960557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:06.960557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:06.960557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:06.960557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:06.960557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:06.960557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:06.960557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:06.960557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:06.960557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:06.960557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:06.960557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:06.960557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:06.960557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:06.960557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:06.960557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:42:06.961478 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:42:06.961478 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:42:06.961478 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:42:06.961478 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 543/1076] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:42:06.966686 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcff099-97fa-4fae-985c-8fc8d2736562 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:07.025219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:07.067882 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcff099-97fa-4fae-985c-8fc8d2736562 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:07.103299 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54523ac4-06a1-4a64-89e2-a5928bcdaa24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:07.103901 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54523ac4-06a1-4a64-89e2-a5928bcdaa24 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:07.104178 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54523ac4-06a1-4a64-89e2-a5928bcdaa24 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:07.104447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54523ac4-06a1-4a64-89e2-a5928bcdaa24 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:07.105081 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54523ac4-06a1-4a64-89e2-a5928bcdaa24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:07.105382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54523ac4-06a1-4a64-89e2-a5928bcdaa24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:07.106844 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54523ac4-06a1-4a64-89e2-a5928bcdaa24 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:07.118366 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 534/1077] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:42:08.166753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5c639-0a69-4945-98b4-292b584ac9bc None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:08.167283 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5c639-0a69-4945-98b4-292b584ac9bc None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:08.167283 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5c639-0a69-4945-98b4-292b584ac9bc None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:08.168607 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 544/1078] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:42:08.173676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba84f56-c535-48dc-9094-9762f2f2aa0d None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:08.174092 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba84f56-c535-48dc-9094-9762f2f2aa0d None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:08.174250 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba84f56-c535-48dc-9094-9762f2f2aa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:08.192474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-9ba84f56-c535-48dc-9094-9762f2f2aa0d None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:08.193662 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-9ba84f56-c535-48dc-9094-9762f2f2aa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:08.257257 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 535/1079] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:42:08.279763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5c639-0a69-4945-98b4-292b584ac9bc None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:08.378675 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5c639-0a69-4945-98b4-292b584ac9bc None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:08.392273 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:08.411723 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc38b9-51fd-4f53-ac00-27a09e052b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:08.412881 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc38b9-51fd-4f53-ac00-27a09e052b8f None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:08.413149 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc38b9-51fd-4f53-ac00-27a09e052b8f None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:08.413414 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc38b9-51fd-4f53-ac00-27a09e052b8f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:08.423096 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc38b9-51fd-4f53-ac00-27a09e052b8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:42:08.427891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-12bc38b9-51fd-4f53-ac00-27a09e052b8f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 09:42:08.427891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:08.427891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:08.427891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:08.427891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:08.427891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:08.427891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:08.427891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:08.427891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:08.427891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:08.427891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:08.427891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:08.427891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:42:08.427891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:42:08.427891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:42:08.427891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:42:08.429117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:42:08.429117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:42:08.429117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:42:08.429117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:42:08.429117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:08.429117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:08.429117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:08.429117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:08.429117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:08.429117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:08.429117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:08.429117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:08.429117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:08.429117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:08.429117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:08.429117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:08.429972 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:08.429972 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:08.429972 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:08.429972 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:08.429972 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:42:08.429972 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:42:08.429972 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:42:08.429972 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:42:08.429972 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:42:08.429972 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:42:08.429972 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 09:42:08.429972 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:42:08.429972 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 545/1080] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Aug 11 09:42:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:42:08.435439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba84f56-c535-48dc-9094-9762f2f2aa0d None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:08.482277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:08.530417 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba84f56-c535-48dc-9094-9762f2f2aa0d None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:08.562850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097d22c-0f0a-464a-abf9-13a1ce422374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:08.563444 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097d22c-0f0a-464a-abf9-13a1ce422374 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:08.563714 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097d22c-0f0a-464a-abf9-13a1ce422374 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:08.563978 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097d22c-0f0a-464a-abf9-13a1ce422374 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:08.564624 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097d22c-0f0a-464a-abf9-13a1ce422374 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:08.564916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097d22c-0f0a-464a-abf9-13a1ce422374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:08.566293 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097d22c-0f0a-464a-abf9-13a1ce422374 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:08.574059 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 536/1081] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Aug 11 09:42:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:08.579585 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc38b9-51fd-4f53-ac00-27a09e052b8f None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:08.678028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc38b9-51fd-4f53-ac00-27a09e052b8f None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:08.702625 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf7f02-7c20-46f8-aa83-073604f2990c None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:08.702911 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf7f02-7c20-46f8-aa83-073604f2990c None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:08.703182 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf7f02-7c20-46f8-aa83-073604f2990c None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:08.704536 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 537/1082] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:42:08.710052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997258f-d773-4d42-b16b-f6494aef7e5d None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:08.710367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997258f-d773-4d42-b16b-f6494aef7e5d None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:08.710633 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997258f-d773-4d42-b16b-f6494aef7e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:08.713102 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53ede4-5291-4a13-805d-9551d3c1ed59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:08.713731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53ede4-5291-4a13-805d-9551d3c1ed59 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:08.714006 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53ede4-5291-4a13-805d-9551d3c1ed59 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:08.714321 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53ede4-5291-4a13-805d-9551d3c1ed59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:08.724241 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53ede4-5291-4a13-805d-9551d3c1ed59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:08.725687 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53ede4-5291-4a13-805d-9551d3c1ed59 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:08.739640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-5b53ede4-5291-4a13-805d-9551d3c1ed59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:42:08.739640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:08.739640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:08.739640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:08.739640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:08.739640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:08.739640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:08.739640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:08.739640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:08.739640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:08.739640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:08.739640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:08.739640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:42:08.739640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:42:08.739640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:42:08.739640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:42:08.740745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:08.740745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:08.740745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:08.740745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:08.740745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:08.740745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:08.740745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:08.740745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:08.740745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:08.740745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:08.740745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:08.740745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:08.740745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:08.740745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:08.740745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:08.740745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:08.740745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:42:08.742029 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:42:08.742029 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:42:08.742029 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:42:08.742029 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 546/1083] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:42:08.746289 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53ede4-5291-4a13-805d-9551d3c1ed59 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:08.756339 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-b997258f-d773-4d42-b16b-f6494aef7e5d None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:08.757501 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-b997258f-d773-4d42-b16b-f6494aef7e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:08.773440 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:08.826128 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 538/1084] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 09:42:08.844283 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53ede4-5291-4a13-805d-9551d3c1ed59 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:08.848649 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997258f-d773-4d42-b16b-f6494aef7e5d None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:08.876937 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73763cbe-856e-4013-8485-bf01c093e898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:08.877534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73763cbe-856e-4013-8485-bf01c093e898 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:08.877807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73763cbe-856e-4013-8485-bf01c093e898 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:08.878105 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73763cbe-856e-4013-8485-bf01c093e898 None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:08.878725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73763cbe-856e-4013-8485-bf01c093e898 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:08.879023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73763cbe-856e-4013-8485-bf01c093e898 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:08.880367 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73763cbe-856e-4013-8485-bf01c093e898 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:08.888158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:08.896264 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 547/1085] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:42:08.898556 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73763cbe-856e-4013-8485-bf01c093e898 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:08.946015 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997258f-d773-4d42-b16b-f6494aef7e5d None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:08.978599 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb1dc0-7cd3-4d91-93ad-f29613e5d7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:08.979210 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb1dc0-7cd3-4d91-93ad-f29613e5d7d7 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:08.979480 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb1dc0-7cd3-4d91-93ad-f29613e5d7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:08.979740 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb1dc0-7cd3-4d91-93ad-f29613e5d7d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:08.981581 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:08.989610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb1dc0-7cd3-4d91-93ad-f29613e5d7d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:42:08.994421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-0edb1dc0-7cd3-4d91-93ad-f29613e5d7d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:42:08.994421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:08.994421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:08.994421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:08.994421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:08.994421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:08.994421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:08.994421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:08.994421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:08.994421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:08.994421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:08.994421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:08.994421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:42:08.994421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:42:08.994421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:42:08.994421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:42:08.995595 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:42:08.995595 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:42:08.995595 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:42:08.995595 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:42:08.995595 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:08.995595 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:08.995595 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:08.995595 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:08.995595 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:08.995595 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:08.995595 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:08.995595 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:08.995595 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:08.995595 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:08.995595 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:08.995595 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:08.996438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:08.996438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:08.996438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:08.996438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:08.996438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:42:08.996438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:42:08.996438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:42:08.996438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:42:08.996438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:42:08.996438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:42:08.996438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:42:08.996438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:42:08.996438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 539/1086] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:42:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:42:08.997158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73763cbe-856e-4013-8485-bf01c093e898 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:09.001404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb1dc0-7cd3-4d91-93ad-f29613e5d7d7 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:09.031487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa54947-de7a-4c7d-9faa-2571924b5aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:09.032151 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa54947-de7a-4c7d-9faa-2571924b5aaf None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:09.032435 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa54947-de7a-4c7d-9faa-2571924b5aaf None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:09.032708 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa54947-de7a-4c7d-9faa-2571924b5aaf None admin] PATH_INFO: `/v3/users/nova` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:09.039678 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa54947-de7a-4c7d-9faa-2571924b5aaf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:09.041102 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa54947-de7a-4c7d-9faa-2571924b5aaf None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:09.052318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-6fa54947-de7a-4c7d-9faa-2571924b5aaf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 09:42:09.052318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:09.052318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:09.052318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:09.052318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:09.052318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:09.052318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:09.052318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:09.052318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:09.052318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:09.052318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:09.052318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:09.052318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:42:09.052318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:42:09.052318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:42:09.052318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:42:09.054213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:09.054213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:09.054213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:42:09.054213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:42:09.054213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:42:09.054213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:42:09.054213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:09.054213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:09.054213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:09.054213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:09.054213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:09.054213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:09.054213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:09.054213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:09.054213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:09.054213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:09.054213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:09.054213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:09.055191 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:09.055191 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:09.055191 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:42:09.055191 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:42:09.055191 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:42:09.055191 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:42:09.055191 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:42:09.055191 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:42:09.055191 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 09:42:09.055191 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:42:09.055191 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 548/1087] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Aug 11 09:42:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:42:09.059685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa54947-de7a-4c7d-9faa-2571924b5aaf None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:09.102155 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:09.105056 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb1dc0-7cd3-4d91-93ad-f29613e5d7d7 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:09.138183 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8d381-6e2e-4b35-a82f-84b91d661723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:09.138781 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8d381-6e2e-4b35-a82f-84b91d661723 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:09.139054 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8d381-6e2e-4b35-a82f-84b91d661723 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:09.139326 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8d381-6e2e-4b35-a82f-84b91d661723 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:09.139997 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8d381-6e2e-4b35-a82f-84b91d661723 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:09.141438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8d381-6e2e-4b35-a82f-84b91d661723 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:09.142838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8d381-6e2e-4b35-a82f-84b91d661723 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:09.150808 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 540/1088] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:42:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:42:09.156528 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa54947-de7a-4c7d-9faa-2571924b5aaf None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:09.156669 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8d381-6e2e-4b35-a82f-84b91d661723 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:09.191141 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9189118-0935-447e-81cd-c8045b7709db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:09.191746 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9189118-0935-447e-81cd-c8045b7709db None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:09.192021 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9189118-0935-447e-81cd-c8045b7709db None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:09.192288 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9189118-0935-447e-81cd-c8045b7709db None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:09.193004 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9189118-0935-447e-81cd-c8045b7709db None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:09.193866 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9189118-0935-447e-81cd-c8045b7709db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:09.195327 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9189118-0935-447e-81cd-c8045b7709db None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:09.213454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 549/1089] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Aug 11 09:42:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:42:09.218982 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9189118-0935-447e-81cd-c8045b7709db None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:09.222402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:09.257127 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8d381-6e2e-4b35-a82f-84b91d661723 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:09.294554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b620d5-1bf5-4b7e-b49c-7ebef82fb0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:09.295238 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b620d5-1bf5-4b7e-b49c-7ebef82fb0a2 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:09.295513 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b620d5-1bf5-4b7e-b49c-7ebef82fb0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:09.295776 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b620d5-1bf5-4b7e-b49c-7ebef82fb0a2 None admin] PATH_INFO: `/v3/users/82545d4c4cf9480d81bd4b2a7cec69bd` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:09.296894 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b620d5-1bf5-4b7e-b49c-7ebef82fb0a2 None admin] RBAC: Authorizing `identity:get_user(user_id=82545d4c4cf9480d81bd4b2a7cec69bd)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:09.298340 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b620d5-1bf5-4b7e-b49c-7ebef82fb0a2 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:09.299899 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 541/1090] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:42:09 2022] GET /identity/v3/users/82545d4c4cf9480d81bd4b2a7cec69bd => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:42:09.306218 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b620d5-1bf5-4b7e-b49c-7ebef82fb0a2 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:09.318111 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9189118-0935-447e-81cd-c8045b7709db None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:09.336451 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:09.350925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16035e10-68cb-4b14-ac91-767ace6ac51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:09.351514 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16035e10-68cb-4b14-ac91-767ace6ac51c None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:09.351785 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16035e10-68cb-4b14-ac91-767ace6ac51c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:09.352048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16035e10-68cb-4b14-ac91-767ace6ac51c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:09.403158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b620d5-1bf5-4b7e-b49c-7ebef82fb0a2 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:09.416667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16035e10-68cb-4b14-ac91-767ace6ac51c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:09.418131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16035e10-68cb-4b14-ac91-767ace6ac51c None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:09.420596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:09.437384 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e330275-5f2a-4430-9fa2-700dcee898ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:09.437986 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e330275-5f2a-4430-9fa2-700dcee898ac None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:09.438292 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e330275-5f2a-4430-9fa2-700dcee898ac None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:09.438563 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e330275-5f2a-4430-9fa2-700dcee898ac None admin] PATH_INFO: `/v3/projects/48aafd02f10443a582d45779194f0b36` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:09.439664 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e330275-5f2a-4430-9fa2-700dcee898ac None admin] RBAC: Authorizing `identity:get_project(project_id=48aafd02f10443a582d45779194f0b36)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:09.441116 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e330275-5f2a-4430-9fa2-700dcee898ac None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:09.442785 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 542/1091] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:42:09 2022] GET /identity/v3/projects/48aafd02f10443a582d45779194f0b36 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:42:09.448731 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e330275-5f2a-4430-9fa2-700dcee898ac None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:09.515238 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 550/1092] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:42:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 11 09:42:09.520768 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16035e10-68cb-4b14-ac91-767ace6ac51c None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:09.545581 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:09.549435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e330275-5f2a-4430-9fa2-700dcee898ac None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:09.583516 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669b4a4-3672-42f5-9b62-de2ca858915b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:09.584166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669b4a4-3672-42f5-9b62-de2ca858915b None admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:09.584439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669b4a4-3672-42f5-9b62-de2ca858915b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:09.584707 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669b4a4-3672-42f5-9b62-de2ca858915b None admin] PATH_INFO: `/v3/projects/48aafd02f10443a582d45779194f0b36/users/82545d4c4cf9480d81bd4b2a7cec69bd/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:09.586645 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669b4a4-3672-42f5-9b62-de2ca858915b None admin] RBAC: Authorizing `identity:create_grant(project_id=48aafd02f10443a582d45779194f0b36, user_id=82545d4c4cf9480d81bd4b2a7cec69bd, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:09.588076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669b4a4-3672-42f5-9b62-de2ca858915b None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:09.618026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16035e10-68cb-4b14-ac91-767ace6ac51c None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:09.620279 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:09.650976 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792e573-bc03-4527-9b5f-b548cf5554a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:09.651592 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792e573-bc03-4527-9b5f-b548cf5554a4 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:09.651867 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792e573-bc03-4527-9b5f-b548cf5554a4 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:09.652212 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792e573-bc03-4527-9b5f-b548cf5554a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:09.662429 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792e573-bc03-4527-9b5f-b548cf5554a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:09.663868 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792e573-bc03-4527-9b5f-b548cf5554a4 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:09.678685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-e792e573-bc03-4527-9b5f-b548cf5554a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:42:09.678685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:09.678685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:09.678685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:09.678685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:09.678685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:09.678685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:09.678685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:09.678685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:09.678685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:09.678685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:09.678685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:09.678685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:42:09.678685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:42:09.678685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:42:09.678685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:42:09.679804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:09.679804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:09.679804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:09.679804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:09.679804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:09.679804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:09.679804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:09.679804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:09.679804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:09.679804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:09.679804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:09.679804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:09.679804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:09.679804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:09.679804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:09.679804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:09.679804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:42:09.681086 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:42:09.681086 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:42:09.681086 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:42:09.682240 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 551/1093] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:42:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:42:09.686319 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 543/1094] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Aug 11 09:42:09 2022] PUT /identity/v3/projects/48aafd02f10443a582d45779194f0b36/users/82545d4c4cf9480d81bd4b2a7cec69bd/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:42:09.689546 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792e573-bc03-4527-9b5f-b548cf5554a4 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:09.797562 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792e573-bc03-4527-9b5f-b548cf5554a4 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:09.832756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316979c5-2bf9-4df8-8fe5-399dcfa7092e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:09.833614 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316979c5-2bf9-4df8-8fe5-399dcfa7092e None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:09.834573 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316979c5-2bf9-4df8-8fe5-399dcfa7092e None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:09.835588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316979c5-2bf9-4df8-8fe5-399dcfa7092e None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:09.835588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316979c5-2bf9-4df8-8fe5-399dcfa7092e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:09.835804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316979c5-2bf9-4df8-8fe5-399dcfa7092e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:09.837207 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316979c5-2bf9-4df8-8fe5-399dcfa7092e None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:09.850511 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 552/1095] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:09.856435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669b4a4-3672-42f5-9b62-de2ca858915b None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:09.951312 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669b4a4-3672-42f5-9b62-de2ca858915b None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:09.984069 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a949f0b-dd35-43b2-a081-7323beaaf946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:09.984686 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a949f0b-dd35-43b2-a081-7323beaaf946 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:09.984955 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a949f0b-dd35-43b2-a081-7323beaaf946 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:09.985224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a949f0b-dd35-43b2-a081-7323beaaf946 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:09.991636 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a949f0b-dd35-43b2-a081-7323beaaf946 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:09.993079 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a949f0b-dd35-43b2-a081-7323beaaf946 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:10.003760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-4a949f0b-dd35-43b2-a081-7323beaaf946 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:42:10.003760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:10.003760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:10.003760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:10.003760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:10.003760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:10.003760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:10.003760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:10.003760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:10.003760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:10.003760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:10.003760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:10.003760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:42:10.003760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:42:10.003760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:42:10.004797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:42:10.004797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:10.004797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:10.004797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:10.004797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:10.004797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:10.004797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:10.004797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:10.004797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:10.004797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:10.004797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:10.004797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:10.004797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:10.004797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:10.004797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:10.004797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:10.004797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:10.005724 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:42:10.005724 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:42:10.005724 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:42:10.005724 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:42:10.005724 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:42:10.005724 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:42:10.005724 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:42:10.005724 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:42:10.005724 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 544/1096] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:42:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:42:10.010587 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316979c5-2bf9-4df8-8fe5-399dcfa7092e None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:10.028689 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:10.108642 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316979c5-2bf9-4df8-8fe5-399dcfa7092e None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:10.140892 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2659f9-ae0f-4a82-8fb8-4d0a48e7f38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:10.141493 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2659f9-ae0f-4a82-8fb8-4d0a48e7f38e None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:10.141762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2659f9-ae0f-4a82-8fb8-4d0a48e7f38e None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:10.142025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2659f9-ae0f-4a82-8fb8-4d0a48e7f38e None admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:10.142727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2659f9-ae0f-4a82-8fb8-4d0a48e7f38e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:10.143024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2659f9-ae0f-4a82-8fb8-4d0a48e7f38e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:10.144436 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2659f9-ae0f-4a82-8fb8-4d0a48e7f38e None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:10.155998 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 553/1097] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:42:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:10.162591 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a949f0b-dd35-43b2-a081-7323beaaf946 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:10.181420 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:10.260018 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a949f0b-dd35-43b2-a081-7323beaaf946 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:10.292068 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c75f2-f7f9-4ef9-bfae-398bacb01091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:10.292660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c75f2-f7f9-4ef9-bfae-398bacb01091 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:10.292935 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c75f2-f7f9-4ef9-bfae-398bacb01091 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:10.293202 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c75f2-f7f9-4ef9-bfae-398bacb01091 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:10.293911 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c75f2-f7f9-4ef9-bfae-398bacb01091 None admin] RBAC: Adding query filter params (role.id=4bbbd0046bb94973a14f7273d3e23c0c, scope.project.id=a0211f5c0b174c8c998e3ad29f96baab, user.id=4c1dc8e0d9454ad98894ed1e8d31f931) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:10.294244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c75f2-f7f9-4ef9-bfae-398bacb01091 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:10.295722 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c75f2-f7f9-4ef9-bfae-398bacb01091 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:10.301308 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 545/1098] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:42:10 2022] GET /identity/v3/role_assignments?user.id=4c1dc8e0d9454ad98894ed1e8d31f931&scope.project.id=a0211f5c0b174c8c998e3ad29f96baab&role.id=4bbbd0046bb94973a14f7273d3e23c0c => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:11.667492 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ef63a-7060-44fe-b265-e7bdb87491c1 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:11.667930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ef63a-7060-44fe-b265-e7bdb87491c1 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:11.668023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ef63a-7060-44fe-b265-e7bdb87491c1 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:11.669336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 554/1099] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:42:11.674483 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04627a82-b9e5-41b9-a742-f3246abb4c6e None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:11.674862 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04627a82-b9e5-41b9-a742-f3246abb4c6e None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:11.675027 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04627a82-b9e5-41b9-a742-f3246abb4c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:11.693398 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-04627a82-b9e5-41b9-a742-f3246abb4c6e None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:11.694607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-04627a82-b9e5-41b9-a742-f3246abb4c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:11.762163 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 546/1100] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:42:11.784934 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ef63a-7060-44fe-b265-e7bdb87491c1 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:11.860762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:11.883807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ef63a-7060-44fe-b265-e7bdb87491c1 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:11.915866 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3c03a-f4ef-4fde-ba9c-ccdb161254b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:11.916414 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3c03a-f4ef-4fde-ba9c-ccdb161254b3 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:11.916689 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3c03a-f4ef-4fde-ba9c-ccdb161254b3 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:11.916958 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3c03a-f4ef-4fde-ba9c-ccdb161254b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:11.927081 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3c03a-f4ef-4fde-ba9c-ccdb161254b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:42:11.932523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-adf3c03a-f4ef-4fde-ba9c-ccdb161254b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:42:11.932523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:11.932523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:11.932523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:11.932523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:11.932523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:11.932523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:11.932523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:11.932523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:11.932523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:11.932523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:11.932523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:11.932523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:42:11.932523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:42:11.932523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:42:11.932523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:42:11.933603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:42:11.933603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:42:11.933603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:42:11.933603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:42:11.933603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:11.933603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:11.933603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:11.933603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:11.933603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:11.933603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:11.933603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:11.933603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:11.933603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:11.933603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:11.933603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:11.933603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:11.934957 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:11.934957 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:11.934957 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:11.934957 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:11.934957 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:42:11.934957 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:42:11.934957 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:42:11.934957 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:42:11.934957 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:42:11.934957 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:42:11.934957 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:42:11.934957 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:42:11.934957 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 555/1101] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:42:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:42:11.939538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04627a82-b9e5-41b9-a742-f3246abb4c6e None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:11.953139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:12.033267 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04627a82-b9e5-41b9-a742-f3246abb4c6e None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:12.066936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91320a96-fc37-4e86-b411-31fd73bcda00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:12.067519 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91320a96-fc37-4e86-b411-31fd73bcda00 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:12.067787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91320a96-fc37-4e86-b411-31fd73bcda00 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:12.068073 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91320a96-fc37-4e86-b411-31fd73bcda00 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:12.068718 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91320a96-fc37-4e86-b411-31fd73bcda00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:12.069012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91320a96-fc37-4e86-b411-31fd73bcda00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:12.070380 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91320a96-fc37-4e86-b411-31fd73bcda00 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:12.077968 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 547/1102] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:42:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:12.084302 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3c03a-f4ef-4fde-ba9c-ccdb161254b3 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:12.180749 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3c03a-f4ef-4fde-ba9c-ccdb161254b3 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:12.212724 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6eab9c-8ce6-492d-8558-09e2ea34c6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:12.213331 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6eab9c-8ce6-492d-8558-09e2ea34c6be None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:12.213608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6eab9c-8ce6-492d-8558-09e2ea34c6be None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:12.213879 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6eab9c-8ce6-492d-8558-09e2ea34c6be None admin] PATH_INFO: `/v3/users/82545d4c4cf9480d81bd4b2a7cec69bd` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:12.215018 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6eab9c-8ce6-492d-8558-09e2ea34c6be None admin] RBAC: Authorizing `identity:get_user(user_id=82545d4c4cf9480d81bd4b2a7cec69bd)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:12.216423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6eab9c-8ce6-492d-8558-09e2ea34c6be None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:12.217950 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 556/1103] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:42:12 2022] GET /identity/v3/users/82545d4c4cf9480d81bd4b2a7cec69bd => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:12.223462 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91320a96-fc37-4e86-b411-31fd73bcda00 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:12.293806 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:12.317154 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91320a96-fc37-4e86-b411-31fd73bcda00 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:12.348978 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91b6f0-7ff6-4150-809f-0bd5f3efeaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:12.349586 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91b6f0-7ff6-4150-809f-0bd5f3efeaa2 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:12.349854 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91b6f0-7ff6-4150-809f-0bd5f3efeaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:12.350138 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91b6f0-7ff6-4150-809f-0bd5f3efeaa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:12.413289 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91b6f0-7ff6-4150-809f-0bd5f3efeaa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:12.414744 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91b6f0-7ff6-4150-809f-0bd5f3efeaa2 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:12.482812 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:12.507139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 548/1104] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:42:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 09:42:12.512944 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6eab9c-8ce6-492d-8558-09e2ea34c6be None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:12.516603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:12.608107 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6eab9c-8ce6-492d-8558-09e2ea34c6be None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:12.639873 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80e69d-ea11-4192-85b1-2ee65aeb4c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:12.640488 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80e69d-ea11-4192-85b1-2ee65aeb4c35 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:12.640763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80e69d-ea11-4192-85b1-2ee65aeb4c35 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:12.641034 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80e69d-ea11-4192-85b1-2ee65aeb4c35 None admin] PATH_INFO: `/v3/projects/48aafd02f10443a582d45779194f0b36` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:12.642151 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80e69d-ea11-4192-85b1-2ee65aeb4c35 None admin] RBAC: Authorizing `identity:get_project(project_id=48aafd02f10443a582d45779194f0b36)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:12.643567 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80e69d-ea11-4192-85b1-2ee65aeb4c35 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:12.645161 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 557/1105] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:42:12 2022] GET /identity/v3/projects/48aafd02f10443a582d45779194f0b36 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:12.651093 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91b6f0-7ff6-4150-809f-0bd5f3efeaa2 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:12.745417 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91b6f0-7ff6-4150-809f-0bd5f3efeaa2 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:12.776783 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b909051-cae0-48a8-934a-b7bef601c6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:12.777365 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b909051-cae0-48a8-934a-b7bef601c6e3 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:12.777634 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b909051-cae0-48a8-934a-b7bef601c6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:12.777894 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b909051-cae0-48a8-934a-b7bef601c6e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:12.778621 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b909051-cae0-48a8-934a-b7bef601c6e3 None admin] RBAC: Adding query filter params (role.id=6aae1c66f3f04cec80ed72c20d7e033b, scope.project.id=48aafd02f10443a582d45779194f0b36, user.id=82545d4c4cf9480d81bd4b2a7cec69bd) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:12.778919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b909051-cae0-48a8-934a-b7bef601c6e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:12.780320 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b909051-cae0-48a8-934a-b7bef601c6e3 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:12.785756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 549/1106] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:42:12 2022] GET /identity/v3/role_assignments?user.id=82545d4c4cf9480d81bd4b2a7cec69bd&scope.project.id=48aafd02f10443a582d45779194f0b36&role.id=6aae1c66f3f04cec80ed72c20d7e033b => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:14.788344 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d1355-ab1d-431f-b181-d75e7e2e0314 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:14.788905 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d1355-ab1d-431f-b181-d75e7e2e0314 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:14.788905 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d1355-ab1d-431f-b181-d75e7e2e0314 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:14.790215 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 558/1107] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:42:14.795216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defd41f-6171-4680-9198-292fa76d4be4 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:14.795580 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defd41f-6171-4680-9198-292fa76d4be4 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:14.795812 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defd41f-6171-4680-9198-292fa76d4be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:14.814071 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-5defd41f-6171-4680-9198-292fa76d4be4 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:14.815279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-5defd41f-6171-4680-9198-292fa76d4be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:14.848265 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:14.884767 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 550/1108] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:42:14.908860 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d1355-ab1d-431f-b181-d75e7e2e0314 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:14.977919 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:15.007788 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d1355-ab1d-431f-b181-d75e7e2e0314 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:15.039934 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05465141-db3d-4f7a-a5d7-c15fad20e5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:15.040536 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05465141-db3d-4f7a-a5d7-c15fad20e5bf None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:15.040811 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05465141-db3d-4f7a-a5d7-c15fad20e5bf None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:15.041081 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05465141-db3d-4f7a-a5d7-c15fad20e5bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:15.042195 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05465141-db3d-4f7a-a5d7-c15fad20e5bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:15.043603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05465141-db3d-4f7a-a5d7-c15fad20e5bf None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:15.045123 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 559/1109] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:42:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:15.050899 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defd41f-6171-4680-9198-292fa76d4be4 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:15.146577 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defd41f-6171-4680-9198-292fa76d4be4 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:15.189256 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fade12-8ac1-4168-9871-e38291d53bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:15.189256 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fade12-8ac1-4168-9871-e38291d53bb9 None admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:15.189256 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fade12-8ac1-4168-9871-e38291d53bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:15.189256 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fade12-8ac1-4168-9871-e38291d53bb9 None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:15.189706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fade12-8ac1-4168-9871-e38291d53bb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:15.190935 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fade12-8ac1-4168-9871-e38291d53bb9 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:15.289124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 551/1110] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Aug 11 09:42:15 2022] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:42:17.299796 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c2190-1d2a-4377-ba58-d2ec96610390 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:17.300364 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c2190-1d2a-4377-ba58-d2ec96610390 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:17.300364 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c2190-1d2a-4377-ba58-d2ec96610390 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:17.301662 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 560/1111] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:42:17.307498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1e658-5235-47ec-81c8-0c9768f9d73d None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:17.307870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1e658-5235-47ec-81c8-0c9768f9d73d None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:17.308032 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1e658-5235-47ec-81c8-0c9768f9d73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:17.325995 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-e3b1e658-5235-47ec-81c8-0c9768f9d73d None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:17.327192 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-e3b1e658-5235-47ec-81c8-0c9768f9d73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:17.344067 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:17.390813 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 552/1112] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:42:17.414404 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c2190-1d2a-4377-ba58-d2ec96610390 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:17.512025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c2190-1d2a-4377-ba58-d2ec96610390 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:17.544305 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32071cea-75b9-4ac2-991a-3a456d170875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:17.544907 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32071cea-75b9-4ac2-991a-3a456d170875 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:17.545181 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32071cea-75b9-4ac2-991a-3a456d170875 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:17.545449 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32071cea-75b9-4ac2-991a-3a456d170875 None admin] PATH_INFO: `/v3/roles/da3ceb6dfa1746f19dbaf26e2c3ef7ab` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:17.546821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32071cea-75b9-4ac2-991a-3a456d170875 None admin] RBAC: Authorizing `identity:get_role(role_id=da3ceb6dfa1746f19dbaf26e2c3ef7ab)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:17.548174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32071cea-75b9-4ac2-991a-3a456d170875 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:17.549447 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 561/1113] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:42:17 2022] GET /identity/v3/roles/da3ceb6dfa1746f19dbaf26e2c3ef7ab => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:17.555379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1e658-5235-47ec-81c8-0c9768f9d73d None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:17.649540 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1e658-5235-47ec-81c8-0c9768f9d73d None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:17.683547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a675e-a418-477e-a546-06ecf11bc137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:17.684170 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a675e-a418-477e-a546-06ecf11bc137 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:17.684447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a675e-a418-477e-a546-06ecf11bc137 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:17.684715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a675e-a418-477e-a546-06ecf11bc137 None admin] PATH_INFO: `/v3/users/242d64a8a3e24877b0b4c3f87fc75a6a` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:17.697752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a675e-a418-477e-a546-06ecf11bc137 None admin] RBAC: Authorizing `identity:get_user(user_id=242d64a8a3e24877b0b4c3f87fc75a6a)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:17.699219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a675e-a418-477e-a546-06ecf11bc137 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:17.700787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 553/1114] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:42:17 2022] GET /identity/v3/users/242d64a8a3e24877b0b4c3f87fc75a6a => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:17.706451 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32071cea-75b9-4ac2-991a-3a456d170875 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:17.718020 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:17.815606 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32071cea-75b9-4ac2-991a-3a456d170875 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:17.847955 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0badd5-0be9-4121-8805-2a3d85da91d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:17.848543 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0badd5-0be9-4121-8805-2a3d85da91d0 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:17.848842 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0badd5-0be9-4121-8805-2a3d85da91d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:17.849111 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0badd5-0be9-4121-8805-2a3d85da91d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:17.912657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0badd5-0be9-4121-8805-2a3d85da91d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:17.914107 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0badd5-0be9-4121-8805-2a3d85da91d0 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:17.923097 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:18.007007 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 562/1115] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:42:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 09:42:18.012877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a675e-a418-477e-a546-06ecf11bc137 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:18.027639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:18.108182 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a675e-a418-477e-a546-06ecf11bc137 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:18.140665 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c0ca2-7581-476e-b9a8-322354a800a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:18.141272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c0ca2-7581-476e-b9a8-322354a800a2 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:18.141544 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c0ca2-7581-476e-b9a8-322354a800a2 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:18.141810 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c0ca2-7581-476e-b9a8-322354a800a2 None admin] PATH_INFO: `/v3/projects/48aafd02f10443a582d45779194f0b36` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:18.142927 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c0ca2-7581-476e-b9a8-322354a800a2 None admin] RBAC: Authorizing `identity:get_project(project_id=48aafd02f10443a582d45779194f0b36)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:18.144339 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c0ca2-7581-476e-b9a8-322354a800a2 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:18.145979 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 554/1116] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:42:18 2022] GET /identity/v3/projects/48aafd02f10443a582d45779194f0b36 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:18.152095 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0badd5-0be9-4121-8805-2a3d85da91d0 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:18.246350 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0badd5-0be9-4121-8805-2a3d85da91d0 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:18.255002 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:18.278613 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7788dd-e935-4683-a504-98bc39a83232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:18.279191 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7788dd-e935-4683-a504-98bc39a83232 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:18.279460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7788dd-e935-4683-a504-98bc39a83232 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:18.279728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7788dd-e935-4683-a504-98bc39a83232 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:18.280463 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7788dd-e935-4683-a504-98bc39a83232 None admin] RBAC: Adding query filter params (role.id=da3ceb6dfa1746f19dbaf26e2c3ef7ab, scope.project.id=48aafd02f10443a582d45779194f0b36, user.id=242d64a8a3e24877b0b4c3f87fc75a6a) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:18.280951 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7788dd-e935-4683-a504-98bc39a83232 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:18.282658 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7788dd-e935-4683-a504-98bc39a83232 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:18.287842 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 563/1117] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:42:18 2022] GET /identity/v3/role_assignments?user.id=242d64a8a3e24877b0b4c3f87fc75a6a&scope.project.id=48aafd02f10443a582d45779194f0b36&role.id=da3ceb6dfa1746f19dbaf26e2c3ef7ab => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:20.237358 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b7381-e151-4a2b-ac42-8e1d35fe8a34 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:20.237892 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b7381-e151-4a2b-ac42-8e1d35fe8a34 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:20.237892 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b7381-e151-4a2b-ac42-8e1d35fe8a34 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:20.239280 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 555/1118] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:42:20.244820 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7397ff1-57eb-434d-af4a-433d923c7934 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:20.245208 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7397ff1-57eb-434d-af4a-433d923c7934 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:20.245358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7397ff1-57eb-434d-af4a-433d923c7934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:20.262863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-a7397ff1-57eb-434d-af4a-433d923c7934 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:20.264040 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-a7397ff1-57eb-434d-af4a-433d923c7934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:20.327598 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 564/1119] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:42:20.350241 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b7381-e151-4a2b-ac42-8e1d35fe8a34 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:20.428271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:20.446570 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b7381-e151-4a2b-ac42-8e1d35fe8a34 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:20.479779 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb45b4c-dec0-45e7-837a-e7d0aceded17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:20.480392 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb45b4c-dec0-45e7-837a-e7d0aceded17 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:20.480667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb45b4c-dec0-45e7-837a-e7d0aceded17 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:20.480935 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb45b4c-dec0-45e7-837a-e7d0aceded17 None admin] PATH_INFO: `/v3/roles/da3ceb6dfa1746f19dbaf26e2c3ef7ab` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:20.482321 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb45b4c-dec0-45e7-837a-e7d0aceded17 None admin] RBAC: Authorizing `identity:get_role(role_id=da3ceb6dfa1746f19dbaf26e2c3ef7ab)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:20.483678 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb45b4c-dec0-45e7-837a-e7d0aceded17 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:20.484975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 556/1120] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:42:20 2022] GET /identity/v3/roles/da3ceb6dfa1746f19dbaf26e2c3ef7ab => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:20.490932 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7397ff1-57eb-434d-af4a-433d923c7934 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:20.584516 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7397ff1-57eb-434d-af4a-433d923c7934 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:20.585960 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:20.617106 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a9094-c22a-4fae-80b5-bff97298b78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:20.617712 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a9094-c22a-4fae-80b5-bff97298b78b None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:20.617983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a9094-c22a-4fae-80b5-bff97298b78b None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:20.618278 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a9094-c22a-4fae-80b5-bff97298b78b None admin] PATH_INFO: `/v3/users/242d64a8a3e24877b0b4c3f87fc75a6a` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:20.619368 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a9094-c22a-4fae-80b5-bff97298b78b None admin] RBAC: Authorizing `identity:get_user(user_id=242d64a8a3e24877b0b4c3f87fc75a6a)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:20.620762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a9094-c22a-4fae-80b5-bff97298b78b None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:20.622317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 565/1121] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:42:20 2022] GET /identity/v3/users/242d64a8a3e24877b0b4c3f87fc75a6a => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:20.627822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb45b4c-dec0-45e7-837a-e7d0aceded17 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:20.722839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb45b4c-dec0-45e7-837a-e7d0aceded17 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:20.755510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e1521-0fc9-4df2-8a3e-22692b491a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:20.756057 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e1521-0fc9-4df2-8a3e-22692b491a73 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:20.756329 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e1521-0fc9-4df2-8a3e-22692b491a73 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:20.756593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e1521-0fc9-4df2-8a3e-22692b491a73 None admin] PATH_INFO: `/v3/projects/48aafd02f10443a582d45779194f0b36` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:20.757670 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e1521-0fc9-4df2-8a3e-22692b491a73 None admin] RBAC: Authorizing `identity:get_project(project_id=48aafd02f10443a582d45779194f0b36)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:20.759112 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e1521-0fc9-4df2-8a3e-22692b491a73 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:20.760696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 557/1122] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:42:20 2022] GET /identity/v3/projects/48aafd02f10443a582d45779194f0b36 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:20.766569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a9094-c22a-4fae-80b5-bff97298b78b None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:20.868084 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a9094-c22a-4fae-80b5-bff97298b78b None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:20.901561 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d8f08-09d5-452b-8594-1fa31fa8e789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:20.902228 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d8f08-09d5-452b-8594-1fa31fa8e789 None admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:20.902501 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d8f08-09d5-452b-8594-1fa31fa8e789 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:20.902762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d8f08-09d5-452b-8594-1fa31fa8e789 None admin] PATH_INFO: `/v3/projects/48aafd02f10443a582d45779194f0b36/users/242d64a8a3e24877b0b4c3f87fc75a6a/roles/da3ceb6dfa1746f19dbaf26e2c3ef7ab` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:20.904831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d8f08-09d5-452b-8594-1fa31fa8e789 None admin] RBAC: Authorizing `identity:create_grant(project_id=48aafd02f10443a582d45779194f0b36, user_id=242d64a8a3e24877b0b4c3f87fc75a6a, role_id=da3ceb6dfa1746f19dbaf26e2c3ef7ab)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:20.906259 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d8f08-09d5-452b-8594-1fa31fa8e789 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:21.029445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 566/1123] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Aug 11 09:42:20 2022] PUT /identity/v3/projects/48aafd02f10443a582d45779194f0b36/users/242d64a8a3e24877b0b4c3f87fc75a6a/roles/da3ceb6dfa1746f19dbaf26e2c3ef7ab => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:42:22.991982 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5919f-c6dc-4d4f-af18-8b3f435e2088 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:22.992502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5919f-c6dc-4d4f-af18-8b3f435e2088 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:22.992502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5919f-c6dc-4d4f-af18-8b3f435e2088 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:22.993741 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 558/1124] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:42:22.998781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69302d12-cf5d-499f-b04f-081792394aeb None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:22.999263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69302d12-cf5d-499f-b04f-081792394aeb None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:22.999359 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69302d12-cf5d-499f-b04f-081792394aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:23.016718 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-69302d12-cf5d-499f-b04f-081792394aeb None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:23.017891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-69302d12-cf5d-499f-b04f-081792394aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:23.040643 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:23.081884 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 567/1125] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:42:23.105446 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5919f-c6dc-4d4f-af18-8b3f435e2088 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:23.123281 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:23.202151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5919f-c6dc-4d4f-af18-8b3f435e2088 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:23.234968 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381be059-db35-4cbe-839c-718d3c29a7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:23.235579 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381be059-db35-4cbe-839c-718d3c29a7a3 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:23.235849 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381be059-db35-4cbe-839c-718d3c29a7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:23.236110 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381be059-db35-4cbe-839c-718d3c29a7a3 None admin] PATH_INFO: `/v3/roles/da3ceb6dfa1746f19dbaf26e2c3ef7ab` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:23.237452 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381be059-db35-4cbe-839c-718d3c29a7a3 None admin] RBAC: Authorizing `identity:get_role(role_id=da3ceb6dfa1746f19dbaf26e2c3ef7ab)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:23.238831 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381be059-db35-4cbe-839c-718d3c29a7a3 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:23.240744 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 559/1126] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:42:23 2022] GET /identity/v3/roles/da3ceb6dfa1746f19dbaf26e2c3ef7ab => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:23.246798 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69302d12-cf5d-499f-b04f-081792394aeb None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:23.343311 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69302d12-cf5d-499f-b04f-081792394aeb None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:23.380967 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa2c73-f2f5-4862-b790-1ede68e72438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:23.381664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa2c73-f2f5-4862-b790-1ede68e72438 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:23.381859 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa2c73-f2f5-4862-b790-1ede68e72438 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:23.382148 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa2c73-f2f5-4862-b790-1ede68e72438 None admin] PATH_INFO: `/v3/users/242d64a8a3e24877b0b4c3f87fc75a6a` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:23.383402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa2c73-f2f5-4862-b790-1ede68e72438 None admin] RBAC: Authorizing `identity:get_user(user_id=242d64a8a3e24877b0b4c3f87fc75a6a)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:23.384827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa2c73-f2f5-4862-b790-1ede68e72438 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:23.386725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 568/1127] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:42:23 2022] GET /identity/v3/users/242d64a8a3e24877b0b4c3f87fc75a6a => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:23.392761 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381be059-db35-4cbe-839c-718d3c29a7a3 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:23.482526 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:23.501851 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381be059-db35-4cbe-839c-718d3c29a7a3 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:23.537390 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f59c58-5476-454f-88db-dc9f33171a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:23.537999 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f59c58-5476-454f-88db-dc9f33171a06 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:23.538303 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f59c58-5476-454f-88db-dc9f33171a06 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:23.538565 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f59c58-5476-454f-88db-dc9f33171a06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:23.604382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f59c58-5476-454f-88db-dc9f33171a06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:23.605827 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f59c58-5476-454f-88db-dc9f33171a06 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:23.683954 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:23.699895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 560/1128] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:42:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 09:42:23.705997 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa2c73-f2f5-4862-b790-1ede68e72438 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:23.733382 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:23.800855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa2c73-f2f5-4862-b790-1ede68e72438 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:23.833823 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19ac6d-66ef-4d6e-bc9a-2f2546361ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:23.834460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19ac6d-66ef-4d6e-bc9a-2f2546361ecb None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:23.834734 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19ac6d-66ef-4d6e-bc9a-2f2546361ecb None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:23.834999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19ac6d-66ef-4d6e-bc9a-2f2546361ecb None admin] PATH_INFO: `/v3/projects/48aafd02f10443a582d45779194f0b36` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:23.836079 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19ac6d-66ef-4d6e-bc9a-2f2546361ecb None admin] RBAC: Authorizing `identity:get_project(project_id=48aafd02f10443a582d45779194f0b36)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:23.837485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19ac6d-66ef-4d6e-bc9a-2f2546361ecb None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:23.839110 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 569/1129] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:42:23 2022] GET /identity/v3/projects/48aafd02f10443a582d45779194f0b36 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:23.845343 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f59c58-5476-454f-88db-dc9f33171a06 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:23.943358 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f59c58-5476-454f-88db-dc9f33171a06 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:23.976371 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3125a-3e67-4955-bb7d-78684ff977b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:23.976956 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3125a-3e67-4955-bb7d-78684ff977b7 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:23.977231 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3125a-3e67-4955-bb7d-78684ff977b7 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:23.977498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3125a-3e67-4955-bb7d-78684ff977b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:23.978240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3125a-3e67-4955-bb7d-78684ff977b7 None admin] RBAC: Adding query filter params (role.id=da3ceb6dfa1746f19dbaf26e2c3ef7ab, scope.project.id=48aafd02f10443a582d45779194f0b36, user.id=242d64a8a3e24877b0b4c3f87fc75a6a) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:23.978545 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3125a-3e67-4955-bb7d-78684ff977b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:23.979962 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3125a-3e67-4955-bb7d-78684ff977b7 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:23.985421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 561/1130] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:42:23 2022] GET /identity/v3/role_assignments?user.id=242d64a8a3e24877b0b4c3f87fc75a6a&scope.project.id=48aafd02f10443a582d45779194f0b36&role.id=da3ceb6dfa1746f19dbaf26e2c3ef7ab => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:25.982275 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c3668-4537-47a1-9ba3-d88ae32380e1 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:25.982797 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c3668-4537-47a1-9ba3-d88ae32380e1 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:25.982797 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c3668-4537-47a1-9ba3-d88ae32380e1 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:25.984057 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 570/1131] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:42:25.989200 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69e5eb-3c09-49a8-a50a-c2e65f1a5d0b None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:25.989767 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69e5eb-3c09-49a8-a50a-c2e65f1a5d0b None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:25.989767 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69e5eb-3c09-49a8-a50a-c2e65f1a5d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:26.012760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-0d69e5eb-3c09-49a8-a50a-c2e65f1a5d0b None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:26.014607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-0d69e5eb-3c09-49a8-a50a-c2e65f1a5d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:26.072640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:26.101596 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 562/1132] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:42:26.129170 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c3668-4537-47a1-9ba3-d88ae32380e1 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:26.226474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:26.237777 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c3668-4537-47a1-9ba3-d88ae32380e1 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:26.267976 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4a83a-ce74-4a64-80be-30e1c1d66e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:26.268599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4a83a-ce74-4a64-80be-30e1c1d66e61 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:26.268876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4a83a-ce74-4a64-80be-30e1c1d66e61 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:26.269147 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4a83a-ce74-4a64-80be-30e1c1d66e61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:26.270303 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b4a83a-ce74-4a64-80be-30e1c1d66e61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:26.271807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b4a83a-ce74-4a64-80be-30e1c1d66e61 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:26.273417 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 571/1133] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:42:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:26.279245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69e5eb-3c09-49a8-a50a-c2e65f1a5d0b None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:26.377110 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69e5eb-3c09-49a8-a50a-c2e65f1a5d0b None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:26.409953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232df3e-52c5-49ae-b707-55d9a8eb820a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:26.410578 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232df3e-52c5-49ae-b707-55d9a8eb820a None admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:26.411404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232df3e-52c5-49ae-b707-55d9a8eb820a None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:26.411675 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232df3e-52c5-49ae-b707-55d9a8eb820a None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:26.412313 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232df3e-52c5-49ae-b707-55d9a8eb820a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:26.413741 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232df3e-52c5-49ae-b707-55d9a8eb820a None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:26.500977 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 563/1134] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Aug 11 09:42:26 2022] POST /identity/v3/projects => generated 311 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:42:28.516285 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa8043-d98b-44d6-829f-27a9b4dbffc0 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:28.516820 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa8043-d98b-44d6-829f-27a9b4dbffc0 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:28.516820 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa8043-d98b-44d6-829f-27a9b4dbffc0 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:28.518178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 572/1135] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:42:28.523872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48dd76-2247-4991-9c92-b025531eb953 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:28.524286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48dd76-2247-4991-9c92-b025531eb953 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:28.524402 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48dd76-2247-4991-9c92-b025531eb953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:28.542593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-3f48dd76-2247-4991-9c92-b025531eb953 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:28.543755 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-3f48dd76-2247-4991-9c92-b025531eb953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:28.566730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:28.607531 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 564/1136] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:42:28.632072 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa8043-d98b-44d6-829f-27a9b4dbffc0 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:28.729011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa8043-d98b-44d6-829f-27a9b4dbffc0 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:28.761996 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba8846-43a0-4636-bdd6-f4341b9f6420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:28.769092 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba8846-43a0-4636-bdd6-f4341b9f6420 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:28.769092 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba8846-43a0-4636-bdd6-f4341b9f6420 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:28.769092 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba8846-43a0-4636-bdd6-f4341b9f6420 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:28.769092 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba8846-43a0-4636-bdd6-f4341b9f6420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:28.769092 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba8846-43a0-4636-bdd6-f4341b9f6420 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:28.769092 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 573/1137] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:42:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:28.772950 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48dd76-2247-4991-9c92-b025531eb953 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:28.865953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48dd76-2247-4991-9c92-b025531eb953 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:28.898142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bb097-4f7f-4dfd-af0e-ec8e714586f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:28.898727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bb097-4f7f-4dfd-af0e-ec8e714586f2 None admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:28.898995 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bb097-4f7f-4dfd-af0e-ec8e714586f2 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:28.899256 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bb097-4f7f-4dfd-af0e-ec8e714586f2 None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:28.899872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bb097-4f7f-4dfd-af0e-ec8e714586f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:28.901286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bb097-4f7f-4dfd-af0e-ec8e714586f2 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:29.006187 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 565/1138] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Aug 11 09:42:28 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:42:31.037144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47512c0b-0e65-46f5-9461-a862aefece54 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:31.037670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47512c0b-0e65-46f5-9461-a862aefece54 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:31.037670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47512c0b-0e65-46f5-9461-a862aefece54 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:31.039020 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 574/1139] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:42:31.044042 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5fd80-7ec0-4b39-8ffd-cb63c418902a None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:31.044476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5fd80-7ec0-4b39-8ffd-cb63c418902a None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:31.044575 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5fd80-7ec0-4b39-8ffd-cb63c418902a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:31.062239 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-c8d5fd80-7ec0-4b39-8ffd-cb63c418902a None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:31.063399 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-c8d5fd80-7ec0-4b39-8ffd-cb63c418902a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:31.073545 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:31.126359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 566/1140] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:42:31.151394 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47512c0b-0e65-46f5-9461-a862aefece54 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:31.184153 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:31.253818 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47512c0b-0e65-46f5-9461-a862aefece54 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:31.286582 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8843ee-082e-488b-ad34-1c8ab7edc557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:31.287243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8843ee-082e-488b-ad34-1c8ab7edc557 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:31.287466 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8843ee-082e-488b-ad34-1c8ab7edc557 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:31.287733 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8843ee-082e-488b-ad34-1c8ab7edc557 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:31.297352 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8843ee-082e-488b-ad34-1c8ab7edc557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:42:31.301883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-2a8843ee-082e-488b-ad34-1c8ab7edc557 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:42:31.301883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:31.301883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:31.301883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:31.301883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:31.301883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:31.301883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:31.301883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:31.301883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:31.301883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:31.301883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:31.301883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:31.301883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:42:31.301883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:42:31.301883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:42:31.301883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:42:31.303326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:42:31.303326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:42:31.303326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:42:31.303326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:42:31.303326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:31.303326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:31.303326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:31.303326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:31.303326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:31.303326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:31.303326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:31.303326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:31.303326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:31.303326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:31.303326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:31.303326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:31.304564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:31.304564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:31.304564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:31.304564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:31.304564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:42:31.304564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:42:31.304564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:42:31.304564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:42:31.304564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:42:31.304564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:42:31.304564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:42:31.304564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:42:31.304564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 575/1141] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:42:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:42:31.309260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5fd80-7ec0-4b39-8ffd-cb63c418902a None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:31.405282 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5fd80-7ec0-4b39-8ffd-cb63c418902a None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:31.437573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cee61a-5be2-4657-a2b7-869e56ffe43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:31.438200 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cee61a-5be2-4657-a2b7-869e56ffe43b None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:31.438478 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cee61a-5be2-4657-a2b7-869e56ffe43b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:31.438745 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cee61a-5be2-4657-a2b7-869e56ffe43b None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:31.439398 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cee61a-5be2-4657-a2b7-869e56ffe43b None admin] RBAC: Adding query filter params (name=admin) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:31.439703 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cee61a-5be2-4657-a2b7-869e56ffe43b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:31.441064 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cee61a-5be2-4657-a2b7-869e56ffe43b None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:31.450432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 567/1142] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:42:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:31.456339 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8843ee-082e-488b-ad34-1c8ab7edc557 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:31.548206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:31.557259 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8843ee-082e-488b-ad34-1c8ab7edc557 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:31.589599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87945b-8029-4f6c-8de6-3795687fb948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:31.590245 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87945b-8029-4f6c-8de6-3795687fb948 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:31.590522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87945b-8029-4f6c-8de6-3795687fb948 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:31.590793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87945b-8029-4f6c-8de6-3795687fb948 None admin] PATH_INFO: `/v3/users/9aede49701ef46d0976e3323fb555106` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:31.604398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87945b-8029-4f6c-8de6-3795687fb948 None admin] RBAC: Authorizing `identity:get_user(user_id=9aede49701ef46d0976e3323fb555106)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:31.605823 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87945b-8029-4f6c-8de6-3795687fb948 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:31.607439 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 576/1143] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:42:31 2022] GET /identity/v3/users/9aede49701ef46d0976e3323fb555106 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:31.613235 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cee61a-5be2-4657-a2b7-869e56ffe43b None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:31.624101 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:31.709644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cee61a-5be2-4657-a2b7-869e56ffe43b None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:31.820465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2396c46-99ff-4494-b8d0-25483a7f7112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:31.820983 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2396c46-99ff-4494-b8d0-25483a7f7112 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:31.821254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2396c46-99ff-4494-b8d0-25483a7f7112 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:31.821516 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2396c46-99ff-4494-b8d0-25483a7f7112 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:31.885803 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2396c46-99ff-4494-b8d0-25483a7f7112 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:31.887268 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2396c46-99ff-4494-b8d0-25483a7f7112 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:31.896897 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:31.981043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 568/1144] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:42:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 09:42:31.987010 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87945b-8029-4f6c-8de6-3795687fb948 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:32.081276 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87945b-8029-4f6c-8de6-3795687fb948 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:32.114265 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddeffcd-cd59-4306-9f15-b57853bd1fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:32.114871 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddeffcd-cd59-4306-9f15-b57853bd1fcc None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:32.115140 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddeffcd-cd59-4306-9f15-b57853bd1fcc None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:32.115400 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddeffcd-cd59-4306-9f15-b57853bd1fcc None admin] PATH_INFO: `/v3/projects/2aa65eeb948946fc8afb4947148740b2` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:32.116480 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddeffcd-cd59-4306-9f15-b57853bd1fcc None admin] RBAC: Authorizing `identity:get_project(project_id=2aa65eeb948946fc8afb4947148740b2)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:32.117877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddeffcd-cd59-4306-9f15-b57853bd1fcc None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:32.119481 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 577/1145] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:42:31 2022] GET /identity/v3/projects/2aa65eeb948946fc8afb4947148740b2 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:32.125355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2396c46-99ff-4494-b8d0-25483a7f7112 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:32.217106 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2396c46-99ff-4494-b8d0-25483a7f7112 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:32.226471 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:32.249927 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ec75b-5577-42d4-958b-12134aaf410b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:32.250535 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ec75b-5577-42d4-958b-12134aaf410b None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:32.250804 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ec75b-5577-42d4-958b-12134aaf410b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:32.251074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ec75b-5577-42d4-958b-12134aaf410b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:32.251772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ec75b-5577-42d4-958b-12134aaf410b None admin] RBAC: Adding query filter params (role.id=6aae1c66f3f04cec80ed72c20d7e033b, scope.project.id=2aa65eeb948946fc8afb4947148740b2, user.id=9aede49701ef46d0976e3323fb555106) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:32.252070 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ec75b-5577-42d4-958b-12134aaf410b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:32.253471 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ec75b-5577-42d4-958b-12134aaf410b None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:32.258632 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 569/1146] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:42:32 2022] GET /identity/v3/role_assignments?user.id=9aede49701ef46d0976e3323fb555106&scope.project.id=2aa65eeb948946fc8afb4947148740b2&role.id=6aae1c66f3f04cec80ed72c20d7e033b => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:34.218561 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b02536-ecf4-4b9e-aa84-a0a152fbd6ab None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:34.219115 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b02536-ecf4-4b9e-aa84-a0a152fbd6ab None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:34.219115 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b02536-ecf4-4b9e-aa84-a0a152fbd6ab None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:34.220421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 578/1147] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:42:34.225612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b252d12-7a27-4188-b36c-de9e9e5cfdf9 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:34.225998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b252d12-7a27-4188-b36c-de9e9e5cfdf9 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:34.226188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b252d12-7a27-4188-b36c-de9e9e5cfdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:34.243618 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-6b252d12-7a27-4188-b36c-de9e9e5cfdf9 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:34.244789 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-6b252d12-7a27-4188-b36c-de9e9e5cfdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:34.308948 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 570/1148] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:42:34.331168 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b02536-ecf4-4b9e-aa84-a0a152fbd6ab None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:34.350363 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:34.430409 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b02536-ecf4-4b9e-aa84-a0a152fbd6ab None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:34.463127 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9ddff-bcd9-4092-b925-e50bc50128c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:34.463731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9ddff-bcd9-4092-b925-e50bc50128c3 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:34.464003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9ddff-bcd9-4092-b925-e50bc50128c3 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:34.464267 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9ddff-bcd9-4092-b925-e50bc50128c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:34.473859 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9ddff-bcd9-4092-b925-e50bc50128c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:42:34.478342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-9cd9ddff-bcd9-4092-b925-e50bc50128c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:42:34.478342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:34.478342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:34.478342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:34.478342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:34.478342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:34.478342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:34.478342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:34.478342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:34.478342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:34.478342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:34.478342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:34.478342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:42:34.478342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:42:34.478342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:42:34.478342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:42:34.479421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:42:34.479421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:42:34.479421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:42:34.479421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:42:34.479421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:34.479421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:34.479421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:34.479421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:34.479421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:34.479421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:34.479421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:34.479421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:34.479421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:34.479421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:34.479421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:34.479421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:34.480620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:34.480620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:34.480620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:34.480620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:34.480620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:42:34.480620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:42:34.480620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:42:34.480620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:42:34.480620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:42:34.480620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:42:34.480620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:42:34.480620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:42:34.480620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 579/1149] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:42:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:42:34.485390 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b252d12-7a27-4188-b36c-de9e9e5cfdf9 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:34.579115 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b252d12-7a27-4188-b36c-de9e9e5cfdf9 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:34.580557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:34.611481 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d078df-90b9-4ac3-823b-0e275210da3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:34.612091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d078df-90b9-4ac3-823b-0e275210da3f None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:34.612364 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d078df-90b9-4ac3-823b-0e275210da3f None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:34.612629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d078df-90b9-4ac3-823b-0e275210da3f None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:34.613801 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d078df-90b9-4ac3-823b-0e275210da3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:34.614127 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d078df-90b9-4ac3-823b-0e275210da3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:34.615484 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d078df-90b9-4ac3-823b-0e275210da3f None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:34.623101 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 571/1150] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:42:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:34.628688 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9ddff-bcd9-4092-b925-e50bc50128c3 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:34.704581 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:34.724927 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9ddff-bcd9-4092-b925-e50bc50128c3 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:34.758912 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc5edc-3c18-49be-910c-0953fead20ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:34.759520 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc5edc-3c18-49be-910c-0953fead20ee None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:34.759792 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc5edc-3c18-49be-910c-0953fead20ee None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:34.760054 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc5edc-3c18-49be-910c-0953fead20ee None admin] PATH_INFO: `/v3/users/9aede49701ef46d0976e3323fb555106` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:34.761142 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc5edc-3c18-49be-910c-0953fead20ee None admin] RBAC: Authorizing `identity:get_user(user_id=9aede49701ef46d0976e3323fb555106)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:34.762589 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc5edc-3c18-49be-910c-0953fead20ee None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:34.764114 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 580/1151] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:42:34 2022] GET /identity/v3/users/9aede49701ef46d0976e3323fb555106 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:34.770012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d078df-90b9-4ac3-823b-0e275210da3f None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:34.872159 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d078df-90b9-4ac3-823b-0e275210da3f None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:34.904240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a53d20-c470-43d5-b75b-a6d2d27cc219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:34.904852 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a53d20-c470-43d5-b75b-a6d2d27cc219 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:34.905124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a53d20-c470-43d5-b75b-a6d2d27cc219 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:34.905389 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a53d20-c470-43d5-b75b-a6d2d27cc219 None admin] PATH_INFO: `/v3/projects/2aa65eeb948946fc8afb4947148740b2` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:34.906503 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a53d20-c470-43d5-b75b-a6d2d27cc219 None admin] RBAC: Authorizing `identity:get_project(project_id=2aa65eeb948946fc8afb4947148740b2)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:34.907923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a53d20-c470-43d5-b75b-a6d2d27cc219 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:34.909529 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 572/1152] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:42:34 2022] GET /identity/v3/projects/2aa65eeb948946fc8afb4947148740b2 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:34.915932 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc5edc-3c18-49be-910c-0953fead20ee None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:35.010119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc5edc-3c18-49be-910c-0953fead20ee None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:35.042085 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa3a7d-e104-4887-99dc-82bf236e2cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:35.042736 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa3a7d-e104-4887-99dc-82bf236e2cdf None admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:35.043009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa3a7d-e104-4887-99dc-82bf236e2cdf None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:35.043276 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa3a7d-e104-4887-99dc-82bf236e2cdf None admin] PATH_INFO: `/v3/projects/2aa65eeb948946fc8afb4947148740b2/users/9aede49701ef46d0976e3323fb555106/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:35.045123 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa3a7d-e104-4887-99dc-82bf236e2cdf None admin] RBAC: Authorizing `identity:create_grant(project_id=2aa65eeb948946fc8afb4947148740b2, user_id=9aede49701ef46d0976e3323fb555106, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:35.046553 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa3a7d-e104-4887-99dc-82bf236e2cdf None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:35.133161 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 581/1153] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Aug 11 09:42:34 2022] PUT /identity/v3/projects/2aa65eeb948946fc8afb4947148740b2/users/9aede49701ef46d0976e3323fb555106/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:42:37.101751 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321f52a-f409-481e-883c-de6a7c1837b3 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:37.102333 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321f52a-f409-481e-883c-de6a7c1837b3 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:37.102333 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321f52a-f409-481e-883c-de6a7c1837b3 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:37.103643 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 573/1154] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:42:37.108610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952af5c-2e38-4a8b-a5b2-6c858a97afe3 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:37.109006 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952af5c-2e38-4a8b-a5b2-6c858a97afe3 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:37.109143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952af5c-2e38-4a8b-a5b2-6c858a97afe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:37.121163 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:37.126843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-9952af5c-2e38-4a8b-a5b2-6c858a97afe3 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:37.128001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-9952af5c-2e38-4a8b-a5b2-6c858a97afe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:37.192379 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 582/1155] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:42:37.215377 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321f52a-f409-481e-883c-de6a7c1837b3 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:37.245417 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:37.312490 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321f52a-f409-481e-883c-de6a7c1837b3 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:37.344965 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db463823-1338-42b2-af8c-02d7cfe249e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:37.345573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db463823-1338-42b2-af8c-02d7cfe249e9 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:37.345844 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db463823-1338-42b2-af8c-02d7cfe249e9 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:37.346132 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db463823-1338-42b2-af8c-02d7cfe249e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:37.356409 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db463823-1338-42b2-af8c-02d7cfe249e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:42:37.360939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-db463823-1338-42b2-af8c-02d7cfe249e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:42:37.360939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:37.360939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:37.360939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:37.360939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:37.360939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:37.360939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:37.360939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:37.360939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:37.360939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:37.360939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:37.360939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:37.360939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:42:37.360939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:42:37.360939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:42:37.360939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:42:37.362052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:42:37.362052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:42:37.362052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:42:37.362052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:42:37.362052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:37.362052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:37.362052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:37.362052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:37.362052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:37.362052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:37.362052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:37.362052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:37.362052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:37.362052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:37.362052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:37.362052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:37.363232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:37.363232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:37.363232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:37.363232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:37.363232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:42:37.363232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:42:37.363232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:42:37.363232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:42:37.363232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:42:37.363232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:42:37.363232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:42:37.363232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:42:37.363232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 574/1156] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:42:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:42:37.367958 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952af5c-2e38-4a8b-a5b2-6c858a97afe3 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:37.462985 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952af5c-2e38-4a8b-a5b2-6c858a97afe3 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:37.494975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afc2b5-a1bf-4e8f-b462-12369d12f8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:37.495565 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afc2b5-a1bf-4e8f-b462-12369d12f8dc None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:37.495841 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afc2b5-a1bf-4e8f-b462-12369d12f8dc None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:37.496113 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afc2b5-a1bf-4e8f-b462-12369d12f8dc None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:37.496765 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85afc2b5-a1bf-4e8f-b462-12369d12f8dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:37.497064 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85afc2b5-a1bf-4e8f-b462-12369d12f8dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:37.498446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85afc2b5-a1bf-4e8f-b462-12369d12f8dc None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:37.500515 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:37.507045 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 583/1157] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:42:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:37.512879 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db463823-1338-42b2-af8c-02d7cfe249e9 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:37.601214 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:37.613486 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db463823-1338-42b2-af8c-02d7cfe249e9 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:37.641780 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a306d-f948-4765-93ce-1d128da46730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:37.642419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a306d-f948-4765-93ce-1d128da46730 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:37.642695 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a306d-f948-4765-93ce-1d128da46730 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:37.642962 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a306d-f948-4765-93ce-1d128da46730 None admin] PATH_INFO: `/v3/users/9aede49701ef46d0976e3323fb555106` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:37.644066 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a306d-f948-4765-93ce-1d128da46730 None admin] RBAC: Authorizing `identity:get_user(user_id=9aede49701ef46d0976e3323fb555106)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:37.645517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a306d-f948-4765-93ce-1d128da46730 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:37.647114 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 575/1158] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:42:37 2022] GET /identity/v3/users/9aede49701ef46d0976e3323fb555106 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:37.652857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afc2b5-a1bf-4e8f-b462-12369d12f8dc None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:37.748951 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afc2b5-a1bf-4e8f-b462-12369d12f8dc None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:37.781688 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e4da4-a817-421e-acd2-36184b19ae62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:37.782299 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e4da4-a817-421e-acd2-36184b19ae62 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:37.782576 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e4da4-a817-421e-acd2-36184b19ae62 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:37.782846 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e4da4-a817-421e-acd2-36184b19ae62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:37.843827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:37.847114 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e4da4-a817-421e-acd2-36184b19ae62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:37.849113 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e4da4-a817-421e-acd2-36184b19ae62 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:37.954503 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 584/1159] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:42:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 11 09:42:37.961044 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a306d-f948-4765-93ce-1d128da46730 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:38.054504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a306d-f948-4765-93ce-1d128da46730 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:38.086440 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce320f08-480f-4d03-b906-429524843445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:38.087039 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce320f08-480f-4d03-b906-429524843445 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:38.087309 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce320f08-480f-4d03-b906-429524843445 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:38.087570 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce320f08-480f-4d03-b906-429524843445 None admin] PATH_INFO: `/v3/projects/2aa65eeb948946fc8afb4947148740b2` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:38.088668 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce320f08-480f-4d03-b906-429524843445 None admin] RBAC: Authorizing `identity:get_project(project_id=2aa65eeb948946fc8afb4947148740b2)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:38.090069 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce320f08-480f-4d03-b906-429524843445 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:38.091654 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 576/1160] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:42:37 2022] GET /identity/v3/projects/2aa65eeb948946fc8afb4947148740b2 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:38.097712 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e4da4-a817-421e-acd2-36184b19ae62 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:38.188938 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:38.192976 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e4da4-a817-421e-acd2-36184b19ae62 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:38.225093 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d1b9f-bb6c-42bd-8d52-d9a8e71a853c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:38.225656 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d1b9f-bb6c-42bd-8d52-d9a8e71a853c None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:38.225925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d1b9f-bb6c-42bd-8d52-d9a8e71a853c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:38.226214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d1b9f-bb6c-42bd-8d52-d9a8e71a853c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:38.226910 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d1b9f-bb6c-42bd-8d52-d9a8e71a853c None admin] RBAC: Adding query filter params (role.id=6aae1c66f3f04cec80ed72c20d7e033b, scope.project.id=2aa65eeb948946fc8afb4947148740b2, user.id=9aede49701ef46d0976e3323fb555106) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:38.227209 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d1b9f-bb6c-42bd-8d52-d9a8e71a853c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:38.228598 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d1b9f-bb6c-42bd-8d52-d9a8e71a853c None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:38.234651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 585/1161] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:42:38 2022] GET /identity/v3/role_assignments?user.id=9aede49701ef46d0976e3323fb555106&scope.project.id=2aa65eeb948946fc8afb4947148740b2&role.id=6aae1c66f3f04cec80ed72c20d7e033b => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:40.236592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed9f2b-8c74-45bd-8414-154e23d8fce2 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:40.237121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed9f2b-8c74-45bd-8414-154e23d8fce2 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:40.237121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed9f2b-8c74-45bd-8414-154e23d8fce2 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:40.238478 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 577/1162] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:42:40.243457 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672e8ab-ccc6-4fe4-9a7f-748e26ee6c44 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:40.243869 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672e8ab-ccc6-4fe4-9a7f-748e26ee6c44 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:40.243986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672e8ab-ccc6-4fe4-9a7f-748e26ee6c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:40.262097 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-1672e8ab-ccc6-4fe4-9a7f-748e26ee6c44 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:40.263263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-1672e8ab-ccc6-4fe4-9a7f-748e26ee6c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:40.325897 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 586/1163] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:42:40.348041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed9f2b-8c74-45bd-8414-154e23d8fce2 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:40.375245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:40.445799 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed9f2b-8c74-45bd-8414-154e23d8fce2 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:40.477912 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5dd4ab-9199-4a58-9053-f63cb56e5ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:40.478524 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dd4ab-9199-4a58-9053-f63cb56e5ae2 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:40.478807 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dd4ab-9199-4a58-9053-f63cb56e5ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:40.479074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dd4ab-9199-4a58-9053-f63cb56e5ae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:40.543315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5dd4ab-9199-4a58-9053-f63cb56e5ae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:40.544753 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5dd4ab-9199-4a58-9053-f63cb56e5ae2 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:40.571337 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:40.639805 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 578/1164] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:42:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 09:42:40.645641 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672e8ab-ccc6-4fe4-9a7f-748e26ee6c44 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:40.732051 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:40.741094 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672e8ab-ccc6-4fe4-9a7f-748e26ee6c44 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:40.774406 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08039e4e-ec3d-45db-8327-53c9874a68a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:40.775012 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08039e4e-ec3d-45db-8327-53c9874a68a0 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:40.775283 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08039e4e-ec3d-45db-8327-53c9874a68a0 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:40.775546 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08039e4e-ec3d-45db-8327-53c9874a68a0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:40.782300 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08039e4e-ec3d-45db-8327-53c9874a68a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:40.783717 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08039e4e-ec3d-45db-8327-53c9874a68a0 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:40.795254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-08039e4e-ec3d-45db-8327-53c9874a68a0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 11 09:42:40.795254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:40.795254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 11 09:42:40.795254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 11 09:42:40.795254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:42:40.795254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:42:40.795254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:42:40.795254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:42:40.795254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 11 09:42:40.795254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:42:40.795254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:42:40.795254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:42:40.795254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:40.795254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:40.795254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:40.795254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:40.795254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:40.796416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:40.796416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:40.796416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:40.796416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:40.796416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:40.796416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:40.796416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:42:40.796416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:42:40.796416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:42:40.796416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:42:40.796416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:40.796416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:40.796416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:40.796416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:40.796416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:40.796416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:40.797472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:40.797472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:40.797472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:40.797472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:40.797472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:40.797472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:40.797472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:40.797472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:40.797472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:40.797472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:40.797472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 11 09:42:40.797472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:42:40.797472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 11 09:42:40.797472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:42:40.797472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 587/1165] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Aug 11 09:42:40 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:42:40.802425 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5dd4ab-9199-4a58-9053-f63cb56e5ae2 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:40.896618 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5dd4ab-9199-4a58-9053-f63cb56e5ae2 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:40.921838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:40.929525 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed44607-a22a-4a3d-a92e-ccd4afeafac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:40.930142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed44607-a22a-4a3d-a92e-ccd4afeafac6 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:40.932044 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed44607-a22a-4a3d-a92e-ccd4afeafac6 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:40.932044 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed44607-a22a-4a3d-a92e-ccd4afeafac6 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:40.932044 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed44607-a22a-4a3d-a92e-ccd4afeafac6 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:40.932044 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed44607-a22a-4a3d-a92e-ccd4afeafac6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:40.933065 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed44607-a22a-4a3d-a92e-ccd4afeafac6 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:40.939888 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 579/1166] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Aug 11 09:42:40 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:42.906608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3aa9a-66da-4fce-baae-787e7aa13dad None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:42.907146 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3aa9a-66da-4fce-baae-787e7aa13dad None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:42.907146 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3aa9a-66da-4fce-baae-787e7aa13dad None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:42.908368 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 588/1167] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:42:42.913549 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e403c-fdb2-4340-b709-aa959e5f5fe0 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:42.913971 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e403c-fdb2-4340-b709-aa959e5f5fe0 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:42.914184 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e403c-fdb2-4340-b709-aa959e5f5fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:42.932460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-e42e403c-fdb2-4340-b709-aa959e5f5fe0 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:42.933632 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-e42e403c-fdb2-4340-b709-aa959e5f5fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:42.997828 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 580/1168] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:42:43.021163 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3aa9a-66da-4fce-baae-787e7aa13dad None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:43.117237 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3aa9a-66da-4fce-baae-787e7aa13dad None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:43.149568 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d069bc1-007c-4f83-af4d-ca3db8e2ae6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:43.150173 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d069bc1-007c-4f83-af4d-ca3db8e2ae6c None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:43.150446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d069bc1-007c-4f83-af4d-ca3db8e2ae6c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:43.150709 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d069bc1-007c-4f83-af4d-ca3db8e2ae6c None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:43.151347 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d069bc1-007c-4f83-af4d-ca3db8e2ae6c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:43.152699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d069bc1-007c-4f83-af4d-ca3db8e2ae6c None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:43.237189 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 589/1169] 10.222.0.13 () {60 vars in 1138 bytes} [Thu Aug 11 09:42:43 2022] POST /identity/v3/domains => generated 267 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:42:45.239160 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbe0fd-bf9f-4ece-a5b0-571af99b5e5e None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:45.239711 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbe0fd-bf9f-4ece-a5b0-571af99b5e5e None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:45.239711 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbe0fd-bf9f-4ece-a5b0-571af99b5e5e None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:45.241014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 581/1170] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:42:45.246172 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f86492-1a09-4559-87c9-6048ef1a2c58 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:45.246614 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f86492-1a09-4559-87c9-6048ef1a2c58 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:45.246706 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f86492-1a09-4559-87c9-6048ef1a2c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:45.264805 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-d3f86492-1a09-4559-87c9-6048ef1a2c58 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:45.265979 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-d3f86492-1a09-4559-87c9-6048ef1a2c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:45.273095 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:45.330227 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 590/1171] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:42:45.352822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbe0fd-bf9f-4ece-a5b0-571af99b5e5e None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:45.449191 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbe0fd-bf9f-4ece-a5b0-571af99b5e5e None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:45.470203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:45.486310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a37986-0d5c-4e00-a8fd-8c78bb3491a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:45.486928 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a37986-0d5c-4e00-a8fd-8c78bb3491a8 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:45.487201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a37986-0d5c-4e00-a8fd-8c78bb3491a8 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:45.488103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a37986-0d5c-4e00-a8fd-8c78bb3491a8 None admin] PATH_INFO: `/v3/domains/d754ac33931445d599af694f38547da7` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:45.498328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a37986-0d5c-4e00-a8fd-8c78bb3491a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d754ac33931445d599af694f38547da7)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:45.507795 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a37986-0d5c-4e00-a8fd-8c78bb3491a8 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:45.509417 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 582/1172] 10.222.0.13 () {56 vars in 1183 bytes} [Thu Aug 11 09:42:45 2022] GET /identity/v3/domains/d754ac33931445d599af694f38547da7 => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:45.515421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f86492-1a09-4559-87c9-6048ef1a2c58 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:45.610161 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f86492-1a09-4559-87c9-6048ef1a2c58 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:45.643822 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76938df1-46f1-468f-8ee0-4ccdb18c534b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:45.644414 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76938df1-46f1-468f-8ee0-4ccdb18c534b None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:45.644689 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76938df1-46f1-468f-8ee0-4ccdb18c534b None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:45.644957 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76938df1-46f1-468f-8ee0-4ccdb18c534b None admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:45.645596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76938df1-46f1-468f-8ee0-4ccdb18c534b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:45.647037 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76938df1-46f1-468f-8ee0-4ccdb18c534b None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:45.661403 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:45.743986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 591/1173] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Aug 11 09:42:45 2022] POST /identity/v3/projects => generated 361 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:42:47.758612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0bbea-86c8-47be-89cb-67f376756073 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:47.759097 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0bbea-86c8-47be-89cb-67f376756073 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:47.759204 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0bbea-86c8-47be-89cb-67f376756073 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:47.760459 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 583/1174] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:42:47.765512 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19eb3a4-768e-4a27-8a54-6159f1807f67 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:47.765956 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19eb3a4-768e-4a27-8a54-6159f1807f67 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:47.766060 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19eb3a4-768e-4a27-8a54-6159f1807f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:47.784365 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-d19eb3a4-768e-4a27-8a54-6159f1807f67 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:47.785604 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-d19eb3a4-768e-4a27-8a54-6159f1807f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:47.852767 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 592/1175] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 09:42:47.875972 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0bbea-86c8-47be-89cb-67f376756073 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:47.976442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0bbea-86c8-47be-89cb-67f376756073 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:48.008076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1da6a-d9b4-45b7-be1f-7abd56884d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:48.008683 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1da6a-d9b4-45b7-be1f-7abd56884d46 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:48.008952 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1da6a-d9b4-45b7-be1f-7abd56884d46 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:48.009213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1da6a-d9b4-45b7-be1f-7abd56884d46 None admin] PATH_INFO: `/v3/domains/d754ac33931445d599af694f38547da7` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:48.010314 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1da6a-d9b4-45b7-be1f-7abd56884d46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d754ac33931445d599af694f38547da7)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:48.011725 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1da6a-d9b4-45b7-be1f-7abd56884d46 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:48.013249 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 584/1176] 10.222.0.13 () {56 vars in 1183 bytes} [Thu Aug 11 09:42:47 2022] GET /identity/v3/domains/d754ac33931445d599af694f38547da7 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:48.019636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19eb3a4-768e-4a27-8a54-6159f1807f67 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:48.113432 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19eb3a4-768e-4a27-8a54-6159f1807f67 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:48.135770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:48.145814 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9b388-2cb2-4249-8023-be635a3db4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:48.146461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9b388-2cb2-4249-8023-be635a3db4b9 None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:48.146735 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9b388-2cb2-4249-8023-be635a3db4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:48.147003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9b388-2cb2-4249-8023-be635a3db4b9 None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:48.147636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9b388-2cb2-4249-8023-be635a3db4b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:48.149032 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9b388-2cb2-4249-8023-be635a3db4b9 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:48.218509 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 593/1177] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Aug 11 09:42:48 2022] POST /identity/v3/users => generated 311 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:42:50.245390 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7904a4b-a7f8-4be5-b143-8fe6be24bb12 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:50.245923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7904a4b-a7f8-4be5-b143-8fe6be24bb12 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:50.245923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7904a4b-a7f8-4be5-b143-8fe6be24bb12 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:50.247277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 585/1178] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:42:50.252282 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bfba5-b771-4d80-8f15-56d95d88cf58 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:50.252677 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bfba5-b771-4d80-8f15-56d95d88cf58 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:50.252852 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bfba5-b771-4d80-8f15-56d95d88cf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:50.270326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-113bfba5-b771-4d80-8f15-56d95d88cf58 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:50.271505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-113bfba5-b771-4d80-8f15-56d95d88cf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:50.335299 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 594/1179] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:42:50.358214 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7904a4b-a7f8-4be5-b143-8fe6be24bb12 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:50.406602 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:50.454479 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7904a4b-a7f8-4be5-b143-8fe6be24bb12 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:50.486940 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02245fa-7775-4049-9c93-4ebf0edb5f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:50.487567 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02245fa-7775-4049-9c93-4ebf0edb5f4d None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:50.487835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02245fa-7775-4049-9c93-4ebf0edb5f4d None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:50.488098 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02245fa-7775-4049-9c93-4ebf0edb5f4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:50.498795 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02245fa-7775-4049-9c93-4ebf0edb5f4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:42:50.503474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-b02245fa-7775-4049-9c93-4ebf0edb5f4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:42:50.503474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:50.503474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:50.503474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:50.503474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:50.503474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:50.503474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:50.503474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:50.503474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:50.503474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:50.503474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:50.503474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:50.503474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:42:50.503474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:42:50.503474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:42:50.503474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:42:50.504607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:42:50.504607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:42:50.504607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:42:50.504607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:42:50.504607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:50.504607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:50.504607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:50.504607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:50.504607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:50.504607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:50.504607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:50.504607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:50.504607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:50.504607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:50.504607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:50.504607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:50.505733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:50.505733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:50.505733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:50.505733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:50.505733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:42:50.505733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:42:50.505733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:42:50.505733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:42:50.505733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:42:50.505733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:42:50.505733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:42:50.505733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:42:50.505733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 586/1180] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:42:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:42:50.510788 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bfba5-b771-4d80-8f15-56d95d88cf58 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:50.606845 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bfba5-b771-4d80-8f15-56d95d88cf58 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:50.617005 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:50.639100 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d155cf-d699-48ff-8cae-f1be68553d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:50.639697 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d155cf-d699-48ff-8cae-f1be68553d05 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:50.639973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d155cf-d699-48ff-8cae-f1be68553d05 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:50.640243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d155cf-d699-48ff-8cae-f1be68553d05 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:50.640897 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d155cf-d699-48ff-8cae-f1be68553d05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:50.641195 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d155cf-d699-48ff-8cae-f1be68553d05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:50.642588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d155cf-d699-48ff-8cae-f1be68553d05 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:50.651668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 595/1181] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:42:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:50.657503 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02245fa-7775-4049-9c93-4ebf0edb5f4d None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:50.755612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02245fa-7775-4049-9c93-4ebf0edb5f4d None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:50.765371 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:50.788011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6af572-c640-4548-a8f5-eaea18990945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:50.788632 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6af572-c640-4548-a8f5-eaea18990945 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:50.788909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6af572-c640-4548-a8f5-eaea18990945 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:50.789220 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6af572-c640-4548-a8f5-eaea18990945 None admin] PATH_INFO: `/v3/users/229d08b37e07432cb429b393c8ab8696` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:50.802448 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6af572-c640-4548-a8f5-eaea18990945 None admin] RBAC: Authorizing `identity:get_user(user_id=229d08b37e07432cb429b393c8ab8696)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:50.803871 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6af572-c640-4548-a8f5-eaea18990945 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:50.805421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 587/1182] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:42:50 2022] GET /identity/v3/users/229d08b37e07432cb429b393c8ab8696 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:50.811113 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d155cf-d699-48ff-8cae-f1be68553d05 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:50.906682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d155cf-d699-48ff-8cae-f1be68553d05 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:50.937971 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6376bc4-4a1b-442c-afe9-51f8e02ff44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:50.938575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6376bc4-4a1b-442c-afe9-51f8e02ff44b None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:50.938846 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6376bc4-4a1b-442c-afe9-51f8e02ff44b None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:50.939109 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6376bc4-4a1b-442c-afe9-51f8e02ff44b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:50.979390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:51.004618 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6376bc4-4a1b-442c-afe9-51f8e02ff44b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:51.006127 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6376bc4-4a1b-442c-afe9-51f8e02ff44b None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:51.100939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 596/1183] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:42:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 09:42:51.106759 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6af572-c640-4548-a8f5-eaea18990945 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:51.202896 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6af572-c640-4548-a8f5-eaea18990945 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:51.235207 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ac213-81a5-48f3-b83d-731477c5606c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:51.235813 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ac213-81a5-48f3-b83d-731477c5606c None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:51.236087 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ac213-81a5-48f3-b83d-731477c5606c None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:51.236353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ac213-81a5-48f3-b83d-731477c5606c None admin] PATH_INFO: `/v3/projects/c3e5e351646649cdae56793878ddbd80` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:51.237953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ac213-81a5-48f3-b83d-731477c5606c None admin] RBAC: Authorizing `identity:get_project(project_id=c3e5e351646649cdae56793878ddbd80)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:51.239382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ac213-81a5-48f3-b83d-731477c5606c None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:51.240948 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 588/1184] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:42:51 2022] GET /identity/v3/projects/c3e5e351646649cdae56793878ddbd80 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:51.246882 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6376bc4-4a1b-442c-afe9-51f8e02ff44b None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:51.313613 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:51.341362 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6376bc4-4a1b-442c-afe9-51f8e02ff44b None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:51.374161 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af49a0-c649-41b2-b64b-cc7d763144d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:51.374744 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af49a0-c649-41b2-b64b-cc7d763144d5 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:51.375019 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af49a0-c649-41b2-b64b-cc7d763144d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:51.375284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af49a0-c649-41b2-b64b-cc7d763144d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:51.375985 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af49a0-c649-41b2-b64b-cc7d763144d5 None admin] RBAC: Adding query filter params (role.id=6aae1c66f3f04cec80ed72c20d7e033b, scope.project.id=c3e5e351646649cdae56793878ddbd80, user.id=229d08b37e07432cb429b393c8ab8696) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:51.376286 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af49a0-c649-41b2-b64b-cc7d763144d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:51.378295 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af49a0-c649-41b2-b64b-cc7d763144d5 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:51.383379 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 597/1185] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:42:51 2022] GET /identity/v3/role_assignments?user.id=229d08b37e07432cb429b393c8ab8696&scope.project.id=c3e5e351646649cdae56793878ddbd80&role.id=6aae1c66f3f04cec80ed72c20d7e033b => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:53.355515 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510d247-09a0-4087-9a6d-d3bec6a0abef None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:53.356045 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510d247-09a0-4087-9a6d-d3bec6a0abef None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:53.356045 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510d247-09a0-4087-9a6d-d3bec6a0abef None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:53.357350 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 589/1186] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:42:53.362537 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f7e7a-c0b2-47d5-8331-da53b7026640 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:53.362951 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f7e7a-c0b2-47d5-8331-da53b7026640 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:53.363077 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f7e7a-c0b2-47d5-8331-da53b7026640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:53.380526 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-216f7e7a-c0b2-47d5-8331-da53b7026640 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:53.381696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-216f7e7a-c0b2-47d5-8331-da53b7026640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:53.446651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 598/1187] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:42:53.468022 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510d247-09a0-4087-9a6d-d3bec6a0abef None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:53.503585 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:53.566580 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510d247-09a0-4087-9a6d-d3bec6a0abef None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:53.598429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02d083-c0c9-4810-befa-237e2bd47659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:53.599043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02d083-c0c9-4810-befa-237e2bd47659 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:53.599321 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02d083-c0c9-4810-befa-237e2bd47659 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:53.599588 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02d083-c0c9-4810-befa-237e2bd47659 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:53.609318 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02d083-c0c9-4810-befa-237e2bd47659 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:42:53.614413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-1f02d083-c0c9-4810-befa-237e2bd47659 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:42:53.614413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:53.614413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:53.614413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:53.614413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:53.614413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:53.614413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:53.614413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:53.614413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:53.614413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:53.614413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:53.614413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:53.614413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:42:53.614413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:42:53.614413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:42:53.614413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:42:53.615493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:42:53.615493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:42:53.615493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:42:53.615493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:42:53.615493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:53.615493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:53.615493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:53.615493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:53.615493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:53.615493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:53.615493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:53.615493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:53.615493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:53.615493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:53.615493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:53.615493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:53.616367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:53.616367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:53.616367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:53.616367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:53.616367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:42:53.616367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:42:53.616367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:42:53.616367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:42:53.616367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:42:53.616367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:42:53.616367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:42:53.616367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:42:53.616367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 590/1188] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:42:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:42:53.621479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f7e7a-c0b2-47d5-8331-da53b7026640 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:53.684319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:53.718676 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f7e7a-c0b2-47d5-8331-da53b7026640 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:53.752132 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d284a1-3a6b-43af-96c4-05265f25c6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:53.752728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d284a1-3a6b-43af-96c4-05265f25c6da None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:53.752999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d284a1-3a6b-43af-96c4-05265f25c6da None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:53.753267 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d284a1-3a6b-43af-96c4-05265f25c6da None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:53.753910 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d284a1-3a6b-43af-96c4-05265f25c6da None admin] RBAC: Adding query filter params (name=admin) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:53.754279 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d284a1-3a6b-43af-96c4-05265f25c6da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:53.755652 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d284a1-3a6b-43af-96c4-05265f25c6da None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:53.763435 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 599/1189] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:42:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:53.769414 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02d083-c0c9-4810-befa-237e2bd47659 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:53.859285 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:53.865461 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02d083-c0c9-4810-befa-237e2bd47659 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:53.897093 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149f32a-f39d-45d4-9134-fd72d65909ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:53.897696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149f32a-f39d-45d4-9134-fd72d65909ce None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:53.897969 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149f32a-f39d-45d4-9134-fd72d65909ce None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:53.898267 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149f32a-f39d-45d4-9134-fd72d65909ce None admin] PATH_INFO: `/v3/users/229d08b37e07432cb429b393c8ab8696` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:53.899353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149f32a-f39d-45d4-9134-fd72d65909ce None admin] RBAC: Authorizing `identity:get_user(user_id=229d08b37e07432cb429b393c8ab8696)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:53.900765 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149f32a-f39d-45d4-9134-fd72d65909ce None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:53.902318 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 591/1190] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:42:53 2022] GET /identity/v3/users/229d08b37e07432cb429b393c8ab8696 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:53.908133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d284a1-3a6b-43af-96c4-05265f25c6da None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:54.012383 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d284a1-3a6b-43af-96c4-05265f25c6da None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:54.037424 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:54.044845 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaaca30-50a8-4f77-a0d2-782ce242b744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:54.045529 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaaca30-50a8-4f77-a0d2-782ce242b744 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:54.049978 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaaca30-50a8-4f77-a0d2-782ce242b744 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:54.049978 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaaca30-50a8-4f77-a0d2-782ce242b744 None admin] PATH_INFO: `/v3/projects/c3e5e351646649cdae56793878ddbd80` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:54.049978 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaaca30-50a8-4f77-a0d2-782ce242b744 None admin] RBAC: Authorizing `identity:get_project(project_id=c3e5e351646649cdae56793878ddbd80)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:54.049978 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaaca30-50a8-4f77-a0d2-782ce242b744 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:54.050791 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 600/1191] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:42:53 2022] GET /identity/v3/projects/c3e5e351646649cdae56793878ddbd80 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:54.057761 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149f32a-f39d-45d4-9134-fd72d65909ce None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:54.155011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149f32a-f39d-45d4-9134-fd72d65909ce None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:54.188261 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca79d9-3982-4294-9b66-120398b63ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:54.188905 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca79d9-3982-4294-9b66-120398b63ed1 None admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:54.189181 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca79d9-3982-4294-9b66-120398b63ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:54.189450 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca79d9-3982-4294-9b66-120398b63ed1 None admin] PATH_INFO: `/v3/projects/c3e5e351646649cdae56793878ddbd80/users/229d08b37e07432cb429b393c8ab8696/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:54.191947 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca79d9-3982-4294-9b66-120398b63ed1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3e5e351646649cdae56793878ddbd80, user_id=229d08b37e07432cb429b393c8ab8696, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:54.193368 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca79d9-3982-4294-9b66-120398b63ed1 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:54.261085 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 592/1192] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Aug 11 09:42:54 2022] PUT /identity/v3/projects/c3e5e351646649cdae56793878ddbd80/users/229d08b37e07432cb429b393c8ab8696/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:42:56.254650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc406a49-0693-4612-bad2-e5ce4dfe397b None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:56.255222 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc406a49-0693-4612-bad2-e5ce4dfe397b None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:56.255222 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc406a49-0693-4612-bad2-e5ce4dfe397b None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:56.256510 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 601/1193] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:42:56.261594 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e49735-bfe3-4962-9e6c-f8ef3a9f6de0 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:56.261978 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e49735-bfe3-4962-9e6c-f8ef3a9f6de0 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:56.262150 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e49735-bfe3-4962-9e6c-f8ef3a9f6de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:56.279427 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-23e49735-bfe3-4962-9e6c-f8ef3a9f6de0 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:42:56.280584 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-23e49735-bfe3-4962-9e6c-f8ef3a9f6de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:42:56.297464 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:56.345510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 593/1194] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:42:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:42:56.368728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc406a49-0693-4612-bad2-e5ce4dfe397b None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:56.466395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc406a49-0693-4612-bad2-e5ce4dfe397b None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:56.498929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421dea63-6123-4df8-a9a4-ffd4a775dd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:56.499530 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dea63-6123-4df8-a9a4-ffd4a775dd8f None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:56.499805 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dea63-6123-4df8-a9a4-ffd4a775dd8f None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:56.500098 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dea63-6123-4df8-a9a4-ffd4a775dd8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:56.510300 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421dea63-6123-4df8-a9a4-ffd4a775dd8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:42:56.514770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-421dea63-6123-4df8-a9a4-ffd4a775dd8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:42:56.514770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:42:56.514770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:42:56.514770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:42:56.514770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:42:56.514770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:42:56.514770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:42:56.514770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:42:56.514770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:42:56.514770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:42:56.514770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:42:56.514770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:42:56.514770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:42:56.514770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:42:56.514770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:42:56.514770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:42:56.515959 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:42:56.515959 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:42:56.515959 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:42:56.515959 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:42:56.515959 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:42:56.515959 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:42:56.515959 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:42:56.515959 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:42:56.515959 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:42:56.515959 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:42:56.515959 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:42:56.515959 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:42:56.515959 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:42:56.515959 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:42:56.515959 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:42:56.515959 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:42:56.516883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:42:56.516883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:42:56.516883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:42:56.516883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:42:56.516883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:42:56.516883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:42:56.516883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:42:56.516883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:42:56.516883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:42:56.516883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:42:56.516883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:42:56.516883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:42:56.516883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 602/1195] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:42:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:42:56.521819 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e49735-bfe3-4962-9e6c-f8ef3a9f6de0 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:56.615491 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e49735-bfe3-4962-9e6c-f8ef3a9f6de0 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:56.647714 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae906e-94c2-4b9b-9358-a39d84349a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:56.648302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae906e-94c2-4b9b-9358-a39d84349a72 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:56.648575 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae906e-94c2-4b9b-9358-a39d84349a72 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:56.648840 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae906e-94c2-4b9b-9358-a39d84349a72 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:56.649481 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae906e-94c2-4b9b-9358-a39d84349a72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:56.649774 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae906e-94c2-4b9b-9358-a39d84349a72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:56.651165 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae906e-94c2-4b9b-9358-a39d84349a72 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:56.659470 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 594/1196] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:42:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:56.665094 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421dea63-6123-4df8-a9a4-ffd4a775dd8f None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:56.719637 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:56.763103 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421dea63-6123-4df8-a9a4-ffd4a775dd8f None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:56.795616 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba82d6-c2ba-4af0-aa2f-e2ec4d7242df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:56.796227 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba82d6-c2ba-4af0-aa2f-e2ec4d7242df None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:56.796505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba82d6-c2ba-4af0-aa2f-e2ec4d7242df None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:56.796776 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba82d6-c2ba-4af0-aa2f-e2ec4d7242df None admin] PATH_INFO: `/v3/users/229d08b37e07432cb429b393c8ab8696` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:56.797874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba82d6-c2ba-4af0-aa2f-e2ec4d7242df None admin] RBAC: Authorizing `identity:get_user(user_id=229d08b37e07432cb429b393c8ab8696)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:56.799336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba82d6-c2ba-4af0-aa2f-e2ec4d7242df None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:56.800887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 603/1197] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Aug 11 09:42:56 2022] GET /identity/v3/users/229d08b37e07432cb429b393c8ab8696 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:56.806934 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae906e-94c2-4b9b-9358-a39d84349a72 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:56.825858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:56.904298 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae906e-94c2-4b9b-9358-a39d84349a72 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:56.936173 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be4698-a5a8-47d1-bac6-76578e256b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:56.936763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be4698-a5a8-47d1-bac6-76578e256b27 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:56.937034 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be4698-a5a8-47d1-bac6-76578e256b27 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:56.937297 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be4698-a5a8-47d1-bac6-76578e256b27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:57.000461 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be4698-a5a8-47d1-bac6-76578e256b27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:57.001882 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be4698-a5a8-47d1-bac6-76578e256b27 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:57.018634 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:57.095237 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 595/1198] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:42:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 09:42:57.101061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba82d6-c2ba-4af0-aa2f-e2ec4d7242df None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:57.197011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba82d6-c2ba-4af0-aa2f-e2ec4d7242df None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:57.218786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:57.228927 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953dfee1-df06-4ef6-a1cc-de38bf273e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:57.233988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dfee1-df06-4ef6-a1cc-de38bf273e13 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:57.233988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dfee1-df06-4ef6-a1cc-de38bf273e13 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:57.233988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dfee1-df06-4ef6-a1cc-de38bf273e13 None admin] PATH_INFO: `/v3/projects/c3e5e351646649cdae56793878ddbd80` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:57.233988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953dfee1-df06-4ef6-a1cc-de38bf273e13 None admin] RBAC: Authorizing `identity:get_project(project_id=c3e5e351646649cdae56793878ddbd80)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:57.233988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953dfee1-df06-4ef6-a1cc-de38bf273e13 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:57.234763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 604/1199] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Aug 11 09:42:57 2022] GET /identity/v3/projects/c3e5e351646649cdae56793878ddbd80 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:42:57.241279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be4698-a5a8-47d1-bac6-76578e256b27 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:42:57.339634 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be4698-a5a8-47d1-bac6-76578e256b27 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:42:57.355058 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:42:57.372195 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fefed-5965-4cca-903d-910840b9ad4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:42:57.372786 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fefed-5965-4cca-903d-910840b9ad4d None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:42:57.373057 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fefed-5965-4cca-903d-910840b9ad4d None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:42:57.373321 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fefed-5965-4cca-903d-910840b9ad4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:42:57.374025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fefed-5965-4cca-903d-910840b9ad4d None admin] RBAC: Adding query filter params (role.id=6aae1c66f3f04cec80ed72c20d7e033b, scope.project.id=c3e5e351646649cdae56793878ddbd80, user.id=229d08b37e07432cb429b393c8ab8696) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:42:57.374357 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fefed-5965-4cca-903d-910840b9ad4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:42:57.375760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fefed-5965-4cca-903d-910840b9ad4d None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:42:57.381794 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 596/1200] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:42:57 2022] GET /identity/v3/role_assignments?user.id=229d08b37e07432cb429b393c8ab8696&scope.project.id=c3e5e351646649cdae56793878ddbd80&role.id=6aae1c66f3f04cec80ed72c20d7e033b => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:43:07.252438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=4 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:43:07.393095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=10 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:09.885434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8109e35-ac8b-4de0-8d14-f829a867f62a None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:09.886017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8109e35-ac8b-4de0-8d14-f829a867f62a None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:09.886017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8109e35-ac8b-4de0-8d14-f829a867f62a None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:09.887324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 605/1201] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:44:09.892386 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8ae44-0030-45ef-b956-2d4543fc7fbb None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:09.892835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8ae44-0030-45ef-b956-2d4543fc7fbb None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:09.892936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8ae44-0030-45ef-b956-2d4543fc7fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:09.913161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-1fc8ae44-0030-45ef-b956-2d4543fc7fbb None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:44:09.913161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-1fc8ae44-0030-45ef-b956-2d4543fc7fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:44:09.976562 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 597/1202] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:44:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:44:10.001735 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8109e35-ac8b-4de0-8d14-f829a867f62a None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:10.101823 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8109e35-ac8b-4de0-8d14-f829a867f62a None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:10.135205 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85d50e-d006-42b1-a4e5-b3d6d138794c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:10.135822 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85d50e-d006-42b1-a4e5-b3d6d138794c None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:10.136097 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85d50e-d006-42b1-a4e5-b3d6d138794c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:10.136365 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85d50e-d006-42b1-a4e5-b3d6d138794c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:10.146167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85d50e-d006-42b1-a4e5-b3d6d138794c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:10.147583 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85d50e-d006-42b1-a4e5-b3d6d138794c None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:10.162124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-2e85d50e-d006-42b1-a4e5-b3d6d138794c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:10.162124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:10.162124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:10.162124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:10.162124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:10.162124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:10.162124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:10.162124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:10.162124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:10.162124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:10.162124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:10.162124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:10.162124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:44:10.162124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:44:10.162124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:44:10.162124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:44:10.163375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:10.163375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:10.163375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:10.163375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:10.163375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:10.163375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:10.163375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:10.163375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:10.163375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:10.163375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:10.163375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:10.163375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:10.163375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:10.163375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:10.163375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:10.163375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:10.163375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:44:10.164619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:44:10.164619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:10.164619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:44:10.164619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 606/1203] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:10.169189 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8ae44-0030-45ef-b956-2d4543fc7fbb None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:10.267871 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8ae44-0030-45ef-b956-2d4543fc7fbb None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:10.307179 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:10.312699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31d859-27f5-4606-9ed0-88798454da05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:10.316763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31d859-27f5-4606-9ed0-88798454da05 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:10.316763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31d859-27f5-4606-9ed0-88798454da05 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:10.316763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31d859-27f5-4606-9ed0-88798454da05 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:10.316763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31d859-27f5-4606-9ed0-88798454da05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:10.316763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31d859-27f5-4606-9ed0-88798454da05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:10.316763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31d859-27f5-4606-9ed0-88798454da05 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:10.326877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 598/1204] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:10.332710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85d50e-d006-42b1-a4e5-b3d6d138794c None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:10.384320 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:10.430410 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85d50e-d006-42b1-a4e5-b3d6d138794c None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:10.462918 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84300efd-1e66-4d85-a454-fd67475e9370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:10.463509 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84300efd-1e66-4d85-a454-fd67475e9370 None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:10.463782 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84300efd-1e66-4d85-a454-fd67475e9370 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:10.464071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84300efd-1e66-4d85-a454-fd67475e9370 None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:10.464700 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84300efd-1e66-4d85-a454-fd67475e9370 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:10.466180 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84300efd-1e66-4d85-a454-fd67475e9370 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:10.570476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 607/1205] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Aug 11 09:44:10 2022] POST /identity/v3/users => generated 251 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:44:12.570063 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b5698-148e-4faa-aeb1-c2ccb2095d9b None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:12.570651 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b5698-148e-4faa-aeb1-c2ccb2095d9b None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:12.570651 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b5698-148e-4faa-aeb1-c2ccb2095d9b None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:12.571982 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 599/1206] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:44:12.577144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2df55-5f20-4028-a7c7-b5eeca86c825 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:12.577534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2df55-5f20-4028-a7c7-b5eeca86c825 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:12.577696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2df55-5f20-4028-a7c7-b5eeca86c825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:12.596035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-37e2df55-5f20-4028-a7c7-b5eeca86c825 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:44:12.597223 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-37e2df55-5f20-4028-a7c7-b5eeca86c825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:44:12.662605 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 608/1207] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:44:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:44:12.685744 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b5698-148e-4faa-aeb1-c2ccb2095d9b None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:12.786276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b5698-148e-4faa-aeb1-c2ccb2095d9b None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:12.819300 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b9674-fdde-402f-95ae-e3268c6d040d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:12.819905 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b9674-fdde-402f-95ae-e3268c6d040d None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:12.820226 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b9674-fdde-402f-95ae-e3268c6d040d None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:12.820439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b9674-fdde-402f-95ae-e3268c6d040d None admin] PATH_INFO: `/v3/roles/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:12.830617 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b9674-fdde-402f-95ae-e3268c6d040d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:44:12.836949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-480b9674-fdde-402f-95ae-e3268c6d040d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:44:12.836949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:12.836949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:12.836949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:12.836949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:12.836949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:12.836949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:12.836949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:12.836949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:12.836949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:12.836949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:12.836949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:12.836949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:44:12.836949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:44:12.836949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:44:12.836949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:44:12.837992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:44:12.837992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:44:12.837992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:44:12.837992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:44:12.837992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:12.837992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:12.837992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:12.837992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:12.837992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:12.837992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:12.837992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:12.837992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:12.837992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:12.837992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:12.837992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:12.837992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:12.838933 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:12.838933 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:12.838933 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:12.838933 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:12.838933 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:44:12.838933 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:44:12.838933 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:44:12.838933 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:44:12.838933 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:44:12.838933 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:44:12.838933 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:44:12.838933 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:44:12.838933 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 600/1208] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Aug 11 09:44:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:12.842658 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2df55-5f20-4028-a7c7-b5eeca86c825 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:12.881609 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:12.939760 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2df55-5f20-4028-a7c7-b5eeca86c825 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:12.971696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc86e9d-5e2a-4cc3-a379-219320d2b7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:12.972290 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc86e9d-5e2a-4cc3-a379-219320d2b7df None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:12.972566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc86e9d-5e2a-4cc3-a379-219320d2b7df None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:12.972831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc86e9d-5e2a-4cc3-a379-219320d2b7df None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:12.973483 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc86e9d-5e2a-4cc3-a379-219320d2b7df None admin] RBAC: Adding query filter params (name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:12.973781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc86e9d-5e2a-4cc3-a379-219320d2b7df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:12.975185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc86e9d-5e2a-4cc3-a379-219320d2b7df None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:12.982698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 609/1209] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Aug 11 09:44:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:12.988958 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b9674-fdde-402f-95ae-e3268c6d040d None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:13.037410 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:13.085865 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b9674-fdde-402f-95ae-e3268c6d040d None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:13.118640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aeb8de-0f0c-4872-b640-9110734514da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:13.119264 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aeb8de-0f0c-4872-b640-9110734514da None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:13.119543 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aeb8de-0f0c-4872-b640-9110734514da None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:13.119814 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aeb8de-0f0c-4872-b640-9110734514da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:13.130882 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aeb8de-0f0c-4872-b640-9110734514da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:13.132314 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aeb8de-0f0c-4872-b640-9110734514da None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:13.145841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-e8aeb8de-0f0c-4872-b640-9110734514da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:13.145841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:13.145841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:13.145841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:13.145841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:13.145841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:13.145841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:13.145841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:13.145841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:13.145841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:13.145841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:13.145841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:13.145841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:44:13.145841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:44:13.145841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:44:13.145841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:44:13.146855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:13.146855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:13.146855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:13.146855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:13.146855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:13.146855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:13.146855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:13.146855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:13.146855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:13.146855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:13.146855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:13.146855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:13.146855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:13.146855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:13.146855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:13.146855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:13.146855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:44:13.147792 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:44:13.147792 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:13.147792 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:44:13.147792 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 601/1210] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:13.152815 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc86e9d-5e2a-4cc3-a379-219320d2b7df None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:13.247613 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:13.250500 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc86e9d-5e2a-4cc3-a379-219320d2b7df None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:13.283196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3a508-9d96-4b01-a9ed-0e12d2a071f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:13.283795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3a508-9d96-4b01-a9ed-0e12d2a071f8 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:13.284069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3a508-9d96-4b01-a9ed-0e12d2a071f8 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:13.284337 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3a508-9d96-4b01-a9ed-0e12d2a071f8 None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:13.284983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3a508-9d96-4b01-a9ed-0e12d2a071f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:13.285266 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3a508-9d96-4b01-a9ed-0e12d2a071f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:13.286650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3a508-9d96-4b01-a9ed-0e12d2a071f8 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:13.297274 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 610/1211] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:13.304042 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aeb8de-0f0c-4872-b640-9110734514da None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:13.400500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aeb8de-0f0c-4872-b640-9110734514da None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:13.401911 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:13.433952 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2deac2c-c91d-4a37-8554-14bd410a4e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:13.434672 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2deac2c-c91d-4a37-8554-14bd410a4e86 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:13.435011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2deac2c-c91d-4a37-8554-14bd410a4e86 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:13.435361 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2deac2c-c91d-4a37-8554-14bd410a4e86 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:13.442831 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2deac2c-c91d-4a37-8554-14bd410a4e86 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:13.444255 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2deac2c-c91d-4a37-8554-14bd410a4e86 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:13.455306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-e2deac2c-c91d-4a37-8554-14bd410a4e86 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 11 09:44:13.455306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:13.455306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:13.455306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:13.455306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:13.455306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:13.455306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:13.455306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:13.455306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:13.455306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:13.455306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:13.455306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:13.455306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:44:13.455306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:44:13.455306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:44:13.455306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:44:13.456477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:13.456477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:13.456477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:44:13.456477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:44:13.456477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:44:13.456477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:44:13.456477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:13.456477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:13.456477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:13.456477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:13.456477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:13.456477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:13.456477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:13.456477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:13.456477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:13.456477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:13.456477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:13.456477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:13.457800 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:13.457800 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:13.457800 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:44:13.457800 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:44:13.457800 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:44:13.457800 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:44:13.457800 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:44:13.457800 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:44:13.457800 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 11 09:44:13.457800 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:44:13.457800 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 602/1212] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:44:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:13.462305 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3a508-9d96-4b01-a9ed-0e12d2a071f8 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:13.561428 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3a508-9d96-4b01-a9ed-0e12d2a071f8 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:13.593654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4005c-caed-465e-9727-6ca20657e88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:13.594272 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4005c-caed-465e-9727-6ca20657e88f None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:13.595167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4005c-caed-465e-9727-6ca20657e88f None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:13.595440 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4005c-caed-465e-9727-6ca20657e88f None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:13.596151 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4005c-caed-465e-9727-6ca20657e88f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:13.596453 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4005c-caed-465e-9727-6ca20657e88f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:13.597860 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4005c-caed-465e-9727-6ca20657e88f None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:13.614403 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 611/1213] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Aug 11 09:44:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:13.620278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2deac2c-c91d-4a37-8554-14bd410a4e86 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:13.717507 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2deac2c-c91d-4a37-8554-14bd410a4e86 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:13.749873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89533264-a2f7-4e15-b13a-30665093b7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:13.750489 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89533264-a2f7-4e15-b13a-30665093b7b9 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:13.750787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89533264-a2f7-4e15-b13a-30665093b7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:13.751057 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89533264-a2f7-4e15-b13a-30665093b7b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:13.780094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:13.816840 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89533264-a2f7-4e15-b13a-30665093b7b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:13.818351 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89533264-a2f7-4e15-b13a-30665093b7b9 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:13.915028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 603/1214] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:44:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 09:44:13.920960 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4005c-caed-465e-9727-6ca20657e88f None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:13.941294 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:14.021613 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4005c-caed-465e-9727-6ca20657e88f None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:14.054512 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f487ba9-112d-44c6-85ea-2b4673f04193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:14.055124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f487ba9-112d-44c6-85ea-2b4673f04193 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:14.055394 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f487ba9-112d-44c6-85ea-2b4673f04193 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:14.055656 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f487ba9-112d-44c6-85ea-2b4673f04193 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:14.065720 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f487ba9-112d-44c6-85ea-2b4673f04193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:14.067200 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f487ba9-112d-44c6-85ea-2b4673f04193 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:14.081485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-2f487ba9-112d-44c6-85ea-2b4673f04193 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:14.081485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:14.081485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:14.081485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:14.081485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:14.081485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:14.081485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:14.081485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:14.081485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:14.081485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:14.081485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:14.081485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:14.081485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:44:14.081485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:44:14.081485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:44:14.081485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:44:14.082566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:14.082566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:14.082566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:14.082566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:14.082566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:14.082566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:14.082566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:14.082566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:14.082566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:14.082566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:14.082566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:14.082566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:14.082566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:14.082566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:14.082566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:14.082566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:14.082566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:44:14.083509 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:44:14.083509 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:14.083509 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:44:14.083509 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 612/1215] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:44:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:44:14.088331 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89533264-a2f7-4e15-b13a-30665093b7b9 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:14.148528 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:14.184807 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89533264-a2f7-4e15-b13a-30665093b7b9 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:14.217816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e2a98-b2a0-4c65-b4b6-e7f282de56d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:14.218448 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e2a98-b2a0-4c65-b4b6-e7f282de56d1 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:14.218723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e2a98-b2a0-4c65-b4b6-e7f282de56d1 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:14.218991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e2a98-b2a0-4c65-b4b6-e7f282de56d1 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:14.219620 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e2a98-b2a0-4c65-b4b6-e7f282de56d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:14.219918 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e2a98-b2a0-4c65-b4b6-e7f282de56d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:14.221288 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e2a98-b2a0-4c65-b4b6-e7f282de56d1 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:14.232741 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 604/1216] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:14.238928 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f487ba9-112d-44c6-85ea-2b4673f04193 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:14.312817 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:14.345469 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f487ba9-112d-44c6-85ea-2b4673f04193 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:14.378559 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29f634-6a85-4644-aa54-f5893684caaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:14.379202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29f634-6a85-4644-aa54-f5893684caaf None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:14.379477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29f634-6a85-4644-aa54-f5893684caaf None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:14.379746 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29f634-6a85-4644-aa54-f5893684caaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:14.386256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29f634-6a85-4644-aa54-f5893684caaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:14.387683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29f634-6a85-4644-aa54-f5893684caaf None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:14.398612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-df29f634-6a85-4644-aa54-f5893684caaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:44:14.398612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:14.398612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:14.398612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:14.398612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:14.398612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:14.398612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:14.398612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:14.398612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:14.398612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:14.398612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:14.398612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:14.398612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:44:14.398612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:44:14.398612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:44:14.399721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:44:14.399721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:14.399721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:14.399721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:14.399721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:14.399721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:14.399721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:14.399721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:14.399721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:14.399721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:14.399721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:14.399721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:14.399721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:14.399721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:14.399721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:14.399721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:14.399721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:14.400986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:44:14.400986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:44:14.400986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:44:14.400986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:44:14.400986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:44:14.400986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:44:14.400986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:44:14.400986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:44:14.400986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 613/1217] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:44:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:14.405578 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e2a98-b2a0-4c65-b4b6-e7f282de56d1 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:14.503141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e2a98-b2a0-4c65-b4b6-e7f282de56d1 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:14.526034 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:14.537433 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af7272-bb17-4751-8948-25e1e348dc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:14.538033 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af7272-bb17-4751-8948-25e1e348dc2c None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:14.538338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af7272-bb17-4751-8948-25e1e348dc2c None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:14.538604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af7272-bb17-4751-8948-25e1e348dc2c None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:14.539274 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af7272-bb17-4751-8948-25e1e348dc2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:14.539570 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af7272-bb17-4751-8948-25e1e348dc2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:14.541077 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af7272-bb17-4751-8948-25e1e348dc2c None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:14.553363 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 605/1218] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:44:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:14.559476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29f634-6a85-4644-aa54-f5893684caaf None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:14.658029 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29f634-6a85-4644-aa54-f5893684caaf None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:14.685929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:14.691610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4242243-da66-4661-93e4-17521828bd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:14.692197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4242243-da66-4661-93e4-17521828bd4a None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:14.692466 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4242243-da66-4661-93e4-17521828bd4a None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:14.692727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4242243-da66-4661-93e4-17521828bd4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:14.693422 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4242243-da66-4661-93e4-17521828bd4a None admin] RBAC: Adding query filter params (role.id=b8d32893edf5475791d4c3b9aea5a3f6, scope.project.id=a0211f5c0b174c8c998e3ad29f96baab, user.id=0061ce46df224f4491599ed10548b2ae) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:14.693721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4242243-da66-4661-93e4-17521828bd4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:14.695234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4242243-da66-4661-93e4-17521828bd4a None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:14.700373 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 614/1219] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:44:14 2022] GET /identity/v3/role_assignments?user.id=0061ce46df224f4491599ed10548b2ae&scope.project.id=a0211f5c0b174c8c998e3ad29f96baab&role.id=b8d32893edf5475791d4c3b9aea5a3f6 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:16.675989 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505006b-3e27-4444-b948-4c7eb0c3bda0 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:16.676449 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505006b-3e27-4444-b948-4c7eb0c3bda0 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:16.676540 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505006b-3e27-4444-b948-4c7eb0c3bda0 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:16.677939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 606/1220] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:44:16.683247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6cf80-864e-46d5-bde2-f85c84afa88d None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:16.683673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6cf80-864e-46d5-bde2-f85c84afa88d None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:16.683846 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6cf80-864e-46d5-bde2-f85c84afa88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:16.701768 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-4ea6cf80-864e-46d5-bde2-f85c84afa88d None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:44:16.702975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-4ea6cf80-864e-46d5-bde2-f85c84afa88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:44:16.766308 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 615/1221] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:44:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:44:16.788957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505006b-3e27-4444-b948-4c7eb0c3bda0 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:16.888603 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505006b-3e27-4444-b948-4c7eb0c3bda0 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:16.921233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51ff68-7400-40f6-a4ce-77c60b901e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:16.921787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51ff68-7400-40f6-a4ce-77c60b901e3f None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:16.922058 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51ff68-7400-40f6-a4ce-77c60b901e3f None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:16.922353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51ff68-7400-40f6-a4ce-77c60b901e3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:16.932353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51ff68-7400-40f6-a4ce-77c60b901e3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:44:16.936923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-ec51ff68-7400-40f6-a4ce-77c60b901e3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:44:16.936923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:16.936923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:16.936923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:16.936923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:16.936923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:16.936923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:16.936923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:16.936923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:16.936923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:16.936923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:16.936923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:16.936923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:44:16.936923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:44:16.936923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:44:16.936923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:44:16.938048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:44:16.938048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:44:16.938048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:44:16.938048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:44:16.938048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:16.938048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:16.938048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:16.938048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:16.938048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:16.938048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:16.938048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:16.938048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:16.938048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:16.938048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:16.938048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:16.938048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:16.939811 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:16.939811 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:16.939811 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:16.939811 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:16.939811 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:44:16.939811 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:44:16.939811 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:44:16.939811 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:44:16.939811 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:44:16.939811 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:44:16.939811 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:44:16.939811 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:44:16.939811 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 607/1222] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Aug 11 09:44:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:16.944463 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6cf80-864e-46d5-bde2-f85c84afa88d None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:17.038674 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6cf80-864e-46d5-bde2-f85c84afa88d None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:17.060817 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:17.073556 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f445033-fe5c-47c9-a6e4-56c26722ee14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:17.074188 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f445033-fe5c-47c9-a6e4-56c26722ee14 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:17.076673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f445033-fe5c-47c9-a6e4-56c26722ee14 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:17.076673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f445033-fe5c-47c9-a6e4-56c26722ee14 None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:17.076673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f445033-fe5c-47c9-a6e4-56c26722ee14 None admin] RBAC: Adding query filter params (name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:17.076673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f445033-fe5c-47c9-a6e4-56c26722ee14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:17.077031 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f445033-fe5c-47c9-a6e4-56c26722ee14 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:17.088156 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 616/1223] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Aug 11 09:44:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:17.091424 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51ff68-7400-40f6-a4ce-77c60b901e3f None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:17.134041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:17.189246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51ff68-7400-40f6-a4ce-77c60b901e3f None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:17.223318 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b01cf-2c0b-4e96-8557-15d7c9702f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:17.223976 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b01cf-2c0b-4e96-8557-15d7c9702f0f None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:17.224247 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b01cf-2c0b-4e96-8557-15d7c9702f0f None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:17.224515 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b01cf-2c0b-4e96-8557-15d7c9702f0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:17.234285 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b01cf-2c0b-4e96-8557-15d7c9702f0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:17.236317 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b01cf-2c0b-4e96-8557-15d7c9702f0f None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:17.250332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-ec1b01cf-2c0b-4e96-8557-15d7c9702f0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:17.250332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:17.250332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:17.250332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:17.250332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:17.250332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:17.250332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:17.250332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:17.250332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:17.250332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:17.250332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:17.250332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:17.250332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:44:17.250332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:44:17.250332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:44:17.250332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:44:17.252028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:17.252028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:17.252028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:17.252028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:17.252028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:17.252028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:17.252028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:17.252028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:17.252028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:17.252028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:17.252028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:17.252028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:17.252028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:17.252028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:17.252028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:17.252028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:17.252028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:44:17.252964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:44:17.252964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:17.252964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:44:17.252964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 608/1224] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:44:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:17.257834 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f445033-fe5c-47c9-a6e4-56c26722ee14 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:17.354910 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f445033-fe5c-47c9-a6e4-56c26722ee14 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:17.388045 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e74da6-3dd7-4060-bc25-5f3768a9cc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:17.388637 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e74da6-3dd7-4060-bc25-5f3768a9cc0a None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:17.388908 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e74da6-3dd7-4060-bc25-5f3768a9cc0a None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:17.389174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e74da6-3dd7-4060-bc25-5f3768a9cc0a None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:17.389794 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e74da6-3dd7-4060-bc25-5f3768a9cc0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:17.390113 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e74da6-3dd7-4060-bc25-5f3768a9cc0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:17.391468 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e74da6-3dd7-4060-bc25-5f3768a9cc0a None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:17.402754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 617/1225] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:17.408482 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b01cf-2c0b-4e96-8557-15d7c9702f0f None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:17.502911 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:17.509326 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b01cf-2c0b-4e96-8557-15d7c9702f0f None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:17.541727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bff74f-334f-4f6d-af2d-75d016ee2b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:17.542366 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bff74f-334f-4f6d-af2d-75d016ee2b9c None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:17.542639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bff74f-334f-4f6d-af2d-75d016ee2b9c None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:17.542903 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bff74f-334f-4f6d-af2d-75d016ee2b9c None admin] PATH_INFO: `/v3/users/placement` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:17.551073 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bff74f-334f-4f6d-af2d-75d016ee2b9c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:17.552871 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bff74f-334f-4f6d-af2d-75d016ee2b9c None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:17.564271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-18bff74f-334f-4f6d-af2d-75d016ee2b9c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 11 09:44:17.564271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:17.564271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:17.564271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:17.564271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:17.564271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:17.564271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:17.564271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:17.564271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:17.564271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:17.564271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:17.564271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:17.564271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:44:17.564271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:44:17.564271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:44:17.564271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:44:17.565405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:17.565405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:17.565405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:44:17.565405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:44:17.565405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:44:17.565405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:44:17.565405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:17.565405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:17.565405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:17.565405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:17.565405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:17.565405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:17.565405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:17.565405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:17.565405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:17.565405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:17.565405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:17.565405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:17.566639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:17.566639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:17.566639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:44:17.566639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:44:17.566639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:44:17.566639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:44:17.566639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:44:17.566639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:44:17.566639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 11 09:44:17.566639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:44:17.566639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 609/1226] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:44:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:17.571340 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e74da6-3dd7-4060-bc25-5f3768a9cc0a None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:17.618791 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:17.669859 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e74da6-3dd7-4060-bc25-5f3768a9cc0a None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:17.702694 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7df8db-7418-49e8-97b4-82147ffc6db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:17.703293 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7df8db-7418-49e8-97b4-82147ffc6db7 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:17.703569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7df8db-7418-49e8-97b4-82147ffc6db7 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:17.703840 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7df8db-7418-49e8-97b4-82147ffc6db7 None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:17.704550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7df8db-7418-49e8-97b4-82147ffc6db7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:17.704854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7df8db-7418-49e8-97b4-82147ffc6db7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:17.706291 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7df8db-7418-49e8-97b4-82147ffc6db7 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:17.725032 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 618/1227] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Aug 11 09:44:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:17.731158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bff74f-334f-4f6d-af2d-75d016ee2b9c None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:17.829451 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bff74f-334f-4f6d-af2d-75d016ee2b9c None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:17.862199 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6ddfc-3a21-469f-97ca-67a493b9895c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:17.862807 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6ddfc-3a21-469f-97ca-67a493b9895c None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:17.863077 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6ddfc-3a21-469f-97ca-67a493b9895c None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:17.863336 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6ddfc-3a21-469f-97ca-67a493b9895c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:17.873445 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb6ddfc-3a21-469f-97ca-67a493b9895c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:17.877596 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb6ddfc-3a21-469f-97ca-67a493b9895c None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:17.888350 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-4cb6ddfc-3a21-469f-97ca-67a493b9895c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:17.888350 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:17.888350 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:17.888350 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:17.888350 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:17.888350 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:17.888350 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:17.888350 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:17.888350 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:17.888350 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:17.888350 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:17.888350 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:17.888350 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:44:17.888350 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:44:17.888350 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:44:17.888350 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:44:17.889435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:17.889435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:17.889435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:17.889435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:17.889435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:17.889435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:17.889435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:17.889435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:17.889435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:17.889435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:17.889435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:17.889435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:17.889435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:17.889435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:17.889435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:17.889435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:17.889435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:44:17.890621 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:44:17.890621 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:17.890621 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:44:17.890621 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 610/1228] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:44:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:17.895256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7df8db-7418-49e8-97b4-82147ffc6db7 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:17.991806 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7df8db-7418-49e8-97b4-82147ffc6db7 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:17.994118 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:18.024536 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb0b53-f90d-4e4f-b8c1-f1091dbae734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:18.025131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb0b53-f90d-4e4f-b8c1-f1091dbae734 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:18.025406 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb0b53-f90d-4e4f-b8c1-f1091dbae734 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:18.025671 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb0b53-f90d-4e4f-b8c1-f1091dbae734 None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:18.026330 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb0b53-f90d-4e4f-b8c1-f1091dbae734 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:18.026626 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb0b53-f90d-4e4f-b8c1-f1091dbae734 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:18.027972 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb0b53-f90d-4e4f-b8c1-f1091dbae734 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:18.039324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 619/1229] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:18.044998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6ddfc-3a21-469f-97ca-67a493b9895c None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:18.054447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:18.141344 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6ddfc-3a21-469f-97ca-67a493b9895c None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:18.175692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ffb234-7a79-40a5-9e20-26a020d0bede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:18.176307 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffb234-7a79-40a5-9e20-26a020d0bede None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:18.176583 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffb234-7a79-40a5-9e20-26a020d0bede None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:18.176851 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffb234-7a79-40a5-9e20-26a020d0bede None admin] PATH_INFO: `/v3/projects/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:18.183269 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ffb234-7a79-40a5-9e20-26a020d0bede None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:18.184743 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ffb234-7a79-40a5-9e20-26a020d0bede None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:18.195587 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-57ffb234-7a79-40a5-9e20-26a020d0bede None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:44:18.195587 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:18.195587 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:18.195587 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:18.195587 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:18.195587 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:18.195587 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:18.195587 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:18.195587 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:18.195587 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:18.195587 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:18.195587 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:18.195587 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:44:18.195587 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:44:18.195587 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:44:18.196629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:44:18.196629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:18.196629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:18.196629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:18.196629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:18.196629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:18.196629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:18.196629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:18.196629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:18.196629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:18.196629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:18.196629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:18.196629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:18.196629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:18.196629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:18.196629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:18.196629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:18.197867 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:44:18.197867 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:44:18.197867 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:44:18.197867 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:44:18.197867 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:44:18.197867 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:44:18.197867 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:44:18.197867 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:44:18.197867 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 611/1230] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:44:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:18.202542 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb0b53-f90d-4e4f-b8c1-f1091dbae734 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:18.300452 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb0b53-f90d-4e4f-b8c1-f1091dbae734 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:18.336244 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db022a5-daa0-4348-bfa7-a6936f08b607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:18.336847 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db022a5-daa0-4348-bfa7-a6936f08b607 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:18.337124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db022a5-daa0-4348-bfa7-a6936f08b607 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:18.337457 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db022a5-daa0-4348-bfa7-a6936f08b607 None admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:18.338184 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db022a5-daa0-4348-bfa7-a6936f08b607 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:18.338492 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db022a5-daa0-4348-bfa7-a6936f08b607 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:18.339902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db022a5-daa0-4348-bfa7-a6936f08b607 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:18.351805 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 620/1231] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:44:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:18.357782 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ffb234-7a79-40a5-9e20-26a020d0bede None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:18.422165 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:18.456521 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ffb234-7a79-40a5-9e20-26a020d0bede None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:18.490000 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12703303-8d07-45af-8b73-5189213c3c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:18.490702 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12703303-8d07-45af-8b73-5189213c3c56 None admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:18.490976 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12703303-8d07-45af-8b73-5189213c3c56 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:18.491279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12703303-8d07-45af-8b73-5189213c3c56 None admin] PATH_INFO: `/v3/projects/a0211f5c0b174c8c998e3ad29f96baab/users/0061ce46df224f4491599ed10548b2ae/roles/b8d32893edf5475791d4c3b9aea5a3f6` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:18.505406 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12703303-8d07-45af-8b73-5189213c3c56 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0211f5c0b174c8c998e3ad29f96baab, user_id=0061ce46df224f4491599ed10548b2ae, role_id=b8d32893edf5475791d4c3b9aea5a3f6)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:18.506861 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12703303-8d07-45af-8b73-5189213c3c56 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:18.575752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 612/1232] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Aug 11 09:44:18 2022] PUT /identity/v3/projects/a0211f5c0b174c8c998e3ad29f96baab/users/0061ce46df224f4491599ed10548b2ae/roles/b8d32893edf5475791d4c3b9aea5a3f6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:44:20.572651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96749c47-3421-4690-be60-0ef07cf97781 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:20.573200 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96749c47-3421-4690-be60-0ef07cf97781 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:20.573200 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96749c47-3421-4690-be60-0ef07cf97781 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:20.574542 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 621/1233] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:44:20.579816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c759db-f8fd-4c95-9f4f-0acc3e44f1ae None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:20.580257 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c759db-f8fd-4c95-9f4f-0acc3e44f1ae None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:20.580353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c759db-f8fd-4c95-9f4f-0acc3e44f1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:20.599036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-d2c759db-f8fd-4c95-9f4f-0acc3e44f1ae None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:44:20.600206 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-d2c759db-f8fd-4c95-9f4f-0acc3e44f1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:44:20.667096 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 613/1234] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:44:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 09:44:20.691077 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96749c47-3421-4690-be60-0ef07cf97781 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:20.715341 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:20.790443 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96749c47-3421-4690-be60-0ef07cf97781 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:20.823624 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1695e7-2e36-4748-bf4c-5f0b6ff6420c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:20.824182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1695e7-2e36-4748-bf4c-5f0b6ff6420c None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:20.824460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1695e7-2e36-4748-bf4c-5f0b6ff6420c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:20.824730 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1695e7-2e36-4748-bf4c-5f0b6ff6420c None admin] PATH_INFO: `/v3/roles/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:20.834510 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1695e7-2e36-4748-bf4c-5f0b6ff6420c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:44:20.839752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-8b1695e7-2e36-4748-bf4c-5f0b6ff6420c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:44:20.839752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:20.839752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:20.839752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:20.839752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:20.839752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:20.839752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:20.839752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:20.839752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:20.839752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:20.839752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:20.839752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:20.839752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:44:20.839752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:44:20.839752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:44:20.839752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:44:20.840936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:44:20.840936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:44:20.840936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:44:20.840936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:44:20.840936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:20.840936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:20.840936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:20.840936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:20.840936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:20.840936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:20.840936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:20.840936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:20.840936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:20.840936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:20.840936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:20.840936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:20.842031 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:20.842031 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:20.842031 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:20.842031 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:20.842031 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:44:20.842031 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:44:20.842031 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:44:20.842031 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:44:20.842031 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:44:20.842031 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:44:20.842031 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 09:44:20.842031 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:44:20.842031 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 622/1235] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Aug 11 09:44:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:20.846701 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c759db-f8fd-4c95-9f4f-0acc3e44f1ae None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:20.890935 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:20.941229 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c759db-f8fd-4c95-9f4f-0acc3e44f1ae None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:20.974786 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c3ceb-dbb8-4364-9d84-ababc538f972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:20.975373 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c3ceb-dbb8-4364-9d84-ababc538f972 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:20.975644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c3ceb-dbb8-4364-9d84-ababc538f972 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:20.975904 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c3ceb-dbb8-4364-9d84-ababc538f972 None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:20.976555 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c3ceb-dbb8-4364-9d84-ababc538f972 None admin] RBAC: Adding query filter params (name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:20.976848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c3ceb-dbb8-4364-9d84-ababc538f972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:20.978239 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c3ceb-dbb8-4364-9d84-ababc538f972 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:20.985775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 614/1236] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Aug 11 09:44:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:20.991578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1695e7-2e36-4748-bf4c-5f0b6ff6420c None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:21.074599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:21.091060 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1695e7-2e36-4748-bf4c-5f0b6ff6420c None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:21.125869 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46bb5d-5aaf-44f9-8dfd-9b90d09c7ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:21.126516 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46bb5d-5aaf-44f9-8dfd-9b90d09c7ebb None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:21.126824 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46bb5d-5aaf-44f9-8dfd-9b90d09c7ebb None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:21.127094 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46bb5d-5aaf-44f9-8dfd-9b90d09c7ebb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:21.136709 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46bb5d-5aaf-44f9-8dfd-9b90d09c7ebb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:21.138187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46bb5d-5aaf-44f9-8dfd-9b90d09c7ebb None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:21.152627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-db46bb5d-5aaf-44f9-8dfd-9b90d09c7ebb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:21.152627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:21.152627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:21.152627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:21.152627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:21.152627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:21.152627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:21.152627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:21.152627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:21.152627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:21.152627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:21.152627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:21.152627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:44:21.152627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:44:21.152627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:44:21.152627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:44:21.153667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:21.153667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:21.153667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:21.153667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:21.153667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:21.153667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:21.153667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:21.153667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:21.153667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:21.153667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:21.153667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:21.153667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:21.153667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:21.153667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:21.153667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:21.153667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:21.153667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:44:21.154731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:44:21.154731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:21.154731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:44:21.154731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 623/1237] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:21.160447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c3ceb-dbb8-4364-9d84-ababc538f972 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:21.257614 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c3ceb-dbb8-4364-9d84-ababc538f972 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:21.266389 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:21.291115 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc62c5-a901-43a5-a2bb-08031340ff43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:21.291716 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc62c5-a901-43a5-a2bb-08031340ff43 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:21.292041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc62c5-a901-43a5-a2bb-08031340ff43 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:21.292310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc62c5-a901-43a5-a2bb-08031340ff43 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:21.292941 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc62c5-a901-43a5-a2bb-08031340ff43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:21.293239 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc62c5-a901-43a5-a2bb-08031340ff43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:21.294632 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc62c5-a901-43a5-a2bb-08031340ff43 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:21.306136 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 615/1238] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:21.312761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46bb5d-5aaf-44f9-8dfd-9b90d09c7ebb None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:21.410363 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46bb5d-5aaf-44f9-8dfd-9b90d09c7ebb None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:21.443596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da458ac2-64a1-4308-8e74-3741d664761c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:21.444225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da458ac2-64a1-4308-8e74-3741d664761c None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:21.444485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da458ac2-64a1-4308-8e74-3741d664761c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:21.444751 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da458ac2-64a1-4308-8e74-3741d664761c None admin] PATH_INFO: `/v3/users/placement` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:21.447393 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:21.452160 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da458ac2-64a1-4308-8e74-3741d664761c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:21.453583 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da458ac2-64a1-4308-8e74-3741d664761c None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:21.465071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-da458ac2-64a1-4308-8e74-3741d664761c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 11 09:44:21.465071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:21.465071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:21.465071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:21.465071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:21.465071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:21.465071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:21.465071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:21.465071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:21.465071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:21.465071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:21.465071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:21.465071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:44:21.465071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:44:21.465071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:44:21.465071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:44:21.466230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:21.466230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:21.466230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:44:21.466230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:44:21.466230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:44:21.466230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:44:21.466230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:21.466230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:21.466230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:21.466230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:21.466230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:21.466230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:21.466230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:21.466230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:21.466230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:21.466230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:21.466230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:21.466230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:21.467445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:21.467445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:21.467445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:44:21.467445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:44:21.467445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:44:21.467445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:44:21.467445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:44:21.467445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:44:21.467445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 11 09:44:21.467445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:44:21.467445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 624/1239] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:44:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 09:44:21.471985 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc62c5-a901-43a5-a2bb-08031340ff43 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:21.569731 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc62c5-a901-43a5-a2bb-08031340ff43 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:21.603227 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ed58d-b9e7-4d4d-904d-05e44532da03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:21.603819 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ed58d-b9e7-4d4d-904d-05e44532da03 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:21.604094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ed58d-b9e7-4d4d-904d-05e44532da03 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:21.604356 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ed58d-b9e7-4d4d-904d-05e44532da03 None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:21.605061 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ed58d-b9e7-4d4d-904d-05e44532da03 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:21.605356 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ed58d-b9e7-4d4d-904d-05e44532da03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:21.606809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ed58d-b9e7-4d4d-904d-05e44532da03 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:21.623387 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 616/1240] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Aug 11 09:44:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:21.629728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da458ac2-64a1-4308-8e74-3741d664761c None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:21.728747 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da458ac2-64a1-4308-8e74-3741d664761c None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:21.761730 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf48c31-213a-4a0a-9570-68aec1312c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:21.762402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf48c31-213a-4a0a-9570-68aec1312c4c None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:21.762681 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf48c31-213a-4a0a-9570-68aec1312c4c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:21.762953 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf48c31-213a-4a0a-9570-68aec1312c4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:21.822600 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:21.828831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf48c31-213a-4a0a-9570-68aec1312c4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:21.830310 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf48c31-213a-4a0a-9570-68aec1312c4c None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:21.923396 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 625/1241] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:44:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 09:44:21.930183 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ed58d-b9e7-4d4d-904d-05e44532da03 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:21.956945 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:22.025823 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ed58d-b9e7-4d4d-904d-05e44532da03 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:22.058566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e5a95-218b-4f74-82f8-48b737dd14a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:22.059184 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e5a95-218b-4f74-82f8-48b737dd14a4 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:22.059460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e5a95-218b-4f74-82f8-48b737dd14a4 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:22.059731 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e5a95-218b-4f74-82f8-48b737dd14a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:22.069857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e5a95-218b-4f74-82f8-48b737dd14a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:22.071322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e5a95-218b-4f74-82f8-48b737dd14a4 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:22.086137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-d31e5a95-218b-4f74-82f8-48b737dd14a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:22.086137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:22.086137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:22.086137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:22.086137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:22.086137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:22.086137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:22.086137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:22.086137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:22.086137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:22.086137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:22.086137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:22.086137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:44:22.086137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:44:22.086137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:44:22.086137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:44:22.092856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:22.092856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:22.092856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:22.092856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:22.092856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:22.092856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:22.092856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:22.092856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:22.092856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:22.092856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:22.092856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:22.092856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:22.092856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:22.092856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:22.092856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:22.092856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:22.092856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:44:22.093935 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:44:22.093935 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:22.093935 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:44:22.093935 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 617/1242] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:22.094243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf48c31-213a-4a0a-9570-68aec1312c4c None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:22.183358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:22.188798 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf48c31-213a-4a0a-9570-68aec1312c4c None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:22.221075 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b2374-e0d9-491b-9f9b-d84ba3dd390d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:22.221697 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b2374-e0d9-491b-9f9b-d84ba3dd390d None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:22.221963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b2374-e0d9-491b-9f9b-d84ba3dd390d None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:22.222266 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b2374-e0d9-491b-9f9b-d84ba3dd390d None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:22.222885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b2374-e0d9-491b-9f9b-d84ba3dd390d None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:22.223183 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b2374-e0d9-491b-9f9b-d84ba3dd390d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:22.224530 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b2374-e0d9-491b-9f9b-d84ba3dd390d None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:22.235271 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 626/1243] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:22.241594 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e5a95-218b-4f74-82f8-48b737dd14a4 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:22.320704 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:22.342528 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e5a95-218b-4f74-82f8-48b737dd14a4 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:22.380621 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855e328-0a91-41bc-ad12-267ec76ad667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:22.381223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855e328-0a91-41bc-ad12-267ec76ad667 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:22.381500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855e328-0a91-41bc-ad12-267ec76ad667 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:22.381768 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855e328-0a91-41bc-ad12-267ec76ad667 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:22.388547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855e328-0a91-41bc-ad12-267ec76ad667 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:22.390521 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855e328-0a91-41bc-ad12-267ec76ad667 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:22.405419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-a855e328-0a91-41bc-ad12-267ec76ad667 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:44:22.405419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:22.405419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:22.405419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:22.405419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:22.405419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:22.405419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:22.405419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:22.405419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:22.405419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:22.405419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:22.405419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:22.405419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:44:22.405419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:44:22.405419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:44:22.406538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:44:22.406538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:22.406538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:22.406538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:22.406538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:22.406538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:22.406538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:22.406538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:22.406538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:22.406538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:22.406538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:22.406538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:22.406538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:22.406538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:22.406538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:22.406538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:22.406538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:22.407447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:44:22.407447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:44:22.407447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:44:22.407447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:44:22.407447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:44:22.407447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:44:22.407447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:44:22.407447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:44:22.407447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 618/1244] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:44:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:22.413185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b2374-e0d9-491b-9f9b-d84ba3dd390d None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:22.510986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b2374-e0d9-491b-9f9b-d84ba3dd390d None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:22.544115 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd6267-5b11-47d7-be6d-9fe2f9a817f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:22.544709 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd6267-5b11-47d7-be6d-9fe2f9a817f4 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:22.544984 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd6267-5b11-47d7-be6d-9fe2f9a817f4 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:22.545251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd6267-5b11-47d7-be6d-9fe2f9a817f4 None admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:22.545925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd6267-5b11-47d7-be6d-9fe2f9a817f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:22.546251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd6267-5b11-47d7-be6d-9fe2f9a817f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:22.547681 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd6267-5b11-47d7-be6d-9fe2f9a817f4 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:22.559491 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 627/1245] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:44:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:22.565584 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855e328-0a91-41bc-ad12-267ec76ad667 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:22.664017 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855e328-0a91-41bc-ad12-267ec76ad667 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:22.697460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c34e62-a00b-4032-a09b-b61eda0d1baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:22.698059 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c34e62-a00b-4032-a09b-b61eda0d1baa None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:22.698365 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c34e62-a00b-4032-a09b-b61eda0d1baa None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:22.698692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c34e62-a00b-4032-a09b-b61eda0d1baa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:22.699339 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c34e62-a00b-4032-a09b-b61eda0d1baa None admin] RBAC: Adding query filter params (role.id=b8d32893edf5475791d4c3b9aea5a3f6, scope.project.id=a0211f5c0b174c8c998e3ad29f96baab, user.id=0061ce46df224f4491599ed10548b2ae) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:22.702603 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c34e62-a00b-4032-a09b-b61eda0d1baa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:22.702603 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c34e62-a00b-4032-a09b-b61eda0d1baa None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:22.707469 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 619/1246] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:44:22 2022] GET /identity/v3/role_assignments?user.id=0061ce46df224f4491599ed10548b2ae&scope.project.id=a0211f5c0b174c8c998e3ad29f96baab&role.id=b8d32893edf5475791d4c3b9aea5a3f6 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:24.756938 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75530f01-abbe-48d9-a68c-08d431ea5b7e None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:24.757470 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75530f01-abbe-48d9-a68c-08d431ea5b7e None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:24.757470 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75530f01-abbe-48d9-a68c-08d431ea5b7e None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:24.758834 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 628/1247] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:44:24.763852 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc35d0b-86d7-42e9-a176-a825b8fb546c None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:24.764279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc35d0b-86d7-42e9-a176-a825b8fb546c None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:24.764370 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc35d0b-86d7-42e9-a176-a825b8fb546c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:24.770793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:24.782600 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-afc35d0b-86d7-42e9-a176-a825b8fb546c None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:44:24.783771 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-afc35d0b-86d7-42e9-a176-a825b8fb546c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:44:24.848364 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 620/1248] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:44:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 09:44:24.872113 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75530f01-abbe-48d9-a68c-08d431ea5b7e None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:24.890766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:24.971329 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75530f01-abbe-48d9-a68c-08d431ea5b7e None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:25.004892 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742437b-faed-4fc9-9286-40e7c7271919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:25.005557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742437b-faed-4fc9-9286-40e7c7271919 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:25.005834 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742437b-faed-4fc9-9286-40e7c7271919 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:25.006121 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742437b-faed-4fc9-9286-40e7c7271919 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:25.015818 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742437b-faed-4fc9-9286-40e7c7271919 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:44:25.020423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-4742437b-faed-4fc9-9286-40e7c7271919 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:44:25.020423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:25.020423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:25.020423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:25.020423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:25.020423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:25.020423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:25.020423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:25.020423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:25.020423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:25.020423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:25.020423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:25.020423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:44:25.020423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:44:25.020423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:44:25.020423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:44:25.021531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:44:25.021531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:44:25.021531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:44:25.021531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:44:25.021531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:25.021531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:25.021531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:25.021531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:25.021531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:25.021531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:25.021531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:25.021531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:25.021531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:25.021531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:25.021531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:25.021531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:25.022577 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:25.022577 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:25.022577 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:25.022577 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:25.022577 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:44:25.022577 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:44:25.022577 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:44:25.022577 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:44:25.022577 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:44:25.022577 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:44:25.022577 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:44:25.022577 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:44:25.022577 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 629/1249] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:44:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:25.027726 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc35d0b-86d7-42e9-a176-a825b8fb546c None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:25.125016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc35d0b-86d7-42e9-a176-a825b8fb546c None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:25.153194 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:25.158493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc4750-989e-4d8f-b6ca-dd0be0f030fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:25.159080 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc4750-989e-4d8f-b6ca-dd0be0f030fb None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:25.159352 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc4750-989e-4d8f-b6ca-dd0be0f030fb None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:25.159614 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc4750-989e-4d8f-b6ca-dd0be0f030fb None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:25.160256 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc4750-989e-4d8f-b6ca-dd0be0f030fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:25.160549 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc4750-989e-4d8f-b6ca-dd0be0f030fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:25.161893 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc4750-989e-4d8f-b6ca-dd0be0f030fb None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:25.169501 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 621/1250] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:44:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:25.176150 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742437b-faed-4fc9-9286-40e7c7271919 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:25.250733 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:25.272667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742437b-faed-4fc9-9286-40e7c7271919 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:25.306332 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9367d-3625-47d5-859a-a98c701f884d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:25.306951 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9367d-3625-47d5-859a-a98c701f884d None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:25.307230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9367d-3625-47d5-859a-a98c701f884d None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:25.307503 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9367d-3625-47d5-859a-a98c701f884d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:25.317177 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9367d-3625-47d5-859a-a98c701f884d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:25.318659 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9367d-3625-47d5-859a-a98c701f884d None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:25.332809 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-f7c9367d-3625-47d5-859a-a98c701f884d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:25.332809 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:25.332809 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:25.332809 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:25.332809 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:25.332809 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:25.332809 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:25.332809 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:25.332809 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:25.332809 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:25.332809 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:25.332809 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:25.332809 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:44:25.332809 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:44:25.332809 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:44:25.332809 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:44:25.333887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:25.333887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:25.333887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:25.333887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:25.333887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:25.333887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:25.333887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:25.333887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:25.333887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:25.333887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:25.333887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:25.333887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:25.333887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:25.333887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:25.333887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:25.333887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:25.333887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:44:25.340402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:44:25.340402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:25.340402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:44:25.340402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 630/1251] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:25.340671 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc4750-989e-4d8f-b6ca-dd0be0f030fb None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:25.437390 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc4750-989e-4d8f-b6ca-dd0be0f030fb None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:25.471294 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607bf26-23eb-4f47-8531-f97b4dd1f121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:25.471896 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607bf26-23eb-4f47-8531-f97b4dd1f121 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:25.472168 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607bf26-23eb-4f47-8531-f97b4dd1f121 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:25.472433 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607bf26-23eb-4f47-8531-f97b4dd1f121 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:25.473063 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607bf26-23eb-4f47-8531-f97b4dd1f121 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:25.473359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607bf26-23eb-4f47-8531-f97b4dd1f121 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:25.474758 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607bf26-23eb-4f47-8531-f97b4dd1f121 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:25.486966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 622/1252] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:25.492571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9367d-3625-47d5-859a-a98c701f884d None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:25.610603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9367d-3625-47d5-859a-a98c701f884d None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:25.646273 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:25.654202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d0434-587b-41ba-a431-531171b786e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:25.654834 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d0434-587b-41ba-a431-531171b786e8 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:25.655110 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d0434-587b-41ba-a431-531171b786e8 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:25.655378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d0434-587b-41ba-a431-531171b786e8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:25.669571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d0434-587b-41ba-a431-531171b786e8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:25.669571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d0434-587b-41ba-a431-531171b786e8 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:25.677654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-c23d0434-587b-41ba-a431-531171b786e8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 11 09:44:25.677654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:25.677654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:25.677654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:25.677654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:25.677654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:25.677654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:25.677654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:25.677654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:25.677654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:25.677654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:25.677654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:25.677654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:44:25.677654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:44:25.677654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:44:25.677654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:44:25.678793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:25.678793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:25.678793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:44:25.678793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:44:25.678793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:44:25.678793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:44:25.678793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:25.678793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:25.678793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:25.678793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:25.678793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:25.678793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:25.678793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:25.678793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:25.678793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:25.678793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:25.678793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:25.678793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:25.680019 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:25.680019 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:25.680019 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:44:25.680019 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:44:25.680019 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:44:25.680019 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:44:25.680019 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:44:25.680019 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:44:25.680019 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 11 09:44:25.680019 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:44:25.680019 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 631/1253] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:44:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:25.684527 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607bf26-23eb-4f47-8531-f97b4dd1f121 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:25.745820 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:25.794211 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607bf26-23eb-4f47-8531-f97b4dd1f121 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:25.830746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5968a8-61e4-4102-a96f-8c70b4344907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:25.831355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5968a8-61e4-4102-a96f-8c70b4344907 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:25.831634 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5968a8-61e4-4102-a96f-8c70b4344907 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:25.831906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5968a8-61e4-4102-a96f-8c70b4344907 None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:25.832639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5968a8-61e4-4102-a96f-8c70b4344907 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:25.832986 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5968a8-61e4-4102-a96f-8c70b4344907 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:25.837528 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5968a8-61e4-4102-a96f-8c70b4344907 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:25.855012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 623/1254] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Aug 11 09:44:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:25.861214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d0434-587b-41ba-a431-531171b786e8 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:25.965120 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d0434-587b-41ba-a431-531171b786e8 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:25.998242 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd36f4-c2a9-4b43-b118-5e18baa6027f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:25.998843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd36f4-c2a9-4b43-b118-5e18baa6027f None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:25.999119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd36f4-c2a9-4b43-b118-5e18baa6027f None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:25.999388 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd36f4-c2a9-4b43-b118-5e18baa6027f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:26.056692 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:26.069375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd36f4-c2a9-4b43-b118-5e18baa6027f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:26.070908 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd36f4-c2a9-4b43-b118-5e18baa6027f None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:26.180938 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 632/1255] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:44:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 09:44:26.186913 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5968a8-61e4-4102-a96f-8c70b4344907 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:26.290763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5968a8-61e4-4102-a96f-8c70b4344907 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:26.305436 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:26.327128 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d91db-bd9f-4463-baaa-8a1a6f0fe3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:26.327751 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d91db-bd9f-4463-baaa-8a1a6f0fe3e5 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:26.328024 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d91db-bd9f-4463-baaa-8a1a6f0fe3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:26.328292 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d91db-bd9f-4463-baaa-8a1a6f0fe3e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:26.337926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d91db-bd9f-4463-baaa-8a1a6f0fe3e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:26.339382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d91db-bd9f-4463-baaa-8a1a6f0fe3e5 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:26.353095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-601d91db-bd9f-4463-baaa-8a1a6f0fe3e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:26.353095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:26.353095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:26.353095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:26.353095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:26.353095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:26.353095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:26.353095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:26.353095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:26.353095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:26.353095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:26.353095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:26.353095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:44:26.353095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:44:26.353095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:44:26.353095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:44:26.354322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:26.354322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:26.354322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:26.354322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:26.354322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:26.354322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:26.354322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:26.354322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:26.354322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:26.354322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:26.354322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:26.354322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:26.354322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:26.354322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:26.354322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:26.354322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:26.354322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:44:26.355354 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:44:26.355354 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:26.355354 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:44:26.355354 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 624/1256] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:44:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:26.359918 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd36f4-c2a9-4b43-b118-5e18baa6027f None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:26.448454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:26.460124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd36f4-c2a9-4b43-b118-5e18baa6027f None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:26.493054 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828fa93-37cf-4aad-9c81-99a4de5aab90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:26.493653 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828fa93-37cf-4aad-9c81-99a4de5aab90 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:26.493935 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828fa93-37cf-4aad-9c81-99a4de5aab90 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:26.494235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828fa93-37cf-4aad-9c81-99a4de5aab90 None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:26.494863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828fa93-37cf-4aad-9c81-99a4de5aab90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:26.495162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828fa93-37cf-4aad-9c81-99a4de5aab90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:26.496505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828fa93-37cf-4aad-9c81-99a4de5aab90 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:26.508199 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 633/1257] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:26.513741 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d91db-bd9f-4463-baaa-8a1a6f0fe3e5 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:26.610773 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d91db-bd9f-4463-baaa-8a1a6f0fe3e5 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:26.642754 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791de18b-25a9-45dd-98ed-f693d010f861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:26.643362 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791de18b-25a9-45dd-98ed-f693d010f861 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:26.643633 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791de18b-25a9-45dd-98ed-f693d010f861 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:26.643898 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791de18b-25a9-45dd-98ed-f693d010f861 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:26.650286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791de18b-25a9-45dd-98ed-f693d010f861 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:26.651705 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791de18b-25a9-45dd-98ed-f693d010f861 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:26.662961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-791de18b-25a9-45dd-98ed-f693d010f861 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:44:26.662961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:26.662961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:26.662961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:26.662961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:26.662961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:26.662961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:26.662961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:26.662961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:26.662961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:26.662961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:26.662961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:26.662961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:44:26.662961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:44:26.662961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:44:26.663874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:44:26.663874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:26.663874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:26.663874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:26.663874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:26.663874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:26.663874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:26.663874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:26.663874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:26.663874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:26.663874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:26.663874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:26.663874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:26.663874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:26.663874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:26.663874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:26.663874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:26.664885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:44:26.664885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:44:26.664885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:44:26.664885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:44:26.664885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:44:26.664885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:44:26.664885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:44:26.664885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:44:26.664885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 625/1258] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:44:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:26.669728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828fa93-37cf-4aad-9c81-99a4de5aab90 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:26.768610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828fa93-37cf-4aad-9c81-99a4de5aab90 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:26.801358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550eaa47-c958-47b0-bdda-a457bb4be46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:26.801944 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eaa47-c958-47b0-bdda-a457bb4be46f None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:26.802244 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eaa47-c958-47b0-bdda-a457bb4be46f None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:26.802512 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eaa47-c958-47b0-bdda-a457bb4be46f None admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:26.803183 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550eaa47-c958-47b0-bdda-a457bb4be46f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:26.803481 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550eaa47-c958-47b0-bdda-a457bb4be46f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:26.805028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550eaa47-c958-47b0-bdda-a457bb4be46f None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:26.817563 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 634/1259] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:44:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:26.823675 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791de18b-25a9-45dd-98ed-f693d010f861 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:26.849243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:26.921078 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791de18b-25a9-45dd-98ed-f693d010f861 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:26.954392 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db988a-9870-486c-88e5-57df3eac281a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:26.955013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db988a-9870-486c-88e5-57df3eac281a None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:26.955290 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db988a-9870-486c-88e5-57df3eac281a None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:26.955561 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db988a-9870-486c-88e5-57df3eac281a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:26.956331 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db988a-9870-486c-88e5-57df3eac281a None admin] RBAC: Adding query filter params (role.id=6aae1c66f3f04cec80ed72c20d7e033b, scope.project.id=a0211f5c0b174c8c998e3ad29f96baab, user.id=0061ce46df224f4491599ed10548b2ae) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:26.956636 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db988a-9870-486c-88e5-57df3eac281a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:26.958068 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db988a-9870-486c-88e5-57df3eac281a None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:26.963335 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 626/1260] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:44:26 2022] GET /identity/v3/role_assignments?user.id=0061ce46df224f4491599ed10548b2ae&scope.project.id=a0211f5c0b174c8c998e3ad29f96baab&role.id=6aae1c66f3f04cec80ed72c20d7e033b => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:28.913912 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874d1e2-db7d-411f-ab01-5f0219c198f9 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:28.914440 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874d1e2-db7d-411f-ab01-5f0219c198f9 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:28.914440 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874d1e2-db7d-411f-ab01-5f0219c198f9 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:28.915711 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 635/1261] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:44:28.920738 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7b7df-cb7a-44d2-a486-32c22db7a92d None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:28.921150 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7b7df-cb7a-44d2-a486-32c22db7a92d None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:28.921306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7b7df-cb7a-44d2-a486-32c22db7a92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:28.940885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-85c7b7df-cb7a-44d2-a486-32c22db7a92d None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:44:28.942069 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-85c7b7df-cb7a-44d2-a486-32c22db7a92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:44:29.007364 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 627/1262] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:44:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:44:29.028899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874d1e2-db7d-411f-ab01-5f0219c198f9 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:29.040079 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:29.129771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874d1e2-db7d-411f-ab01-5f0219c198f9 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:29.162705 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c38ca-3e1f-4734-8664-63362ad077da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:29.163331 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c38ca-3e1f-4734-8664-63362ad077da None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:29.163608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c38ca-3e1f-4734-8664-63362ad077da None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:29.163876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c38ca-3e1f-4734-8664-63362ad077da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:29.174555 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c38ca-3e1f-4734-8664-63362ad077da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:44:29.179477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-bc6c38ca-3e1f-4734-8664-63362ad077da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:44:29.179477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:29.179477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:29.179477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:29.179477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:29.179477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:29.179477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:29.179477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:29.179477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:29.179477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:29.179477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:29.179477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:29.179477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:44:29.179477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:44:29.179477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:44:29.179477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:44:29.180636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:44:29.180636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:44:29.180636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:44:29.180636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:44:29.180636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:29.180636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:29.180636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:29.180636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:29.180636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:29.180636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:29.180636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:29.180636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:29.180636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:29.180636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:29.180636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:29.180636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:29.181888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:29.181888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:29.181888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:29.181888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:29.181888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:44:29.181888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:44:29.181888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:44:29.181888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:44:29.181888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:44:29.181888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:44:29.181888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:44:29.181888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:44:29.181888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 636/1263] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:44:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:29.186613 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7b7df-cb7a-44d2-a486-32c22db7a92d None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:29.204279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:29.281686 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7b7df-cb7a-44d2-a486-32c22db7a92d None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:29.314933 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d448b4-d841-4de3-af90-5be02328ecdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:29.315535 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d448b4-d841-4de3-af90-5be02328ecdd None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:29.315812 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d448b4-d841-4de3-af90-5be02328ecdd None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:29.316082 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d448b4-d841-4de3-af90-5be02328ecdd None admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:29.316735 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d448b4-d841-4de3-af90-5be02328ecdd None admin] RBAC: Adding query filter params (name=admin) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:29.317038 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d448b4-d841-4de3-af90-5be02328ecdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:29.318427 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d448b4-d841-4de3-af90-5be02328ecdd None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:29.326109 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 628/1264] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:44:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:29.332589 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c38ca-3e1f-4734-8664-63362ad077da None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:29.397335 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:29.429518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c38ca-3e1f-4734-8664-63362ad077da None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:29.461616 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e913e-d5dc-42f7-a286-590d879ea858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:29.462314 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e913e-d5dc-42f7-a286-590d879ea858 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:29.462588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e913e-d5dc-42f7-a286-590d879ea858 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:29.462852 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e913e-d5dc-42f7-a286-590d879ea858 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:29.473680 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e913e-d5dc-42f7-a286-590d879ea858 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:29.475657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e913e-d5dc-42f7-a286-590d879ea858 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:29.489458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-c89e913e-d5dc-42f7-a286-590d879ea858 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:29.489458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:29.489458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:29.489458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:29.489458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:29.489458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:29.489458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:29.489458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:29.489458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:29.489458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:29.489458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:29.489458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:29.489458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:44:29.489458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:44:29.489458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:44:29.489458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:44:29.490548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:29.490548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:29.490548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:29.490548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:29.490548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:29.490548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:29.490548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:29.490548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:29.490548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:29.490548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:29.490548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:29.490548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:29.490548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:29.490548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:29.490548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:29.490548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:29.490548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:44:29.491541 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:44:29.491541 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:29.491541 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:44:29.491541 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 637/1265] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:29.496384 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d448b4-d841-4de3-af90-5be02328ecdd None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:29.575478 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:29.594147 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d448b4-d841-4de3-af90-5be02328ecdd None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:29.625661 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23986df-a5ed-4848-88a0-49d930679062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:29.626284 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23986df-a5ed-4848-88a0-49d930679062 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:29.626574 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23986df-a5ed-4848-88a0-49d930679062 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:29.627359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23986df-a5ed-4848-88a0-49d930679062 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:29.627990 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23986df-a5ed-4848-88a0-49d930679062 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:29.628290 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23986df-a5ed-4848-88a0-49d930679062 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:29.629643 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23986df-a5ed-4848-88a0-49d930679062 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:29.641601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 629/1266] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:29.647728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e913e-d5dc-42f7-a286-590d879ea858 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:29.746214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e913e-d5dc-42f7-a286-590d879ea858 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:29.765902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:29.779949 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59472fac-3423-40bb-b05f-61cf949564b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:29.780557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59472fac-3423-40bb-b05f-61cf949564b0 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:29.780828 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59472fac-3423-40bb-b05f-61cf949564b0 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:29.781093 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59472fac-3423-40bb-b05f-61cf949564b0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:29.788752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59472fac-3423-40bb-b05f-61cf949564b0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:29.790268 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59472fac-3423-40bb-b05f-61cf949564b0 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:29.801835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-59472fac-3423-40bb-b05f-61cf949564b0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 11 09:44:29.801835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:29.801835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:29.801835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:29.801835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:29.801835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:29.801835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:29.801835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:29.801835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:29.801835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:29.801835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:29.801835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:29.801835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:44:29.801835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:44:29.801835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:44:29.801835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:44:29.802999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:29.802999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:29.802999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:44:29.802999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:44:29.802999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:44:29.802999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:44:29.802999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:29.802999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:29.802999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:29.802999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:29.802999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:29.802999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:29.802999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:29.802999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:29.802999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:29.802999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:29.802999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:29.802999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:29.803985 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:29.803985 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:29.803985 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:44:29.803985 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:44:29.803985 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:44:29.803985 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:44:29.803985 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:44:29.803985 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:44:29.803985 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 11 09:44:29.803985 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:44:29.803985 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 638/1267] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:44:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:29.808807 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23986df-a5ed-4848-88a0-49d930679062 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:29.906230 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23986df-a5ed-4848-88a0-49d930679062 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:29.939719 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e46c46-3442-4205-a819-13a0151315d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:29.940327 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e46c46-3442-4205-a819-13a0151315d5 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:29.940576 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e46c46-3442-4205-a819-13a0151315d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:29.940854 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e46c46-3442-4205-a819-13a0151315d5 None admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:29.941554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e46c46-3442-4205-a819-13a0151315d5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:29.941856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e46c46-3442-4205-a819-13a0151315d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:29.943303 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e46c46-3442-4205-a819-13a0151315d5 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:29.951535 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:29.960152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 630/1268] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Aug 11 09:44:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:29.966212 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59472fac-3423-40bb-b05f-61cf949564b0 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:30.062259 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59472fac-3423-40bb-b05f-61cf949564b0 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:30.094309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a3b23-d6e0-4cdf-9b09-15cb12f738bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:30.094902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a3b23-d6e0-4cdf-9b09-15cb12f738bd None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:30.095172 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a3b23-d6e0-4cdf-9b09-15cb12f738bd None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:30.095435 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a3b23-d6e0-4cdf-9b09-15cb12f738bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:30.105625 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a3b23-d6e0-4cdf-9b09-15cb12f738bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:30.107072 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a3b23-d6e0-4cdf-9b09-15cb12f738bd None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:30.120899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-932a3b23-d6e0-4cdf-9b09-15cb12f738bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:30.120899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:30.120899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:30.120899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:30.120899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:30.120899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:30.120899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:30.120899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:30.120899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:30.120899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:30.120899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:30.120899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:30.120899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:44:30.120899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:44:30.120899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:44:30.120899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:44:30.122050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:30.122050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:30.122050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:30.122050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:30.122050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:30.122050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:30.122050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:30.122050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:30.122050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:30.122050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:30.122050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:30.122050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:30.122050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:30.122050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:30.122050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:30.122050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:30.122050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:44:30.123199 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:44:30.123199 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:30.123199 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:44:30.123199 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 639/1269] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:30.128372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e46c46-3442-4205-a819-13a0151315d5 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:30.224257 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e46c46-3442-4205-a819-13a0151315d5 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:30.258605 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435b9dc-0fc0-4402-ad60-37f0990f3096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:30.259209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435b9dc-0fc0-4402-ad60-37f0990f3096 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:30.259487 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435b9dc-0fc0-4402-ad60-37f0990f3096 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:30.259758 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435b9dc-0fc0-4402-ad60-37f0990f3096 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:30.260388 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435b9dc-0fc0-4402-ad60-37f0990f3096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:30.260689 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435b9dc-0fc0-4402-ad60-37f0990f3096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:30.262047 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435b9dc-0fc0-4402-ad60-37f0990f3096 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:30.272986 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 631/1270] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:30.278647 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a3b23-d6e0-4cdf-9b09-15cb12f738bd None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:30.309710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:30.378801 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a3b23-d6e0-4cdf-9b09-15cb12f738bd None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:30.415055 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566d958-eb98-4c2b-9253-73c8b8de9564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:30.415683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566d958-eb98-4c2b-9253-73c8b8de9564 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:30.415961 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566d958-eb98-4c2b-9253-73c8b8de9564 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:30.416232 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566d958-eb98-4c2b-9253-73c8b8de9564 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:30.422915 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566d958-eb98-4c2b-9253-73c8b8de9564 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:30.425241 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566d958-eb98-4c2b-9253-73c8b8de9564 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:30.436757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-8566d958-eb98-4c2b-9253-73c8b8de9564 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:44:30.436757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:30.436757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:30.436757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:30.436757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:30.436757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:30.436757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:30.436757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:30.436757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:30.436757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:30.436757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:30.436757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:30.436757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:44:30.436757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:44:30.436757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:44:30.437853 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:44:30.437853 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:30.437853 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:30.437853 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:30.437853 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:30.437853 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:30.437853 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:30.437853 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:30.437853 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:30.437853 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:30.437853 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:30.437853 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:30.437853 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:30.437853 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:30.437853 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:30.437853 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:30.437853 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:30.439089 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:44:30.439089 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:44:30.439089 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:44:30.439089 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:44:30.439089 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:44:30.439089 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:44:30.439089 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:44:30.439089 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:44:30.439089 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 640/1271] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:44:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:30.443759 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435b9dc-0fc0-4402-ad60-37f0990f3096 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:30.501492 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:30.541717 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435b9dc-0fc0-4402-ad60-37f0990f3096 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:30.573965 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb0da3-409a-4232-aa73-012d15327c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:30.574582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb0da3-409a-4232-aa73-012d15327c5b None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:30.574861 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb0da3-409a-4232-aa73-012d15327c5b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:30.575132 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb0da3-409a-4232-aa73-012d15327c5b None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:30.575811 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb0da3-409a-4232-aa73-012d15327c5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:30.576112 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb0da3-409a-4232-aa73-012d15327c5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:30.577532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb0da3-409a-4232-aa73-012d15327c5b None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:30.588870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 632/1272] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:44:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:30.594927 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566d958-eb98-4c2b-9253-73c8b8de9564 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:30.685101 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:30.693473 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566d958-eb98-4c2b-9253-73c8b8de9564 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:30.726713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cef9a4-a27a-4b3d-9422-83b9380e6f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:30.727350 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cef9a4-a27a-4b3d-9422-83b9380e6f01 None admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:30.727620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cef9a4-a27a-4b3d-9422-83b9380e6f01 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:30.727883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cef9a4-a27a-4b3d-9422-83b9380e6f01 None admin] PATH_INFO: `/v3/projects/a0211f5c0b174c8c998e3ad29f96baab/users/0061ce46df224f4491599ed10548b2ae/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:30.729841 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cef9a4-a27a-4b3d-9422-83b9380e6f01 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0211f5c0b174c8c998e3ad29f96baab, user_id=0061ce46df224f4491599ed10548b2ae, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:30.731284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cef9a4-a27a-4b3d-9422-83b9380e6f01 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:30.799207 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 641/1273] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Aug 11 09:44:30 2022] PUT /identity/v3/projects/a0211f5c0b174c8c998e3ad29f96baab/users/0061ce46df224f4491599ed10548b2ae/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:44:32.794979 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8701640-0c5c-4314-9681-2acdb8d5138b None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:32.795524 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8701640-0c5c-4314-9681-2acdb8d5138b None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:32.795524 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8701640-0c5c-4314-9681-2acdb8d5138b None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:32.796929 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 633/1274] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:44:32.802538 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2d880-f5c6-4d8b-98e4-44d0b4942d3b None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:32.802971 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2d880-f5c6-4d8b-98e4-44d0b4942d3b None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:32.803074 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2d880-f5c6-4d8b-98e4-44d0b4942d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:32.820461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-cfd2d880-f5c6-4d8b-98e4-44d0b4942d3b None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:44:32.821638 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-cfd2d880-f5c6-4d8b-98e4-44d0b4942d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:44:32.885039 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 642/1275] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:44:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:44:32.908876 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8701640-0c5c-4314-9681-2acdb8d5138b None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:33.007049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8701640-0c5c-4314-9681-2acdb8d5138b None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:33.024945 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:33.043531 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0776e0-4f7f-42af-85d7-d4465d0b57f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:33.044170 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0776e0-4f7f-42af-85d7-d4465d0b57f2 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:33.044450 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0776e0-4f7f-42af-85d7-d4465d0b57f2 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:33.044719 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0776e0-4f7f-42af-85d7-d4465d0b57f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:33.055084 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0776e0-4f7f-42af-85d7-d4465d0b57f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 09:44:33.059720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-de0776e0-4f7f-42af-85d7-d4465d0b57f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:44:33.059720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:33.059720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:33.059720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:33.059720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:33.059720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:33.059720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:33.059720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:33.059720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:33.059720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:33.059720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:33.059720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:33.059720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 09:44:33.059720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 09:44:33.059720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 09:44:33.059720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 09:44:33.060848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 09:44:33.060848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 09:44:33.060848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 09:44:33.060848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 09:44:33.060848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:33.060848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:33.060848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:33.060848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:33.060848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:33.060848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:33.060848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:33.060848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:33.060848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:33.060848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:33.060848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:33.060848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:33.061909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:33.061909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:33.061909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:33.061909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:33.061909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 09:44:33.061909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 09:44:33.061909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 09:44:33.061909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 09:44:33.061909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 09:44:33.061909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 09:44:33.061909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 09:44:33.061909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:44:33.061909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 634/1276] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Aug 11 09:44:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:33.066889 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2d880-f5c6-4d8b-98e4-44d0b4942d3b None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:33.145510 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:33.166559 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2d880-f5c6-4d8b-98e4-44d0b4942d3b None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:33.195145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263b889-b745-4f78-bbb9-77c7c99a63fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:33.195745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263b889-b745-4f78-bbb9-77c7c99a63fa None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:33.196021 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263b889-b745-4f78-bbb9-77c7c99a63fa None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:33.196288 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263b889-b745-4f78-bbb9-77c7c99a63fa None admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:33.196942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263b889-b745-4f78-bbb9-77c7c99a63fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:33.197243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263b889-b745-4f78-bbb9-77c7c99a63fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:33.198627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263b889-b745-4f78-bbb9-77c7c99a63fa None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:33.206870 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 643/1277] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Aug 11 09:44:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:33.212534 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0776e0-4f7f-42af-85d7-d4465d0b57f2 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:33.313259 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0776e0-4f7f-42af-85d7-d4465d0b57f2 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:33.346858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35e7fc-11c9-4b28-b933-8acd80591833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:33.347471 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35e7fc-11c9-4b28-b933-8acd80591833 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:33.347743 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35e7fc-11c9-4b28-b933-8acd80591833 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:33.348009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35e7fc-11c9-4b28-b933-8acd80591833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:33.357653 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35e7fc-11c9-4b28-b933-8acd80591833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:33.359228 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35e7fc-11c9-4b28-b933-8acd80591833 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:33.373094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-2b35e7fc-11c9-4b28-b933-8acd80591833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:33.373094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:33.373094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:33.373094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:33.373094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:33.373094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:33.373094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:33.373094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:33.373094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:33.373094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:33.373094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:33.373094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:33.373094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:44:33.373094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:44:33.373094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:44:33.373094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:44:33.374243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:33.374243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:33.374243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:33.374243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:33.374243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:33.374243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:33.374243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:33.374243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:33.374243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:33.374243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:33.374243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:33.374243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:33.374243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:33.374243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:33.374243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:33.374243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:33.374243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:44:33.375372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:44:33.375372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:33.375372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:44:33.375372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 635/1278] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:33.380666 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263b889-b745-4f78-bbb9-77c7c99a63fa None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:33.478345 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263b889-b745-4f78-bbb9-77c7c99a63fa None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:33.511136 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b292f-0101-4d72-a473-b9cf6d10b8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:33.511730 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b292f-0101-4d72-a473-b9cf6d10b8be None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:33.512005 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b292f-0101-4d72-a473-b9cf6d10b8be None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:33.512270 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b292f-0101-4d72-a473-b9cf6d10b8be None admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:33.512920 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b292f-0101-4d72-a473-b9cf6d10b8be None admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:33.513218 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b292f-0101-4d72-a473-b9cf6d10b8be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:33.514597 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b292f-0101-4d72-a473-b9cf6d10b8be None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:33.526546 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 644/1279] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:33.532225 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35e7fc-11c9-4b28-b933-8acd80591833 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:33.562254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:33.629225 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35e7fc-11c9-4b28-b933-8acd80591833 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:33.663863 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e88a60-2c18-4218-ab9e-d38c2fd7312b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:33.664517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e88a60-2c18-4218-ab9e-d38c2fd7312b None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:33.664791 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e88a60-2c18-4218-ab9e-d38c2fd7312b None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:33.665060 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e88a60-2c18-4218-ab9e-d38c2fd7312b None admin] PATH_INFO: `/v3/users/placement` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:33.672626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e88a60-2c18-4218-ab9e-d38c2fd7312b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:33.674060 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e88a60-2c18-4218-ab9e-d38c2fd7312b None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:33.685505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-e9e88a60-2c18-4218-ab9e-d38c2fd7312b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 11 09:44:33.685505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:33.685505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:33.685505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:33.685505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:33.685505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:33.685505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:33.685505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:33.685505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:33.685505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:33.685505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:33.685505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:33.685505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 09:44:33.685505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 09:44:33.685505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 09:44:33.685505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 09:44:33.686699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:33.686699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:33.686699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 09:44:33.686699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:44:33.686699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 09:44:33.686699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 09:44:33.686699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:33.686699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:33.686699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:33.686699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:33.686699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:33.686699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:33.686699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:33.686699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:33.686699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:33.686699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:33.686699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:33.686699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:33.687716 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:33.687716 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:33.687716 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 09:44:33.687716 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 09:44:33.687716 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 09:44:33.687716 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 09:44:33.687716 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 09:44:33.687716 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 09:44:33.687716 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 11 09:44:33.687716 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:44:33.687716 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 636/1280] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:44:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:33.693007 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b292f-0101-4d72-a473-b9cf6d10b8be None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:33.696832 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:33.791523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b292f-0101-4d72-a473-b9cf6d10b8be None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:33.825214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71771f8d-7d99-4bce-9864-46c12e25a9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:33.825816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71771f8d-7d99-4bce-9864-46c12e25a9da None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:33.826067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71771f8d-7d99-4bce-9864-46c12e25a9da None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:33.826402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71771f8d-7d99-4bce-9864-46c12e25a9da None admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:33.827136 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71771f8d-7d99-4bce-9864-46c12e25a9da None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:33.827436 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71771f8d-7d99-4bce-9864-46c12e25a9da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:33.828852 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71771f8d-7d99-4bce-9864-46c12e25a9da None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:33.846013 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 645/1281] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Aug 11 09:44:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:33.851871 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e88a60-2c18-4218-ab9e-d38c2fd7312b None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:33.942783 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:33.951677 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e88a60-2c18-4218-ab9e-d38c2fd7312b None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:33.982979 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d7bbc-2eb4-4555-b954-52aa274d6668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:33.983568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d7bbc-2eb4-4555-b954-52aa274d6668 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:33.983843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d7bbc-2eb4-4555-b954-52aa274d6668 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:33.984110 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d7bbc-2eb4-4555-b954-52aa274d6668 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:34.051143 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d7bbc-2eb4-4555-b954-52aa274d6668 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:34.052509 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d7bbc-2eb4-4555-b954-52aa274d6668 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:34.145112 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:34.154996 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 637/1282] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Aug 11 09:44:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 09:44:34.161384 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71771f8d-7d99-4bce-9864-46c12e25a9da None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:34.219807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:34.259218 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71771f8d-7d99-4bce-9864-46c12e25a9da None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:34.291637 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c5a7c-8cb5-417c-b8e4-bb04e1334d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:34.292247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c5a7c-8cb5-417c-b8e4-bb04e1334d56 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:34.292517 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c5a7c-8cb5-417c-b8e4-bb04e1334d56 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:34.292779 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c5a7c-8cb5-417c-b8e4-bb04e1334d56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:34.303788 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c5a7c-8cb5-417c-b8e4-bb04e1334d56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:34.305168 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c5a7c-8cb5-417c-b8e4-bb04e1334d56 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:34.319333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-fa1c5a7c-8cb5-417c-b8e4-bb04e1334d56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:34.319333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:34.319333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:34.319333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:34.319333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:34.319333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:34.319333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:34.319333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:34.319333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:34.319333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:34.319333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:34.319333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:34.319333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 09:44:34.319333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 09:44:34.319333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 09:44:34.319333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 09:44:34.320443 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:34.320443 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:34.320443 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:34.320443 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:34.320443 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:34.320443 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:34.320443 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:34.320443 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:34.320443 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:34.320443 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:34.320443 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:34.320443 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:34.320443 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:34.320443 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:34.320443 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:34.320443 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:34.320443 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 09:44:34.321747 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 09:44:34.321747 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 09:44:34.321747 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:44:34.321747 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 646/1283] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:44:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:34.326187 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d7bbc-2eb4-4555-b954-52aa274d6668 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:34.430701 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d7bbc-2eb4-4555-b954-52aa274d6668 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:34.464914 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a70164-175f-4143-96f9-b341871109a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:34.465503 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a70164-175f-4143-96f9-b341871109a3 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:34.465774 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a70164-175f-4143-96f9-b341871109a3 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:34.466039 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a70164-175f-4143-96f9-b341871109a3 None admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:34.466690 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a70164-175f-4143-96f9-b341871109a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:34.466980 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a70164-175f-4143-96f9-b341871109a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:34.468346 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a70164-175f-4143-96f9-b341871109a3 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:34.479652 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 638/1284] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Aug 11 09:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:34.485536 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c5a7c-8cb5-417c-b8e4-bb04e1334d56 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:34.581506 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c5a7c-8cb5-417c-b8e4-bb04e1334d56 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:34.594675 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:34.614107 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4c0d3-0e50-4aa3-b6a0-5e9410078c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:34.614789 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4c0d3-0e50-4aa3-b6a0-5e9410078c36 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:34.615157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4c0d3-0e50-4aa3-b6a0-5e9410078c36 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:34.615433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4c0d3-0e50-4aa3-b6a0-5e9410078c36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:34.621942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4c0d3-0e50-4aa3-b6a0-5e9410078c36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:34.623397 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4c0d3-0e50-4aa3-b6a0-5e9410078c36 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:34.634072 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application [None req-39d4c0d3-0e50-4aa3-b6a0-5e9410078c36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:44:34.634072 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:34.634072 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:34.634072 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:34.634072 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:34.634072 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:34.634072 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:34.634072 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:34.634072 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:34.634072 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:34.634072 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:34.634072 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:34.634072 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 09:44:34.634072 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 09:44:34.634072 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 09:44:34.635158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 09:44:34.635158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:34.635158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:34.635158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:34.635158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:34.635158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:34.635158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:34.635158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:34.635158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:34.635158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:34.635158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:34.635158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:34.635158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:34.635158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:34.635158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:34.635158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:34.635158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:34.636109 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 09:44:34.636109 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 09:44:34.636109 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 09:44:34.636109 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 09:44:34.636109 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 09:44:34.636109 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 09:44:34.636109 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 09:44:34.636109 dv-cinder-815660-9-smb devstack@keystone.service[98478]: ERROR keystone.server.flask.application Aug 11 09:44:34.636109 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 647/1285] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Aug 11 09:44:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:34.641112 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a70164-175f-4143-96f9-b341871109a3 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:34.690581 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:34.746102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a70164-175f-4143-96f9-b341871109a3 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:34.778670 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ec33b-cb8f-4f0d-8758-2d8a872b4a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:34.779258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ec33b-cb8f-4f0d-8758-2d8a872b4a87 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:34.779533 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ec33b-cb8f-4f0d-8758-2d8a872b4a87 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:34.779800 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ec33b-cb8f-4f0d-8758-2d8a872b4a87 None admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:34.780488 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ec33b-cb8f-4f0d-8758-2d8a872b4a87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:34.780773 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ec33b-cb8f-4f0d-8758-2d8a872b4a87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:34.782228 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ec33b-cb8f-4f0d-8758-2d8a872b4a87 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:34.794566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 639/1286] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Aug 11 09:44:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:34.800956 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4c0d3-0e50-4aa3-b6a0-5e9410078c36 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:34.898358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4c0d3-0e50-4aa3-b6a0-5e9410078c36 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:34.929884 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2d37b-57ca-43c9-93dc-7507e9b74341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:34.930490 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2d37b-57ca-43c9-93dc-7507e9b74341 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:34.930762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2d37b-57ca-43c9-93dc-7507e9b74341 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:34.931026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2d37b-57ca-43c9-93dc-7507e9b74341 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:34.931720 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2d37b-57ca-43c9-93dc-7507e9b74341 None admin] RBAC: Adding query filter params (role.id=6aae1c66f3f04cec80ed72c20d7e033b, scope.project.id=a0211f5c0b174c8c998e3ad29f96baab, user.id=0061ce46df224f4491599ed10548b2ae) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:34.932020 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2d37b-57ca-43c9-93dc-7507e9b74341 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:34.933426 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2d37b-57ca-43c9-93dc-7507e9b74341 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:34.939197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 648/1287] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Aug 11 09:44:34 2022] GET /identity/v3/role_assignments?user.id=0061ce46df224f4491599ed10548b2ae&scope.project.id=a0211f5c0b174c8c998e3ad29f96baab&role.id=6aae1c66f3f04cec80ed72c20d7e033b => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:36.953427 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7c01a-f10a-44e7-b3e1-8c470b7b043f None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:36.953953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7c01a-f10a-44e7-b3e1-8c470b7b043f None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:36.953953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7c01a-f10a-44e7-b3e1-8c470b7b043f None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:36.955278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 640/1288] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:44:36.960260 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192afdcf-c5ea-4e2f-a4d9-fba12ab97256 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:36.960635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192afdcf-c5ea-4e2f-a4d9-fba12ab97256 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:36.960799 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192afdcf-c5ea-4e2f-a4d9-fba12ab97256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:36.978427 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-192afdcf-c5ea-4e2f-a4d9-fba12ab97256 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:44:36.979587 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-192afdcf-c5ea-4e2f-a4d9-fba12ab97256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:44:37.009011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:37.044977 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 649/1289] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:44:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:44:37.067629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7c01a-f10a-44e7-b3e1-8c470b7b043f None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:37.166887 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7c01a-f10a-44e7-b3e1-8c470b7b043f None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:37.178107 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:37.200277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338aa686-3518-44ff-8c77-fb388e443e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:37.200896 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338aa686-3518-44ff-8c77-fb388e443e40 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:37.201177 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338aa686-3518-44ff-8c77-fb388e443e40 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:37.201442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338aa686-3518-44ff-8c77-fb388e443e40 None admin] PATH_INFO: `/v3/services/placement` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:37.202016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338aa686-3518-44ff-8c77-fb388e443e40 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:37.203401 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338aa686-3518-44ff-8c77-fb388e443e40 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:37.211822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-338aa686-3518-44ff-8c77-fb388e443e40 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 09:44:37.211822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:37.211822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:44:37.211822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:44:37.211822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:44:37.211822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:44:37.211822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:44:37.211822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:44:37.211822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 09:44:37.211822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:44:37.211822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:44:37.211822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:44:37.211822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:37.211822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:37.211822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:37.211822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:37.211822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:37.213076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:37.213076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:37.213076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:37.213076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:37.213076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:37.213076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:37.213076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:44:37.213076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:44:37.213076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:44:37.213076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:44:37.213076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:37.213076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:37.213076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:37.213076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:37.213076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:37.213076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:37.214021 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:37.214021 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:37.214021 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:37.214021 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:37.214021 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:37.214021 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:37.214021 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:37.214021 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:37.214021 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:37.214021 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:37.214021 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:44:37.214021 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:44:37.214021 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 09:44:37.214021 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:44:37.218187 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 641/1290] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Aug 11 09:44:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:37.220618 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192afdcf-c5ea-4e2f-a4d9-fba12ab97256 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:37.325784 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192afdcf-c5ea-4e2f-a4d9-fba12ab97256 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:37.363868 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23149ce3-8652-4f0c-91c9-117c7789c22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:37.364483 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23149ce3-8652-4f0c-91c9-117c7789c22a None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:37.364752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23149ce3-8652-4f0c-91c9-117c7789c22a None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:37.365016 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23149ce3-8652-4f0c-91c9-117c7789c22a None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:37.365649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23149ce3-8652-4f0c-91c9-117c7789c22a None admin] RBAC: Adding query filter params (name=placement) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:37.365941 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23149ce3-8652-4f0c-91c9-117c7789c22a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:37.367366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23149ce3-8652-4f0c-91c9-117c7789c22a None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:37.372668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 650/1291] 10.222.0.13 () {56 vars in 1116 bytes} [Thu Aug 11 09:44:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:44:37.378939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338aa686-3518-44ff-8c77-fb388e443e40 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:37.487076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338aa686-3518-44ff-8c77-fb388e443e40 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:37.522372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1127f8c-f304-4afd-a1a4-e013ff1d006e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:37.522988 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1127f8c-f304-4afd-a1a4-e013ff1d006e None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:37.523265 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1127f8c-f304-4afd-a1a4-e013ff1d006e None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:37.523534 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1127f8c-f304-4afd-a1a4-e013ff1d006e None admin] PATH_INFO: `/v3/services` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:37.524170 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1127f8c-f304-4afd-a1a4-e013ff1d006e None admin] RBAC: Adding query filter params (type=placement) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:37.524493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1127f8c-f304-4afd-a1a4-e013ff1d006e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:37.525853 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1127f8c-f304-4afd-a1a4-e013ff1d006e None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:37.530461 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 642/1292] 10.222.0.13 () {56 vars in 1116 bytes} [Thu Aug 11 09:44:37 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:39.522617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346877a-caef-4664-a3ba-442ef96e93a7 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:39.523150 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346877a-caef-4664-a3ba-442ef96e93a7 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:39.523150 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346877a-caef-4664-a3ba-442ef96e93a7 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:39.524451 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 651/1293] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:44:39.529800 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdbe27-3609-4f93-bcb1-cb08e2a5f194 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:39.530224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdbe27-3609-4f93-bcb1-cb08e2a5f194 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:39.530371 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdbe27-3609-4f93-bcb1-cb08e2a5f194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:39.547945 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-82bdbe27-3609-4f93-bcb1-cb08e2a5f194 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:44:39.549116 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-82bdbe27-3609-4f93-bcb1-cb08e2a5f194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:44:39.577947 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:39.613150 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 643/1294] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:44:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:44:39.636608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346877a-caef-4664-a3ba-442ef96e93a7 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:39.670155 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:39.738347 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346877a-caef-4664-a3ba-442ef96e93a7 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:39.770522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6ab9f-abe7-4672-b311-bd7c3a52511c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:39.771117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6ab9f-abe7-4672-b311-bd7c3a52511c None admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:39.771392 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6ab9f-abe7-4672-b311-bd7c3a52511c None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:39.771659 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6ab9f-abe7-4672-b311-bd7c3a52511c None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:39.772282 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6ab9f-abe7-4672-b311-bd7c3a52511c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:39.777595 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6ab9f-abe7-4672-b311-bd7c3a52511c None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:39.871816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 652/1295] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Aug 11 09:44:39 2022] POST /identity/v3/services => generated 246 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:44:41.851626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f018b3-fa54-4562-9515-e79d6772b9af None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:41.852175 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f018b3-fa54-4562-9515-e79d6772b9af None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:41.852175 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f018b3-fa54-4562-9515-e79d6772b9af None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:41.853504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 644/1296] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:44:41.858831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69761d58-f44d-44ee-8dd0-f966071d2bbc None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:41.859910 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69761d58-f44d-44ee-8dd0-f966071d2bbc None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:41.859910 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69761d58-f44d-44ee-8dd0-f966071d2bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:41.877193 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-69761d58-f44d-44ee-8dd0-f966071d2bbc None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:44:41.878949 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-69761d58-f44d-44ee-8dd0-f966071d2bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:44:41.949736 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 653/1297] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:44:41 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:44:41.971831 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f018b3-fa54-4562-9515-e79d6772b9af None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:42.069990 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f018b3-fa54-4562-9515-e79d6772b9af None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:42.102171 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56143b73-a12f-4d47-9963-dd150bf0883e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:42.102799 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56143b73-a12f-4d47-9963-dd150bf0883e None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:42.103065 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56143b73-a12f-4d47-9963-dd150bf0883e None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:42.103333 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56143b73-a12f-4d47-9963-dd150bf0883e None admin] PATH_INFO: `/v3/services/placement` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:42.103911 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56143b73-a12f-4d47-9963-dd150bf0883e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:42.105268 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56143b73-a12f-4d47-9963-dd150bf0883e None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:42.114277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-56143b73-a12f-4d47-9963-dd150bf0883e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 09:44:42.114277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:42.114277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:44:42.114277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:44:42.114277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:44:42.114277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:44:42.114277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:44:42.114277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:44:42.114277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 09:44:42.114277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:44:42.114277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:44:42.114277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:44:42.114277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:42.114277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:42.114277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:42.114277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:42.114277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:42.115460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:42.115460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:42.115460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:42.115460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:42.115460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:42.115460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:42.115460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:44:42.115460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:44:42.115460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:44:42.115460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:44:42.115460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:42.115460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:42.115460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:42.115460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:42.115460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:42.115460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:42.116355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:42.116355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:42.116355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:42.116355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:42.116355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:42.116355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:42.116355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:42.116355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:42.116355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:42.116355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:42.116355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:44:42.116355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:44:42.116355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 09:44:42.116355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:44:42.116355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 645/1298] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Aug 11 09:44:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:42.121432 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69761d58-f44d-44ee-8dd0-f966071d2bbc None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:42.140033 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:42.215928 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69761d58-f44d-44ee-8dd0-f966071d2bbc None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:42.248785 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eecfa5-5f2c-462f-905b-4cd1b4b754d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:42.249373 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eecfa5-5f2c-462f-905b-4cd1b4b754d8 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:42.249646 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eecfa5-5f2c-462f-905b-4cd1b4b754d8 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:42.249910 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eecfa5-5f2c-462f-905b-4cd1b4b754d8 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:42.250546 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eecfa5-5f2c-462f-905b-4cd1b4b754d8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:42.250840 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eecfa5-5f2c-462f-905b-4cd1b4b754d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:42.252328 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eecfa5-5f2c-462f-905b-4cd1b4b754d8 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:42.257791 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 654/1299] 10.222.0.13 () {56 vars in 1116 bytes} [Thu Aug 11 09:44:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:42.263748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56143b73-a12f-4d47-9963-dd150bf0883e None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:42.294588 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:42.360335 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56143b73-a12f-4d47-9963-dd150bf0883e None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:42.395151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafce80-e852-4b5b-8b7b-79a381624a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:42.395982 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafce80-e852-4b5b-8b7b-79a381624a69 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:42.395982 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafce80-e852-4b5b-8b7b-79a381624a69 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:42.397211 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafce80-e852-4b5b-8b7b-79a381624a69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:42.399196 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafce80-e852-4b5b-8b7b-79a381624a69 None admin] RBAC: Adding query filter params (interface=public, service_id=cfef9ab3cef5480e8c13e1915d973197, region_id=RegionOne) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:42.400636 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafce80-e852-4b5b-8b7b-79a381624a69 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:42.402216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafce80-e852-4b5b-8b7b-79a381624a69 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:42.407212 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 646/1300] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Aug 11 09:44:42 2022] GET /identity/v3/endpoints?service_id=cfef9ab3cef5480e8c13e1915d973197&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:42.413372 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eecfa5-5f2c-462f-905b-4cd1b4b754d8 None admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:42.494804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:42.511915 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eecfa5-5f2c-462f-905b-4cd1b4b754d8 None admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:42.544698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9422c1-5730-4b29-b9ab-5a4674f98655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:42.545292 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9422c1-5730-4b29-b9ab-5a4674f98655 None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:42.545650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9422c1-5730-4b29-b9ab-5a4674f98655 None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:42.545988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9422c1-5730-4b29-b9ab-5a4674f98655 None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:42.546609 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9422c1-5730-4b29-b9ab-5a4674f98655 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:42.547957 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9422c1-5730-4b29-b9ab-5a4674f98655 None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:42.555571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 655/1301] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Aug 11 09:44:42 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:44:44.531032 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4a7c7-3a1c-4a6d-9e99-029fda72a119 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:44.531604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4a7c7-3a1c-4a6d-9e99-029fda72a119 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:44.531604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4a7c7-3a1c-4a6d-9e99-029fda72a119 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:44.532904 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 647/1302] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:44:44.538524 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcef57-059f-4a60-af26-c84fe4bc8ed1 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:44.538946 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcef57-059f-4a60-af26-c84fe4bc8ed1 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:44.539063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcef57-059f-4a60-af26-c84fe4bc8ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:44.556862 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-b9dcef57-059f-4a60-af26-c84fe4bc8ed1 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:44:44.558021 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-b9dcef57-059f-4a60-af26-c84fe4bc8ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:44:44.622750 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 656/1303] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:44:44 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 09:44:44.646318 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4a7c7-3a1c-4a6d-9e99-029fda72a119 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:44.739198 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:44.745650 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4a7c7-3a1c-4a6d-9e99-029fda72a119 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:44.778222 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2af93-f684-4d60-b356-198066996962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:44.778830 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2af93-f684-4d60-b356-198066996962 None admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:44.779101 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2af93-f684-4d60-b356-198066996962 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:44.779366 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2af93-f684-4d60-b356-198066996962 None admin] PATH_INFO: `/v3/services/placement` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:44.779929 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2af93-f684-4d60-b356-198066996962 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:44.781320 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2af93-f684-4d60-b356-198066996962 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:44.789562 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application [None req-47b2af93-f684-4d60-b356-198066996962 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 09:44:44.789562 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:44.789562 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 09:44:44.789562 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 09:44:44.789562 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 09:44:44.789562 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 09:44:44.789562 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 09:44:44.789562 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:44:44.789562 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 09:44:44.789562 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:44:44.789562 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 09:44:44.789562 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:44:44.789562 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 09:44:44.789562 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 09:44:44.789562 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 09:44:44.789562 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 09:44:44.789562 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 09:44:44.790835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 09:44:44.790835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 09:44:44.790835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 09:44:44.790835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 09:44:44.790835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 09:44:44.790835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 09:44:44.790835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 09:44:44.790835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 09:44:44.790835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 09:44:44.790835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 09:44:44.790835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 09:44:44.790835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 09:44:44.790835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 09:44:44.790835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 09:44:44.790835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 09:44:44.790835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 09:44:44.791953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 09:44:44.791953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application with Lock( Aug 11 09:44:44.791953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 09:44:44.791953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self._enter() Aug 11 09:44:44.791953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 09:44:44.791953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 09:44:44.791953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 09:44:44.791953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application return self.creator() Aug 11 09:44:44.791953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 09:44:44.791953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application created_value = creator( Aug 11 09:44:44.791953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 09:44:44.791953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 09:44:44.791953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 09:44:44.791953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: ERROR keystone.server.flask.application Aug 11 09:44:44.791953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 648/1304] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Aug 11 09:44:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 09:44:44.796601 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcef57-059f-4a60-af26-c84fe4bc8ed1 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:44.869437 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:44.891416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcef57-059f-4a60-af26-c84fe4bc8ed1 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:44.924769 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95a6a1-7ae4-4495-b0e0-815796ed422d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:44.926163 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95a6a1-7ae4-4495-b0e0-815796ed422d None admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:44.926438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95a6a1-7ae4-4495-b0e0-815796ed422d None admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:44.926704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95a6a1-7ae4-4495-b0e0-815796ed422d None admin] PATH_INFO: `/v3/services` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:44.927313 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95a6a1-7ae4-4495-b0e0-815796ed422d None admin] RBAC: Adding query filter params (name=placement) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:44:44.927604 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95a6a1-7ae4-4495-b0e0-815796ed422d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:44.928973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95a6a1-7ae4-4495-b0e0-815796ed422d None admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:44.933838 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 657/1305] 10.222.0.13 () {56 vars in 1116 bytes} [Thu Aug 11 09:44:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:44:44.939556 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2af93-f684-4d60-b356-198066996962 None admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:44:45.036459 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2af93-f684-4d60-b356-198066996962 None admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:44:45.069243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27267513-80d7-4ac1-8b46-a7c7c1900880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:44:45.070725 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27267513-80d7-4ac1-8b46-a7c7c1900880 None admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:44:45.070725 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27267513-80d7-4ac1-8b46-a7c7c1900880 None admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:44:45.070725 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27267513-80d7-4ac1-8b46-a7c7c1900880 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:44:45.071034 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27267513-80d7-4ac1-8b46-a7c7c1900880 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:44:45.072389 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27267513-80d7-4ac1-8b46-a7c7c1900880 None admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:44:45.245511 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 649/1306] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:44:44 2022] POST /identity/v3/endpoints => generated 331 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 09:44:54.931035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=30 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:44:55.241069 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:50:34.418954 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a6de0-b9fe-4492-b5ce-69550f2368a4 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:34.421374 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a6de0-b9fe-4492-b5ce-69550f2368a4 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:34.421374 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a6de0-b9fe-4492-b5ce-69550f2368a4 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:34.423360 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 658/1307] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:50:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:50:34.426190 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e38ad-1fa7-4189-a119-beb68df40d31 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:34.426643 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e38ad-1fa7-4189-a119-beb68df40d31 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:34.426741 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e38ad-1fa7-4189-a119-beb68df40d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:34.502970 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-be0e38ad-1fa7-4189-a119-beb68df40d31 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:50:34.507868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-be0e38ad-1fa7-4189-a119-beb68df40d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:34.648105 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 650/1308] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:50:34.677156 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edfb17-9c85-4a82-8521-43bc5dde7750 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:34.678116 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edfb17-9c85-4a82-8521-43bc5dde7750 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:34.678468 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edfb17-9c85-4a82-8521-43bc5dde7750 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:34.680281 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 659/1309] 10.222.0.13 () {54 vars in 965 bytes} [Thu Aug 11 09:50:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:50:34.691537 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eed31-92fe-4952-b974-bac10e603569 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:34.691870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eed31-92fe-4952-b974-bac10e603569 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:34.692047 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eed31-92fe-4952-b974-bac10e603569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:34.824552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-282eed31-92fe-4952-b974-bac10e603569 None None] MFA Rules not processed for user `4ac6ca32b5144c59b2bb5086fbd53ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:50:34.826247 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-282eed31-92fe-4952-b974-bac10e603569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:34.849400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:50:34.919464 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 651/1310] 10.222.0.13 () {58 vars in 1062 bytes} [Thu Aug 11 09:50:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:50:34.936862 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edfb17-9c85-4a82-8521-43bc5dde7750 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:50:34.936862 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-d8edfb17-9c85-4a82-8521-43bc5dde7750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:35.060827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edfb17-9c85-4a82-8521-43bc5dde7750 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:50:35.218402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4ead1-8a87-4958-bb6d-60416d5a3a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:50:35.218402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4ead1-8a87-4958-bb6d-60416d5a3a4c service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:35.218402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4ead1-8a87-4958-bb6d-60416d5a3a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:35.218402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4ead1-8a87-4958-bb6d-60416d5a3a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:35.219282 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-b7a4ead1-8a87-4958-bb6d-60416d5a3a4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:35.219282 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:50:35.257613 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4ead1-8a87-4958-bb6d-60416d5a3a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:50:35.264686 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4ead1-8a87-4958-bb6d-60416d5a3a4c service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:50:35.280247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 660/1311] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:50:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 09:50:37.597153 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714af992-e7a0-4676-bea7-3cc3118776d3 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:37.597747 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714af992-e7a0-4676-bea7-3cc3118776d3 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:37.597747 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714af992-e7a0-4676-bea7-3cc3118776d3 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:37.599295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 652/1312] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:50:37.604855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb71975-16be-47cf-b5c3-c46d113b6606 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:37.605399 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb71975-16be-47cf-b5c3-c46d113b6606 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:37.605399 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb71975-16be-47cf-b5c3-c46d113b6606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:37.700042 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-acb71975-16be-47cf-b5c3-c46d113b6606 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:50:37.701283 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-acb71975-16be-47cf-b5c3-c46d113b6606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:37.814104 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 661/1313] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:50:37.845194 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714af992-e7a0-4676-bea7-3cc3118776d3 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:50:37.846985 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-714af992-e7a0-4676-bea7-3cc3118776d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:37.973115 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714af992-e7a0-4676-bea7-3cc3118776d3 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:50:38.049261 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:50:38.051625 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09cb30-b728-4d6c-bf73-e118a0e58301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:50:38.052221 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09cb30-b728-4d6c-bf73-e118a0e58301 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:38.053105 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09cb30-b728-4d6c-bf73-e118a0e58301 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:38.053367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09cb30-b728-4d6c-bf73-e118a0e58301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:38.054967 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-6c09cb30-b728-4d6c-bf73-e118a0e58301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:38.161433 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09cb30-b728-4d6c-bf73-e118a0e58301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:50:38.163410 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09cb30-b728-4d6c-bf73-e118a0e58301 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:50:38.181993 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 653/1314] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:50:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:50:40.684323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bae97-9720-496f-b82e-9374f942e14d None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:40.684781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bae97-9720-496f-b82e-9374f942e14d None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:40.684875 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bae97-9720-496f-b82e-9374f942e14d None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:40.686264 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 662/1315] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:50:40.691263 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8edd5-b747-4805-ade1-f23e084e81c1 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:40.691642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8edd5-b747-4805-ade1-f23e084e81c1 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:40.691805 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8edd5-b747-4805-ade1-f23e084e81c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:40.756001 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-f1f8edd5-b747-4805-ade1-f23e084e81c1 None None] MFA Rules not processed for user `df154087f69f4bfab45c05e2ee8526a3`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:50:40.757184 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-f1f8edd5-b747-4805-ade1-f23e084e81c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:40.806975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:50:40.849539 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 654/1316] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:50:40 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:50:40.892839 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bae97-9720-496f-b82e-9374f942e14d None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:50:40.894390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-a38bae97-9720-496f-b82e-9374f942e14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:40.903910 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:50:40.994055 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bae97-9720-496f-b82e-9374f942e14d None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:50:41.082721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b37a87-578e-45c7-9e6b-0f11de1b9e40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:50:41.083316 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b37a87-578e-45c7-9e6b-0f11de1b9e40 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:41.083610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b37a87-578e-45c7-9e6b-0f11de1b9e40 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:41.083844 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b37a87-578e-45c7-9e6b-0f11de1b9e40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:41.085414 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-15b37a87-578e-45c7-9e6b-0f11de1b9e40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:41.144458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:50:41.188945 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b37a87-578e-45c7-9e6b-0f11de1b9e40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:50:41.190375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b37a87-578e-45c7-9e6b-0f11de1b9e40 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:50:41.208129 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 663/1317] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:50:40 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:50:43.992366 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc281bd1-cbd4-407f-9ad9-e5853427107c None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:43.992833 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc281bd1-cbd4-407f-9ad9-e5853427107c None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:43.992926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc281bd1-cbd4-407f-9ad9-e5853427107c None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:43.994286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 655/1318] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:50:43.999557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c64bba-f81a-49cc-a833-5044c409b09d None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:43.999995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c64bba-f81a-49cc-a833-5044c409b09d None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:44.000093 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c64bba-f81a-49cc-a833-5044c409b09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:44.073374 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-a4c64bba-f81a-49cc-a833-5044c409b09d None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:50:44.074605 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-a4c64bba-f81a-49cc-a833-5044c409b09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:44.168192 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 664/1319] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:50:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:50:44.222707 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11cce1-ff28-4ca7-9d4e-ba2f2b045417 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:44.222889 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11cce1-ff28-4ca7-9d4e-ba2f2b045417 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:44.223158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11cce1-ff28-4ca7-9d4e-ba2f2b045417 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:44.224494 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 656/1320] 10.222.0.13 () {54 vars in 965 bytes} [Thu Aug 11 09:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:50:44.230198 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38a240-f289-4feb-9a45-e7af876d633c None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:44.230487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38a240-f289-4feb-9a45-e7af876d633c None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:44.230758 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38a240-f289-4feb-9a45-e7af876d633c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:44.251897 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:50:44.304272 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-3b38a240-f289-4feb-9a45-e7af876d633c None None] MFA Rules not processed for user `4ac6ca32b5144c59b2bb5086fbd53ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:50:44.305492 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-3b38a240-f289-4feb-9a45-e7af876d633c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:44.379154 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 665/1321] 10.222.0.13 () {58 vars in 1062 bytes} [Thu Aug 11 09:50:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:50:44.389043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11cce1-ff28-4ca7-9d4e-ba2f2b045417 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:50:44.390639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-cc11cce1-ff28-4ca7-9d4e-ba2f2b045417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:44.494204 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11cce1-ff28-4ca7-9d4e-ba2f2b045417 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:50:44.564383 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1ffed-3cd5-4137-97e6-605ebb65fe9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:50:44.564975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1ffed-3cd5-4137-97e6-605ebb65fe9f service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:44.565245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1ffed-3cd5-4137-97e6-605ebb65fe9f service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:44.565509 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1ffed-3cd5-4137-97e6-605ebb65fe9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:44.567101 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-44b1ffed-3cd5-4137-97e6-605ebb65fe9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:44.575820 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:50:44.672747 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1ffed-3cd5-4137-97e6-605ebb65fe9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:50:44.674263 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1ffed-3cd5-4137-97e6-605ebb65fe9f service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:50:44.696005 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 657/1322] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:50:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:50:48.141776 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e5004-ea55-42b5-81a0-058dd01f0b22 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:48.142340 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e5004-ea55-42b5-81a0-058dd01f0b22 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:48.142340 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e5004-ea55-42b5-81a0-058dd01f0b22 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:48.143673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 666/1323] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:50:48.149158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc901422-d3df-4548-85e9-bc89b6c57a91 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:48.149590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc901422-d3df-4548-85e9-bc89b6c57a91 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:48.149687 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc901422-d3df-4548-85e9-bc89b6c57a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:48.215778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-fc901422-d3df-4548-85e9-bc89b6c57a91 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:50:48.216894 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-fc901422-d3df-4548-85e9-bc89b6c57a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:48.274111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:50:48.314890 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 658/1324] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:50:48.353271 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e5004-ea55-42b5-81a0-058dd01f0b22 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:50:48.354839 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ec3e5004-ea55-42b5-81a0-058dd01f0b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:48.464623 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e5004-ea55-42b5-81a0-058dd01f0b22 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:50:48.478248 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:50:48.542616 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade9ceb-4c6e-4714-a07c-de2e5f2f9413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:50:48.543218 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade9ceb-4c6e-4714-a07c-de2e5f2f9413 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:48.543497 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade9ceb-4c6e-4714-a07c-de2e5f2f9413 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:48.543765 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade9ceb-4c6e-4714-a07c-de2e5f2f9413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:48.545384 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-5ade9ceb-4c6e-4714-a07c-de2e5f2f9413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:48.658660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade9ceb-4c6e-4714-a07c-de2e5f2f9413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:50:48.660102 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade9ceb-4c6e-4714-a07c-de2e5f2f9413 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:50:48.677812 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 667/1325] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:50:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:50:50.739923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6489d0-acd7-47b6-90c9-947f47ab7488 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:50.740478 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6489d0-acd7-47b6-90c9-947f47ab7488 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:50.740478 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6489d0-acd7-47b6-90c9-947f47ab7488 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:50.741944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 659/1326] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:50:50.746916 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544cf09-5b80-4523-ae26-30b8a33f5b81 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:50.747318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544cf09-5b80-4523-ae26-30b8a33f5b81 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:50.747465 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544cf09-5b80-4523-ae26-30b8a33f5b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:50.796585 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:50:50.814650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-a544cf09-5b80-4523-ae26-30b8a33f5b81 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:50:50.815860 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-a544cf09-5b80-4523-ae26-30b8a33f5b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:50.909221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 668/1327] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:50:50.945595 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6489d0-acd7-47b6-90c9-947f47ab7488 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:50:50.947284 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-ab6489d0-acd7-47b6-90c9-947f47ab7488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:51.050858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6489d0-acd7-47b6-90c9-947f47ab7488 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:50:51.123888 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed2f7f-ce8c-4b62-8ffe-c251901c954a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:50:51.124496 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed2f7f-ce8c-4b62-8ffe-c251901c954a service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:51.124769 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed2f7f-ce8c-4b62-8ffe-c251901c954a service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:51.125038 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed2f7f-ce8c-4b62-8ffe-c251901c954a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:51.126635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-1bed2f7f-ce8c-4b62-8ffe-c251901c954a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:51.142871 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:50:51.241420 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed2f7f-ce8c-4b62-8ffe-c251901c954a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:50:51.242892 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed2f7f-ce8c-4b62-8ffe-c251901c954a service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:50:51.260624 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 660/1328] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:50:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:50:53.336000 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bc7b9-483f-4297-a365-8bdbabff9d49 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:53.336537 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bc7b9-483f-4297-a365-8bdbabff9d49 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:53.336537 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bc7b9-483f-4297-a365-8bdbabff9d49 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:53.337914 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 669/1329] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:50:53.343251 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a3734-24db-44c5-ba91-3dcd39ab02e5 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:53.343703 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a3734-24db-44c5-ba91-3dcd39ab02e5 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:53.343816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a3734-24db-44c5-ba91-3dcd39ab02e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:53.408366 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-300a3734-24db-44c5-ba91-3dcd39ab02e5 None None] MFA Rules not processed for user `df154087f69f4bfab45c05e2ee8526a3`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:50:53.409556 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-300a3734-24db-44c5-ba91-3dcd39ab02e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:53.474496 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:50:53.507306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 661/1330] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:50:53 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:50:53.545458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bc7b9-483f-4297-a365-8bdbabff9d49 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:50:53.547029 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-894bc7b9-483f-4297-a365-8bdbabff9d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:53.652291 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bc7b9-483f-4297-a365-8bdbabff9d49 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:50:53.672908 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:50:53.726726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81cf61-c2f5-43ce-a88f-cdebccaea46d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:50:53.727241 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81cf61-c2f5-43ce-a88f-cdebccaea46d service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:53.727511 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81cf61-c2f5-43ce-a88f-cdebccaea46d service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:53.727781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81cf61-c2f5-43ce-a88f-cdebccaea46d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:53.729343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-bd81cf61-c2f5-43ce-a88f-cdebccaea46d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:53.838846 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81cf61-c2f5-43ce-a88f-cdebccaea46d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:50:53.840274 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81cf61-c2f5-43ce-a88f-cdebccaea46d service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:50:53.858204 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 670/1331] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:50:53 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:50:56.365863 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad109a65-4061-412d-85e6-e4fb9d6dbd02 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:56.366462 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad109a65-4061-412d-85e6-e4fb9d6dbd02 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:56.366462 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad109a65-4061-412d-85e6-e4fb9d6dbd02 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:56.367752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 662/1332] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:50:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:50:56.373103 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7aa93-7c4e-4156-a9cf-bbda17ba24df None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:56.373528 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7aa93-7c4e-4156-a9cf-bbda17ba24df None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:56.373643 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7aa93-7c4e-4156-a9cf-bbda17ba24df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:56.435420 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:50:56.437981 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-97f7aa93-7c4e-4156-a9cf-bbda17ba24df None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:50:56.439188 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-97f7aa93-7c4e-4156-a9cf-bbda17ba24df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:56.534762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 671/1333] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:50:56.570874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad109a65-4061-412d-85e6-e4fb9d6dbd02 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:50:56.572452 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-ad109a65-4061-412d-85e6-e4fb9d6dbd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:56.673615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad109a65-4061-412d-85e6-e4fb9d6dbd02 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:50:56.746238 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d9fc9-5b48-449f-8ae7-78037d56150b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:50:56.746833 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d9fc9-5b48-449f-8ae7-78037d56150b service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:56.747106 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d9fc9-5b48-449f-8ae7-78037d56150b service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:56.747371 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d9fc9-5b48-449f-8ae7-78037d56150b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:56.748942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-2f4d9fc9-5b48-449f-8ae7-78037d56150b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:56.774850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:50:56.853510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d9fc9-5b48-449f-8ae7-78037d56150b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:50:56.854964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d9fc9-5b48-449f-8ae7-78037d56150b service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:50:56.873027 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 663/1334] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:50:58.913512 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e3174-1d8e-45ef-be6d-4211853ac8be None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:58.914039 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e3174-1d8e-45ef-be6d-4211853ac8be None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:58.914282 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e3174-1d8e-45ef-be6d-4211853ac8be None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:58.915625 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 672/1335] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:50:58.920930 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f8e47-99f3-4d2f-9279-7fbec1736c96 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:58.921338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f8e47-99f3-4d2f-9279-7fbec1736c96 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:58.921490 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f8e47-99f3-4d2f-9279-7fbec1736c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:58.986228 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-395f8e47-99f3-4d2f-9279-7fbec1736c96 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:50:58.987409 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-395f8e47-99f3-4d2f-9279-7fbec1736c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:59.060063 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:50:59.081318 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 664/1336] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:50:59.122023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e3174-1d8e-45ef-be6d-4211853ac8be None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:50:59.123595 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-f36e3174-1d8e-45ef-be6d-4211853ac8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:59.223880 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e3174-1d8e-45ef-be6d-4211853ac8be None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:50:59.251209 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:50:59.294730 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504b860-8549-4847-be1a-aea7e303f616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:50:59.295325 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504b860-8549-4847-be1a-aea7e303f616 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:50:59.295596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504b860-8549-4847-be1a-aea7e303f616 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:50:59.295864 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504b860-8549-4847-be1a-aea7e303f616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:50:59.297424 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-0504b860-8549-4847-be1a-aea7e303f616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:50:59.403256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504b860-8549-4847-be1a-aea7e303f616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:50:59.404670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504b860-8549-4847-be1a-aea7e303f616 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:50:59.422885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 673/1337] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:50:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 09:51:02.035455 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81579924-b3f4-4b85-8442-efea830d1f17 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:02.036535 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81579924-b3f4-4b85-8442-efea830d1f17 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:02.036535 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81579924-b3f4-4b85-8442-efea830d1f17 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:02.037853 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 665/1338] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:51:02.043066 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c59b78-0cfe-4b03-91fa-579397c960db None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:02.043473 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c59b78-0cfe-4b03-91fa-579397c960db None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:02.043646 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c59b78-0cfe-4b03-91fa-579397c960db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:02.108136 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-f4c59b78-0cfe-4b03-91fa-579397c960db None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:51:02.109330 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-f4c59b78-0cfe-4b03-91fa-579397c960db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:02.118139 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:02.204016 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 674/1339] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:51:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:51:02.241143 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81579924-b3f4-4b85-8442-efea830d1f17 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:51:02.242734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-81579924-b3f4-4b85-8442-efea830d1f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:02.341922 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81579924-b3f4-4b85-8442-efea830d1f17 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:51:02.414805 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67719209-8653-4667-8ab6-70ee525ad52d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:51:02.415405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67719209-8653-4667-8ab6-70ee525ad52d service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:02.415721 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67719209-8653-4667-8ab6-70ee525ad52d service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:02.415990 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67719209-8653-4667-8ab6-70ee525ad52d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:02.417607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-67719209-8653-4667-8ab6-70ee525ad52d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:02.452398 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:02.525617 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67719209-8653-4667-8ab6-70ee525ad52d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:51:02.527081 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67719209-8653-4667-8ab6-70ee525ad52d service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:51:02.545905 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 666/1340] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:51:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:51:06.742351 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413f30b-dfdc-465a-8767-e77477d0b8e3 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:06.742960 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413f30b-dfdc-465a-8767-e77477d0b8e3 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:06.743317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413f30b-dfdc-465a-8767-e77477d0b8e3 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:06.744712 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 675/1341] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:51:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:51:06.750485 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11d81b-bb23-407f-9659-1ac3d856144c None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:06.750933 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11d81b-bb23-407f-9659-1ac3d856144c None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:06.751034 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11d81b-bb23-407f-9659-1ac3d856144c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:06.819607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-2d11d81b-bb23-407f-9659-1ac3d856144c None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:51:06.820796 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-2d11d81b-bb23-407f-9659-1ac3d856144c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:06.903703 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:06.915500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 667/1342] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:51:06.954194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413f30b-dfdc-465a-8767-e77477d0b8e3 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:51:06.955724 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-3413f30b-dfdc-465a-8767-e77477d0b8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:07.059165 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413f30b-dfdc-465a-8767-e77477d0b8e3 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:51:07.095670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:07.132650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b259b66-48cf-4572-b4ec-b6b6cad35586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:51:07.133258 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b259b66-48cf-4572-b4ec-b6b6cad35586 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:07.133535 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b259b66-48cf-4572-b4ec-b6b6cad35586 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:07.133804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b259b66-48cf-4572-b4ec-b6b6cad35586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:07.135426 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-5b259b66-48cf-4572-b4ec-b6b6cad35586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:07.246114 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b259b66-48cf-4572-b4ec-b6b6cad35586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:51:07.247552 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b259b66-48cf-4572-b4ec-b6b6cad35586 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:51:07.266256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 676/1343] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:51:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:51:10.399714 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272987e7-fd13-4f00-8f3c-a46b56a41447 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:10.400248 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272987e7-fd13-4f00-8f3c-a46b56a41447 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:10.400248 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272987e7-fd13-4f00-8f3c-a46b56a41447 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:10.401499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 668/1344] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:51:10.406690 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1101337-d952-4793-b7e5-c76ea2f5021b None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:10.407141 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1101337-d952-4793-b7e5-c76ea2f5021b None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:10.407238 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1101337-d952-4793-b7e5-c76ea2f5021b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:10.472028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-b1101337-d952-4793-b7e5-c76ea2f5021b None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:51:10.473763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-b1101337-d952-4793-b7e5-c76ea2f5021b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:10.491879 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:10.569611 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 677/1345] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:51:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:51:10.606266 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272987e7-fd13-4f00-8f3c-a46b56a41447 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:51:10.607812 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-272987e7-fd13-4f00-8f3c-a46b56a41447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:10.714517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272987e7-fd13-4f00-8f3c-a46b56a41447 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:51:10.790117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03559925-d493-40f0-b269-d5a8683a6c26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:51:10.790738 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03559925-d493-40f0-b269-d5a8683a6c26 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:10.791006 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03559925-d493-40f0-b269-d5a8683a6c26 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:10.791270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03559925-d493-40f0-b269-d5a8683a6c26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:10.792934 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-03559925-d493-40f0-b269-d5a8683a6c26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:10.837720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:10.903062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03559925-d493-40f0-b269-d5a8683a6c26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:51:10.904515 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03559925-d493-40f0-b269-d5a8683a6c26 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:51:10.922863 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 669/1346] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:51:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:51:15.479678 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafeff41-9565-428d-8434-cd98de2528a0 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:15.480169 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafeff41-9565-428d-8434-cd98de2528a0 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:15.480265 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafeff41-9565-428d-8434-cd98de2528a0 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:15.481575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 678/1347] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:51:15.487020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20196905-c770-4851-ac10-4152c16211d1 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:15.487498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20196905-c770-4851-ac10-4152c16211d1 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:15.487583 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20196905-c770-4851-ac10-4152c16211d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:15.557799 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-20196905-c770-4851-ac10-4152c16211d1 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:51:15.559067 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-20196905-c770-4851-ac10-4152c16211d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:15.658530 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:15.661689 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 670/1348] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:51:15.700607 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafeff41-9565-428d-8434-cd98de2528a0 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:51:15.702174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-aafeff41-9565-428d-8434-cd98de2528a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:15.824979 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafeff41-9565-428d-8434-cd98de2528a0 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:51:15.872544 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:15.899642 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d7f12-81f5-486f-a09d-2a0374f2a213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:51:15.900241 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d7f12-81f5-486f-a09d-2a0374f2a213 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:15.900519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d7f12-81f5-486f-a09d-2a0374f2a213 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:15.900776 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d7f12-81f5-486f-a09d-2a0374f2a213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:15.902367 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-234d7f12-81f5-486f-a09d-2a0374f2a213 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:16.013564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d7f12-81f5-486f-a09d-2a0374f2a213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:51:16.015378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d7f12-81f5-486f-a09d-2a0374f2a213 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:51:16.034632 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 679/1349] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:51:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:51:20.922123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f683b-50d8-4662-ac33-bedcdaad5001 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:20.922608 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f683b-50d8-4662-ac33-bedcdaad5001 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:20.922726 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f683b-50d8-4662-ac33-bedcdaad5001 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:20.924121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 671/1350] 10.222.0.13 () {54 vars in 921 bytes} [Thu Aug 11 09:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:51:20.929309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf91b2-2327-4f08-9b89-3719581b56e7 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:20.929749 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf91b2-2327-4f08-9b89-3719581b56e7 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:20.930068 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf91b2-2327-4f08-9b89-3719581b56e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:21.033127 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-23cf91b2-2327-4f08-9b89-3719581b56e7 None None] MFA Rules not processed for user `0061ce46df224f4491599ed10548b2ae`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:51:21.034619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-23cf91b2-2327-4f08-9b89-3719581b56e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:21.058477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:21.207298 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 680/1351] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Aug 11 09:51:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:51:25.288321 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbf956-5952-4377-8dd7-f0672c60a2d5 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:25.289177 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbf956-5952-4377-8dd7-f0672c60a2d5 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:25.289446 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbf956-5952-4377-8dd7-f0672c60a2d5 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:25.291247 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 672/1352] 10.222.0.13 () {54 vars in 921 bytes} [Thu Aug 11 09:51:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:51:25.297028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8308e-7450-414a-ba8b-c2d26f6435f6 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:25.297541 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8308e-7450-414a-ba8b-c2d26f6435f6 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:25.297850 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8308e-7450-414a-ba8b-c2d26f6435f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:25.378050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-40b8308e-7450-414a-ba8b-c2d26f6435f6 None None] MFA Rules not processed for user `0061ce46df224f4491599ed10548b2ae`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:51:25.380250 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-40b8308e-7450-414a-ba8b-c2d26f6435f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:25.459765 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:25.507635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 681/1353] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Aug 11 09:51:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:51:26.975978 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c55870-b9e0-4cb4-a7a3-b3e460442af1 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:26.976492 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c55870-b9e0-4cb4-a7a3-b3e460442af1 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:26.976492 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c55870-b9e0-4cb4-a7a3-b3e460442af1 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:26.977957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 673/1354] 10.222.0.13 () {54 vars in 921 bytes} [Thu Aug 11 09:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:51:26.983112 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2196a0-911e-429f-8f95-98339f9ac2ed None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:26.983536 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2196a0-911e-429f-8f95-98339f9ac2ed None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:26.983652 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2196a0-911e-429f-8f95-98339f9ac2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:27.058869 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-ea2196a0-911e-429f-8f95-98339f9ac2ed None None] MFA Rules not processed for user `0061ce46df224f4491599ed10548b2ae`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:51:27.060056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ea2196a0-911e-429f-8f95-98339f9ac2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:27.184589 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 682/1355] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Aug 11 09:51:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:51:30.605221 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838c7d0-4d5f-4c8a-b2b1-10d19b81f7cb None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:30.605734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838c7d0-4d5f-4c8a-b2b1-10d19b81f7cb None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:30.605734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838c7d0-4d5f-4c8a-b2b1-10d19b81f7cb None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:30.608028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 674/1356] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:51:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:51:30.615063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc930cc4-59a5-4cff-80e9-69b48f9d021e None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:30.615830 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc930cc4-59a5-4cff-80e9-69b48f9d021e None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:30.616277 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc930cc4-59a5-4cff-80e9-69b48f9d021e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:30.663496 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:30.704202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-bc930cc4-59a5-4cff-80e9-69b48f9d021e None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:51:30.706108 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-bc930cc4-59a5-4cff-80e9-69b48f9d021e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:30.820411 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 683/1357] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:51:30.878689 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beaddd-b351-4521-942a-29cee2862dce None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:30.879444 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beaddd-b351-4521-942a-29cee2862dce None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:30.879945 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beaddd-b351-4521-942a-29cee2862dce None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:30.881544 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 675/1358] 10.222.0.13 () {54 vars in 962 bytes} [Thu Aug 11 09:51:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:51:30.891889 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e8769-b405-4e51-a694-2af4ad8c2359 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:30.893247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e8769-b405-4e51-a694-2af4ad8c2359 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:30.893247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e8769-b405-4e51-a694-2af4ad8c2359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:30.978640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-5b7e8769-b405-4e51-a694-2af4ad8c2359 None None] MFA Rules not processed for user `4c1dc8e0d9454ad98894ed1e8d31f931`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:51:30.980038 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-5b7e8769-b405-4e51-a694-2af4ad8c2359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:31.032414 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:31.105280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 684/1359] 10.222.0.13 () {58 vars in 1059 bytes} [Thu Aug 11 09:51:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 09:51:31.113941 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beaddd-b351-4521-942a-29cee2862dce None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:51:31.115585 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-55beaddd-b351-4521-942a-29cee2862dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:31.271679 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beaddd-b351-4521-942a-29cee2862dce None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:51:31.349346 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:31.393999 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6719b-4736-41ea-b43b-3fd1744661f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:51:31.402372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6719b-4736-41ea-b43b-3fd1744661f3 service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:31.402372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6719b-4736-41ea-b43b-3fd1744661f3 service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:31.402372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6719b-4736-41ea-b43b-3fd1744661f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:31.402372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-a3f6719b-4736-41ea-b43b-3fd1744661f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:31.518505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6719b-4736-41ea-b43b-3fd1744661f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:51:31.520851 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6719b-4736-41ea-b43b-3fd1744661f3 service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:51:31.542185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 676/1360] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:51:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 09:51:33.919963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75741cce-c822-4b6e-8447-0d84393badca None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:33.920506 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75741cce-c822-4b6e-8447-0d84393badca None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:33.920506 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75741cce-c822-4b6e-8447-0d84393badca None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:33.921753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 685/1361] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:51:33.926995 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3676aa-231b-4685-ac25-2e8561308dff None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:33.927437 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3676aa-231b-4685-ac25-2e8561308dff None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:33.927521 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3676aa-231b-4685-ac25-2e8561308dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:34.004117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-bb3676aa-231b-4685-ac25-2e8561308dff None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:51:34.005640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-bb3676aa-231b-4685-ac25-2e8561308dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:34.051465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:34.124419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 677/1362] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:51:34.173394 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75741cce-c822-4b6e-8447-0d84393badca None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:51:34.175210 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-75741cce-c822-4b6e-8447-0d84393badca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:34.381567 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75741cce-c822-4b6e-8447-0d84393badca None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:51:34.391809 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:34.506449 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb950dc9-cb50-4e68-9f65-0ec930e2113c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:51:34.507163 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb950dc9-cb50-4e68-9f65-0ec930e2113c service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:34.507513 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb950dc9-cb50-4e68-9f65-0ec930e2113c service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:34.507983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb950dc9-cb50-4e68-9f65-0ec930e2113c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:34.509681 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-cb950dc9-cb50-4e68-9f65-0ec930e2113c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:34.605608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb950dc9-cb50-4e68-9f65-0ec930e2113c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:51:34.607238 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb950dc9-cb50-4e68-9f65-0ec930e2113c service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:51:34.625582 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 686/1363] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:51:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:51:37.131436 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0de72-6cbb-4bdb-9bc3-a88f2929f5ae None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:37.132447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0de72-6cbb-4bdb-9bc3-a88f2929f5ae None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:37.132735 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0de72-6cbb-4bdb-9bc3-a88f2929f5ae None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:37.134159 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 678/1364] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:51:37.139472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9167334-11a6-431c-a3dc-d5b49fbce694 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:37.139981 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9167334-11a6-431c-a3dc-d5b49fbce694 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:37.139981 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9167334-11a6-431c-a3dc-d5b49fbce694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:37.155925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:37.211000 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-a9167334-11a6-431c-a3dc-d5b49fbce694 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:51:37.212196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-a9167334-11a6-431c-a3dc-d5b49fbce694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:37.318986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 687/1365] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:51:37.365984 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc473cf5-7184-4f15-a9f3-befca65fd4ca None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:37.366376 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc473cf5-7184-4f15-a9f3-befca65fd4ca None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:37.366728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc473cf5-7184-4f15-a9f3-befca65fd4ca None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:37.368170 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 679/1366] 10.222.0.13 () {54 vars in 962 bytes} [Thu Aug 11 09:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:51:37.373571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3d2a6-ae41-438d-a62d-3f9af920c7d1 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:37.373855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3d2a6-ae41-438d-a62d-3f9af920c7d1 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:37.374145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3d2a6-ae41-438d-a62d-3f9af920c7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:37.465709 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-2bd3d2a6-ae41-438d-a62d-3f9af920c7d1 None None] MFA Rules not processed for user `4c1dc8e0d9454ad98894ed1e8d31f931`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:51:37.467125 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-2bd3d2a6-ae41-438d-a62d-3f9af920c7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:37.506507 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:37.601328 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 688/1367] 10.222.0.13 () {58 vars in 1059 bytes} [Thu Aug 11 09:51:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:51:37.609325 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc473cf5-7184-4f15-a9f3-befca65fd4ca None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:51:37.610870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-bc473cf5-7184-4f15-a9f3-befca65fd4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:37.770396 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc473cf5-7184-4f15-a9f3-befca65fd4ca None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:51:37.792868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:37.896344 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12020628-bf91-4dd2-88b5-95ffe9e041c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:51:37.896944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12020628-bf91-4dd2-88b5-95ffe9e041c2 service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:37.898134 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12020628-bf91-4dd2-88b5-95ffe9e041c2 service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:37.898134 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12020628-bf91-4dd2-88b5-95ffe9e041c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:37.902681 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-12020628-bf91-4dd2-88b5-95ffe9e041c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:37.997463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12020628-bf91-4dd2-88b5-95ffe9e041c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:51:37.999103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12020628-bf91-4dd2-88b5-95ffe9e041c2 service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:51:38.018853 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 680/1368] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:51:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:51:38.866131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ea6d8-5c07-4805-9652-90bec9f154cf None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:38.866700 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ea6d8-5c07-4805-9652-90bec9f154cf None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:38.866700 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ea6d8-5c07-4805-9652-90bec9f154cf None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:38.868272 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 689/1369] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:51:38.873424 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ef97a-3d67-4507-91c3-32de9d41f94b None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:38.873897 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ef97a-3d67-4507-91c3-32de9d41f94b None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:38.874023 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ef97a-3d67-4507-91c3-32de9d41f94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:38.913009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:38.947627 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-3b6ef97a-3d67-4507-91c3-32de9d41f94b None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:51:38.948839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-3b6ef97a-3d67-4507-91c3-32de9d41f94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:39.050238 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 681/1370] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:51:39.393765 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79a297-d23c-4ba7-a0ab-a1512fc89ebb None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:39.394043 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79a297-d23c-4ba7-a0ab-a1512fc89ebb None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:39.394434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79a297-d23c-4ba7-a0ab-a1512fc89ebb None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:39.395949 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 690/1371] 10.222.0.13 () {54 vars in 964 bytes} [Thu Aug 11 09:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:51:39.400775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd67e8-0cef-463b-a922-2db72847ac04 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:39.401058 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd67e8-0cef-463b-a922-2db72847ac04 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:39.401327 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd67e8-0cef-463b-a922-2db72847ac04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:39.480497 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-21fd67e8-0cef-463b-a922-2db72847ac04 None None] MFA Rules not processed for user `740fc24dc2134f5ca2fba8caa9abb3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:51:39.481696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-21fd67e8-0cef-463b-a922-2db72847ac04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:39.529349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:39.560783 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 682/1372] 10.222.0.13 () {58 vars in 1061 bytes} [Thu Aug 11 09:51:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:51:39.567240 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79a297-d23c-4ba7-a0ab-a1512fc89ebb None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:51:39.568723 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-be79a297-d23c-4ba7-a0ab-a1512fc89ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:39.679084 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79a297-d23c-4ba7-a0ab-a1512fc89ebb None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:51:39.720381 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:39.755263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea175af6-ac5b-4c3c-b8bd-f40a9cfd3d74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:51:39.755927 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea175af6-ac5b-4c3c-b8bd-f40a9cfd3d74 service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:39.756206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea175af6-ac5b-4c3c-b8bd-f40a9cfd3d74 service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:39.756467 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea175af6-ac5b-4c3c-b8bd-f40a9cfd3d74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:39.758055 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ea175af6-ac5b-4c3c-b8bd-f40a9cfd3d74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:39.882394 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea175af6-ac5b-4c3c-b8bd-f40a9cfd3d74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:51:39.884165 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea175af6-ac5b-4c3c-b8bd-f40a9cfd3d74 service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:51:39.914621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 691/1373] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:51:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:51:40.264227 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5c501-7c71-445f-9348-d525ec14ef3e None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:40.264682 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5c501-7c71-445f-9348-d525ec14ef3e None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:40.264911 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5c501-7c71-445f-9348-d525ec14ef3e None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:40.266584 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 683/1374] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:51:40.271786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b84de-4821-4cfa-9db3-7a69a9922f49 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:40.272069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b84de-4821-4cfa-9db3-7a69a9922f49 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:40.272411 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b84de-4821-4cfa-9db3-7a69a9922f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:40.352162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-136b84de-4821-4cfa-9db3-7a69a9922f49 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:51:40.353794 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-136b84de-4821-4cfa-9db3-7a69a9922f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:40.376361 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:40.453715 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 692/1375] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:51:40.497972 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5c501-7c71-445f-9348-d525ec14ef3e None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:51:40.499521 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-8da5c501-7c71-445f-9348-d525ec14ef3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:40.645787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5c501-7c71-445f-9348-d525ec14ef3e None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:51:40.698148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:40.758538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a810c63-4f24-421c-a5d6-c05a17f3d1c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:51:40.759074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a810c63-4f24-421c-a5d6-c05a17f3d1c1 service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:40.759351 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a810c63-4f24-421c-a5d6-c05a17f3d1c1 service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:40.759616 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a810c63-4f24-421c-a5d6-c05a17f3d1c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:40.761208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-5a810c63-4f24-421c-a5d6-c05a17f3d1c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:40.849709 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a810c63-4f24-421c-a5d6-c05a17f3d1c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:51:40.851393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a810c63-4f24-421c-a5d6-c05a17f3d1c1 service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:51:40.869837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 684/1376] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:51:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:51:43.078145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8415d-566d-4e4c-995f-328c79143cee None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:43.078684 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8415d-566d-4e4c-995f-328c79143cee None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:43.078684 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8415d-566d-4e4c-995f-328c79143cee None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:43.080292 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 693/1377] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:51:43.086411 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3b558-105b-45fd-b12d-ab3fd52b60ac None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:43.086885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3b558-105b-45fd-b12d-ab3fd52b60ac None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:43.086972 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3b558-105b-45fd-b12d-ab3fd52b60ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:43.166061 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-a6e3b558-105b-45fd-b12d-ab3fd52b60ac None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:51:43.167213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-a6e3b558-105b-45fd-b12d-ab3fd52b60ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:43.173810 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:43.263788 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 685/1378] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:51:43.308636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8415d-566d-4e4c-995f-328c79143cee None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:51:43.310417 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-a4b8415d-566d-4e4c-995f-328c79143cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:43.474788 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8415d-566d-4e4c-995f-328c79143cee None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:51:43.478394 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:43.614422 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c6444-9bf7-4b74-8d76-300c0b856ed9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:51:43.614985 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c6444-9bf7-4b74-8d76-300c0b856ed9 service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:43.615258 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c6444-9bf7-4b74-8d76-300c0b856ed9 service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:43.615519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c6444-9bf7-4b74-8d76-300c0b856ed9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:43.617110 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-b60c6444-9bf7-4b74-8d76-300c0b856ed9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:43.725860 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c6444-9bf7-4b74-8d76-300c0b856ed9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:51:43.727667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c6444-9bf7-4b74-8d76-300c0b856ed9 service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:51:43.747089 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 694/1379] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:51:45.912541 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c037459-8dde-4d0a-a72d-d39740226ce4 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:45.912541 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c037459-8dde-4d0a-a72d-d39740226ce4 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:45.912541 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c037459-8dde-4d0a-a72d-d39740226ce4 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:45.918244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 686/1380] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:51:45 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:51:45.918786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265ac5d-6307-45c3-8d02-b28de8ae29de None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:45.919180 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265ac5d-6307-45c3-8d02-b28de8ae29de None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:45.919483 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265ac5d-6307-45c3-8d02-b28de8ae29de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:45.940427 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:45.989866 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-0265ac5d-6307-45c3-8d02-b28de8ae29de None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:51:45.991338 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-0265ac5d-6307-45c3-8d02-b28de8ae29de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:46.092352 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 695/1381] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:51:46.136123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c037459-8dde-4d0a-a72d-d39740226ce4 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:51:46.137738 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-8c037459-8dde-4d0a-a72d-d39740226ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:46.283030 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:46.293894 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c037459-8dde-4d0a-a72d-d39740226ce4 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:51:46.423135 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25c966-cbfd-4b56-ab95-e073fcbc3df3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:51:46.423957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25c966-cbfd-4b56-ab95-e073fcbc3df3 service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:46.424880 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25c966-cbfd-4b56-ab95-e073fcbc3df3 service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:46.425255 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25c966-cbfd-4b56-ab95-e073fcbc3df3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:46.427229 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-8f25c966-cbfd-4b56-ab95-e073fcbc3df3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:46.524586 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25c966-cbfd-4b56-ab95-e073fcbc3df3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:51:46.526456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25c966-cbfd-4b56-ab95-e073fcbc3df3 service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:51:46.538617 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:46.549018 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 687/1382] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:51:48.882662 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d7d13-eecd-4293-a8be-39cc8e995e8e None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:48.883381 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d7d13-eecd-4293-a8be-39cc8e995e8e None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:48.883381 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d7d13-eecd-4293-a8be-39cc8e995e8e None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:48.884567 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 696/1383] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:51:48.890059 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadb54a-f431-40ed-ade9-31e7a187d648 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:48.890525 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadb54a-f431-40ed-ade9-31e7a187d648 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:48.890828 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadb54a-f431-40ed-ade9-31e7a187d648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:48.963249 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-1aadb54a-f431-40ed-ade9-31e7a187d648 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:51:48.964375 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-1aadb54a-f431-40ed-ade9-31e7a187d648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:49.061534 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 688/1384] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:51:49.106376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d7d13-eecd-4293-a8be-39cc8e995e8e None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:51:49.107883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-cd0d7d13-eecd-4293-a8be-39cc8e995e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:49.196199 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:49.258709 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d7d13-eecd-4293-a8be-39cc8e995e8e None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:51:49.380140 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9097b84-c618-4f1e-b920-04886a78b8f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:51:49.380964 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9097b84-c618-4f1e-b920-04886a78b8f8 service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:49.381329 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9097b84-c618-4f1e-b920-04886a78b8f8 service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:49.381677 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9097b84-c618-4f1e-b920-04886a78b8f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:49.383847 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-a9097b84-c618-4f1e-b920-04886a78b8f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:49.446258 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:49.495664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9097b84-c618-4f1e-b920-04886a78b8f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:51:49.497724 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9097b84-c618-4f1e-b920-04886a78b8f8 service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:51:49.520970 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 697/1385] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:51:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:51:51.538741 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5da32-0cf3-45bb-9c99-25a6aa492ed7 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:51.539306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5da32-0cf3-45bb-9c99-25a6aa492ed7 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:51.539306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5da32-0cf3-45bb-9c99-25a6aa492ed7 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:51.540994 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 689/1386] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:51:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:51:51.546327 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378fb2b-5d51-4158-9361-43399245a07e None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:51.547610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378fb2b-5d51-4158-9361-43399245a07e None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:51.547610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378fb2b-5d51-4158-9361-43399245a07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:51.614153 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-c378fb2b-5d51-4158-9361-43399245a07e None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:51:51.615382 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-c378fb2b-5d51-4158-9361-43399245a07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:51.713666 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 698/1387] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:51:51.758611 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5da32-0cf3-45bb-9c99-25a6aa492ed7 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:51:51.760134 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-0bc5da32-0cf3-45bb-9c99-25a6aa492ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:51.836350 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:51.909058 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5da32-0cf3-45bb-9c99-25a6aa492ed7 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:51:52.029018 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0682a-a907-49fd-a800-a3d7ade78e81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:51:52.029673 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0682a-a907-49fd-a800-a3d7ade78e81 service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:52.029892 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0682a-a907-49fd-a800-a3d7ade78e81 service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:52.030184 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0682a-a907-49fd-a800-a3d7ade78e81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:52.031766 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-67a0682a-a907-49fd-a800-a3d7ade78e81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:52.070108 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:52.122413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0682a-a907-49fd-a800-a3d7ade78e81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:51:52.124026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0682a-a907-49fd-a800-a3d7ade78e81 service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:51:52.142407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 690/1388] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:51:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:51:54.344967 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee27942-daec-49b2-b8fd-256c8e34e025 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:54.345513 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee27942-daec-49b2-b8fd-256c8e34e025 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:54.345513 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee27942-daec-49b2-b8fd-256c8e34e025 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:54.347455 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 699/1389] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:51:54.352956 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73f647-979a-4d7e-b967-221e0704ce09 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:54.353382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73f647-979a-4d7e-b967-221e0704ce09 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:54.353488 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73f647-979a-4d7e-b967-221e0704ce09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:54.421827 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-9e73f647-979a-4d7e-b967-221e0704ce09 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:51:54.423065 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-9e73f647-979a-4d7e-b967-221e0704ce09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:54.521295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 691/1390] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:51:54.565398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee27942-daec-49b2-b8fd-256c8e34e025 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:51:54.566931 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-4ee27942-daec-49b2-b8fd-256c8e34e025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:54.598366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:54.713478 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee27942-daec-49b2-b8fd-256c8e34e025 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:51:54.815801 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:54.827509 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc034726-3d8f-4f87-852d-a648a49b7fbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:51:54.828116 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc034726-3d8f-4f87-852d-a648a49b7fbd service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:54.828390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc034726-3d8f-4f87-852d-a648a49b7fbd service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:54.828656 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc034726-3d8f-4f87-852d-a648a49b7fbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:54.830904 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-fc034726-3d8f-4f87-852d-a648a49b7fbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:54.920643 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc034726-3d8f-4f87-852d-a648a49b7fbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:51:54.922183 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc034726-3d8f-4f87-852d-a648a49b7fbd service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:51:54.941280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 700/1391] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:51:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:51:55.296474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9f87f-740d-4c7f-891b-deb934cf965e None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:55.296757 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9f87f-740d-4c7f-891b-deb934cf965e None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:55.297118 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9f87f-740d-4c7f-891b-deb934cf965e None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:55.298497 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 692/1392] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:51:55.304444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af95ae-cbcf-4128-8a3d-012fecbdcce1 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:55.305050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af95ae-cbcf-4128-8a3d-012fecbdcce1 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:55.305388 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af95ae-cbcf-4128-8a3d-012fecbdcce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:55.371434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-53af95ae-cbcf-4128-8a3d-012fecbdcce1 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:51:55.372655 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-53af95ae-cbcf-4128-8a3d-012fecbdcce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:55.433315 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:55.471432 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 701/1393] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:51:55.526011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd52a89-bde6-497e-b033-10dc25fbe744 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:55.526594 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd52a89-bde6-497e-b033-10dc25fbe744 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:55.526923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd52a89-bde6-497e-b033-10dc25fbe744 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:55.528332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 693/1394] 10.222.0.13 () {54 vars in 967 bytes} [Thu Aug 11 09:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:51:55.534031 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c41f1-4e97-494e-97ed-d1addb701c80 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:55.534332 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c41f1-4e97-494e-97ed-d1addb701c80 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:55.534600 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c41f1-4e97-494e-97ed-d1addb701c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:55.610700 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-c23c41f1-4e97-494e-97ed-d1addb701c80 None None] MFA Rules not processed for user `a7791be968594cea9c32b51a7b3454b6`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:51:55.612435 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-c23c41f1-4e97-494e-97ed-d1addb701c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:55.692285 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 702/1395] 10.222.0.13 () {58 vars in 1064 bytes} [Thu Aug 11 09:51:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:51:55.699840 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd52a89-bde6-497e-b033-10dc25fbe744 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:51:55.701347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-9cd52a89-bde6-497e-b033-10dc25fbe744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:55.714793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:55.804507 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd52a89-bde6-497e-b033-10dc25fbe744 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:51:55.877583 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff81cc4-651f-4ef1-bc79-bcddfe05d02a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7791be968594cea9c32b51a7b3454b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:51:55.878128 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff81cc4-651f-4ef1-bc79-bcddfe05d02a service glance] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:55.878413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff81cc4-651f-4ef1-bc79-bcddfe05d02a service glance] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:55.878682 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff81cc4-651f-4ef1-bc79-bcddfe05d02a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:55.880265 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-2ff81cc4-651f-4ef1-bc79-bcddfe05d02a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:55.951240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:55.996029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff81cc4-651f-4ef1-bc79-bcddfe05d02a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:51:55.999372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff81cc4-651f-4ef1-bc79-bcddfe05d02a service glance] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:51:56.018049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 694/1396] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:51:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:51:56.977037 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e4502-861f-4452-beae-04a904b924e1 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:56.977551 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e4502-861f-4452-beae-04a904b924e1 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:56.977650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e4502-861f-4452-beae-04a904b924e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:57.114047 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85638a-f248-4af2-80d1-b722653949e7 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:57.114632 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85638a-f248-4af2-80d1-b722653949e7 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:57.114632 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85638a-f248-4af2-80d1-b722653949e7 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:57.115936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 695/1397] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:51:57.121742 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f9b70-dc2a-4ad5-9b88-3d5ca0bbebb3 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:57.122030 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f9b70-dc2a-4ad5-9b88-3d5ca0bbebb3 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:57.122338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f9b70-dc2a-4ad5-9b88-3d5ca0bbebb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:57.165907 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-9e0e4502-861f-4452-beae-04a904b924e1 None None] MFA Rules not processed for user `d392c30328a3491bb186bd7b55f4d99c`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:51:57.167185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-9e0e4502-861f-4452-beae-04a904b924e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:57.176114 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:57.191852 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-1c9f9b70-dc2a-4ad5-9b88-3d5ca0bbebb3 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:51:57.193040 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-1c9f9b70-dc2a-4ad5-9b88-3d5ca0bbebb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:57.253845 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 703/1398] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Aug 11 09:51:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:51:57.291727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 696/1399] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 09:51:57.304483 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e98f8f-4184-4df3-be48-b606da6826e0 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:57.305272 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e98f8f-4184-4df3-be48-b606da6826e0 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:57.305647 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e98f8f-4184-4df3-be48-b606da6826e0 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:57.307485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 704/1400] 10.222.0.13 () {54 vars in 943 bytes} [Thu Aug 11 09:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:51:57.314237 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae59e07-2ff2-4afa-b309-733ceb0395b5 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:57.314637 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae59e07-2ff2-4afa-b309-733ceb0395b5 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:57.314928 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae59e07-2ff2-4afa-b309-733ceb0395b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:57.338789 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e98f8f-4184-4df3-be48-b606da6826e0 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:51:57.340345 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-19e98f8f-4184-4df3-be48-b606da6826e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:57.346796 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:57.396592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-eae59e07-2ff2-4afa-b309-733ceb0395b5 None None] MFA Rules not processed for user `f7e3b1c5aec94673b391210ae51d4cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:51:57.397772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-eae59e07-2ff2-4afa-b309-733ceb0395b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:57.486916 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e98f8f-4184-4df3-be48-b606da6826e0 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:51:57.490505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:57.506675 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 697/1401] 10.222.0.13 () {58 vars in 1040 bytes} [Thu Aug 11 09:51:57 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 09:51:57.516105 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae59e07-2ff2-4afa-b309-733ceb0395b5 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:51:57.525540 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae59e07-2ff2-4afa-b309-733ceb0395b5 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:51:57.598636 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:51:57.608371 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2be939-8053-4167-86b7-6583801d9eca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:51:57.611808 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2be939-8053-4167-86b7-6583801d9eca service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:57.611808 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2be939-8053-4167-86b7-6583801d9eca service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:57.611808 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2be939-8053-4167-86b7-6583801d9eca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:57.611808 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-3f2be939-8053-4167-86b7-6583801d9eca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:57.634932 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed0762-7808-4da1-bd2e-72e654f9c635 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e3b1c5aec94673b391210ae51d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:51:57.635541 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed0762-7808-4da1-bd2e-72e654f9c635 service swift] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:57.635818 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed0762-7808-4da1-bd2e-72e654f9c635 service swift] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:57.636084 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed0762-7808-4da1-bd2e-72e654f9c635 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:57.637730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-5fed0762-7808-4da1-bd2e-72e654f9c635 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:51:57.707329 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2be939-8053-4167-86b7-6583801d9eca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:51:57.708918 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2be939-8053-4167-86b7-6583801d9eca service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:51:57.722793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed0762-7808-4da1-bd2e-72e654f9c635 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:51:57.724363 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed0762-7808-4da1-bd2e-72e654f9c635 service swift] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:51:57.727388 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 705/1402] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:51:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 09:51:57.735538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 698/1403] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Aug 11 09:51:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 11 09:51:59.952782 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7cd2d-a835-4425-bd9d-985ef8c7fd2a None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:59.953299 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7cd2d-a835-4425-bd9d-985ef8c7fd2a None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:59.953299 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7cd2d-a835-4425-bd9d-985ef8c7fd2a None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:51:59.954602 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 706/1404] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:51:59.960123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adf33c-1078-4825-841c-da4a8ebc93c7 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:51:59.960561 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adf33c-1078-4825-841c-da4a8ebc93c7 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:51:59.960667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adf33c-1078-4825-841c-da4a8ebc93c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:00.042710 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-f5adf33c-1078-4825-841c-da4a8ebc93c7 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:52:00.044446 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-f5adf33c-1078-4825-841c-da4a8ebc93c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:00.112881 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:00.159375 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 699/1405] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:52:00.207671 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7cd2d-a835-4425-bd9d-985ef8c7fd2a None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:52:00.209197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-e6a7cd2d-a835-4425-bd9d-985ef8c7fd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:00.221469 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:00.420520 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7cd2d-a835-4425-bd9d-985ef8c7fd2a None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:52:00.520562 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:00.577622 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046fd72-1349-4254-92ff-6d74cc9de54f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:52:00.579183 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046fd72-1349-4254-92ff-6d74cc9de54f service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:00.579478 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046fd72-1349-4254-92ff-6d74cc9de54f service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:00.579752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046fd72-1349-4254-92ff-6d74cc9de54f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:00.581583 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-3046fd72-1349-4254-92ff-6d74cc9de54f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:00.697889 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046fd72-1349-4254-92ff-6d74cc9de54f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:52:00.699968 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046fd72-1349-4254-92ff-6d74cc9de54f service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:52:00.726215 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 707/1406] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:52:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:52:03.630109 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee356a-5ce1-4530-9751-29df053cb824 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:03.630694 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee356a-5ce1-4530-9751-29df053cb824 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:03.630694 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee356a-5ce1-4530-9751-29df053cb824 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:03.632145 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 700/1407] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:52:03.640986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d97cab-8be8-4554-873f-546d0d53304a None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:03.641533 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d97cab-8be8-4554-873f-546d0d53304a None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:03.641533 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d97cab-8be8-4554-873f-546d0d53304a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:03.731951 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-17d97cab-8be8-4554-873f-546d0d53304a None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:52:03.733465 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-17d97cab-8be8-4554-873f-546d0d53304a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:03.784653 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:03.843343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 708/1408] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:52:03.888217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee356a-5ce1-4530-9751-29df053cb824 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:52:03.889759 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-dfee356a-5ce1-4530-9751-29df053cb824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:04.050361 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee356a-5ce1-4530-9751-29df053cb824 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:52:04.093247 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:04.175143 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50164d8d-a240-46a5-ac3c-5dedafb2bc40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:52:04.175760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50164d8d-a240-46a5-ac3c-5dedafb2bc40 service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:04.176213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50164d8d-a240-46a5-ac3c-5dedafb2bc40 service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:04.176606 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50164d8d-a240-46a5-ac3c-5dedafb2bc40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:04.178342 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-50164d8d-a240-46a5-ac3c-5dedafb2bc40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:04.280872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50164d8d-a240-46a5-ac3c-5dedafb2bc40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:52:04.282523 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50164d8d-a240-46a5-ac3c-5dedafb2bc40 service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:52:04.305950 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 701/1409] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:52:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:52:13.840874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=23 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:14.302945 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=79 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:21.257856 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1eb0a-20d9-46df-85c1-a1f2def88767 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:21.258461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1eb0a-20d9-46df-85c1-a1f2def88767 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:21.258461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1eb0a-20d9-46df-85c1-a1f2def88767 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:21.259751 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 709/1410] 10.222.0.13 () {54 vars in 918 bytes} [Thu Aug 11 09:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:52:21.264734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b783a15-be4f-4b9e-962f-ee6346d1cebe None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:21.265135 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b783a15-be4f-4b9e-962f-ee6346d1cebe None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:21.265271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b783a15-be4f-4b9e-962f-ee6346d1cebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:21.340716 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-8b783a15-be4f-4b9e-962f-ee6346d1cebe None None] MFA Rules not processed for user `0061ce46df224f4491599ed10548b2ae`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:52:21.341953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-8b783a15-be4f-4b9e-962f-ee6346d1cebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:21.450281 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 702/1411] 10.222.0.13 () {58 vars in 1015 bytes} [Thu Aug 11 09:52:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:52:21.464507 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11238bca-56e7-40e4-b9a4-a8093767a65d None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:21.464790 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11238bca-56e7-40e4-b9a4-a8093767a65d None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:21.465090 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11238bca-56e7-40e4-b9a4-a8093767a65d None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:21.466486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 710/1412] 10.222.0.13 () {54 vars in 918 bytes} [Thu Aug 11 09:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:52:21.471244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a94f22-be28-4bba-bd00-5201d5c70a0d None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:21.471522 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a94f22-be28-4bba-bd00-5201d5c70a0d None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:21.471840 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a94f22-be28-4bba-bd00-5201d5c70a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:21.541912 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:21.544932 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-37a94f22-be28-4bba-bd00-5201d5c70a0d None None] MFA Rules not processed for user `4c1dc8e0d9454ad98894ed1e8d31f931`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:52:21.546203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-37a94f22-be28-4bba-bd00-5201d5c70a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:21.661693 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 703/1413] 10.222.0.13 () {58 vars in 1015 bytes} [Thu Aug 11 09:52:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:52:24.142620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763af32-9580-4d07-b4fc-1708fc4f1f89 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:24.143183 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763af32-9580-4d07-b4fc-1708fc4f1f89 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:24.143183 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763af32-9580-4d07-b4fc-1708fc4f1f89 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:24.144458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 09:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:52:24.149780 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07f545-2b73-4a43-850c-86ba9e279f4f None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:24.150238 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07f545-2b73-4a43-850c-86ba9e279f4f None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:24.150350 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07f545-2b73-4a43-850c-86ba9e279f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:24.215316 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-6c07f545-2b73-4a43-850c-86ba9e279f4f None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:52:24.216500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-6c07f545-2b73-4a43-850c-86ba9e279f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:24.269710 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:24.311075 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 09:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:52:24.353883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763af32-9580-4d07-b4fc-1708fc4f1f89 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:52:24.355419 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-e763af32-9580-4d07-b4fc-1708fc4f1f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:24.498912 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763af32-9580-4d07-b4fc-1708fc4f1f89 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:52:24.570340 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:24.609370 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516906b-d785-40c5-b8bc-75e371234c39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:52:24.609965 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516906b-d785-40c5-b8bc-75e371234c39 service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:24.610270 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516906b-d785-40c5-b8bc-75e371234c39 service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:24.610540 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516906b-d785-40c5-b8bc-75e371234c39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:24.612111 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-5516906b-d785-40c5-b8bc-75e371234c39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:24.699236 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516906b-d785-40c5-b8bc-75e371234c39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:52:24.700814 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516906b-d785-40c5-b8bc-75e371234c39 service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:52:24.718835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 712/1416] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:52:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:52:25.615188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db7f9d-585f-4566-ad28-dd9c951c2935 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:25.615763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db7f9d-585f-4566-ad28-dd9c951c2935 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:25.615763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db7f9d-585f-4566-ad28-dd9c951c2935 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:25.617108 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 09:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:52:25.621914 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64268aa9-6042-4e2e-9dec-1577d0b05ef7 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:25.622382 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64268aa9-6042-4e2e-9dec-1577d0b05ef7 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:25.622515 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64268aa9-6042-4e2e-9dec-1577d0b05ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:25.698993 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-64268aa9-6042-4e2e-9dec-1577d0b05ef7 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:52:25.700195 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-64268aa9-6042-4e2e-9dec-1577d0b05ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:25.727268 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:25.798541 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 09:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:52:25.951335 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db7f9d-585f-4566-ad28-dd9c951c2935 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:52:25.952769 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-01db7f9d-585f-4566-ad28-dd9c951c2935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:26.111356 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db7f9d-585f-4566-ad28-dd9c951c2935 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:52:26.152754 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:26.225387 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fb3a4-5e6e-4177-a7ba-432271bf22b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:52:26.225907 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fb3a4-5e6e-4177-a7ba-432271bf22b5 service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:26.226206 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fb3a4-5e6e-4177-a7ba-432271bf22b5 service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:26.226474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fb3a4-5e6e-4177-a7ba-432271bf22b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:26.228045 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-987fb3a4-5e6e-4177-a7ba-432271bf22b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:26.313904 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987fb3a4-5e6e-4177-a7ba-432271bf22b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:52:26.315519 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987fb3a4-5e6e-4177-a7ba-432271bf22b5 service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:52:26.333193 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 706/1419] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:52:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:52:27.209214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067dd54-94ab-4319-a6e6-46de947bf0e9 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:27.209795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067dd54-94ab-4319-a6e6-46de947bf0e9 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:27.209795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067dd54-94ab-4319-a6e6-46de947bf0e9 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:27.211112 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 09:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:52:27.216031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05a00b-7851-4f6f-a3fd-0f3cd7a2cb2b None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:27.216450 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05a00b-7851-4f6f-a3fd-0f3cd7a2cb2b None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:27.219116 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05a00b-7851-4f6f-a3fd-0f3cd7a2cb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:27.270278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:27.290839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-ec05a00b-7851-4f6f-a3fd-0f3cd7a2cb2b None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:52:27.292048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-ec05a00b-7851-4f6f-a3fd-0f3cd7a2cb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:27.387686 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 09:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:52:27.538614 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067dd54-94ab-4319-a6e6-46de947bf0e9 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:52:27.540109 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-0067dd54-94ab-4319-a6e6-46de947bf0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:27.683459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067dd54-94ab-4319-a6e6-46de947bf0e9 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:52:27.695122 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:27.791885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ac0c7-2581-4467-961f-bf5a0a1092ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:52:27.792431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ac0c7-2581-4467-961f-bf5a0a1092ac service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:27.792696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ac0c7-2581-4467-961f-bf5a0a1092ac service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:27.792957 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ac0c7-2581-4467-961f-bf5a0a1092ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:27.794550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-559ac0c7-2581-4467-961f-bf5a0a1092ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:27.884682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ac0c7-2581-4467-961f-bf5a0a1092ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:52:27.886303 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ac0c7-2581-4467-961f-bf5a0a1092ac service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:52:27.904210 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 715/1422] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:52:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:52:28.780163 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344ad07-e8c2-4291-93f0-882ca0a67f66 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:28.780695 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344ad07-e8c2-4291-93f0-882ca0a67f66 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:28.780793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344ad07-e8c2-4291-93f0-882ca0a67f66 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:28.782115 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 09:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:52:28.786936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672287d7-8042-454d-a715-9eb51d048ee9 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:28.787455 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672287d7-8042-454d-a715-9eb51d048ee9 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:28.787455 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672287d7-8042-454d-a715-9eb51d048ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:28.807335 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:28.862642 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-672287d7-8042-454d-a715-9eb51d048ee9 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:52:28.863858 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-672287d7-8042-454d-a715-9eb51d048ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:28.959700 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 09:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:52:29.110648 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344ad07-e8c2-4291-93f0-882ca0a67f66 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:52:29.112276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-b344ad07-e8c2-4291-93f0-882ca0a67f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:29.220847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:29.257755 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344ad07-e8c2-4291-93f0-882ca0a67f66 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:52:29.367620 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2e403-f53a-411c-bcf2-d16686b7ddd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:52:29.368216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2e403-f53a-411c-bcf2-d16686b7ddd2 service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:29.368491 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2e403-f53a-411c-bcf2-d16686b7ddd2 service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:29.368757 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2e403-f53a-411c-bcf2-d16686b7ddd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:29.370375 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-44b2e403-f53a-411c-bcf2-d16686b7ddd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:29.443939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:29.457619 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2e403-f53a-411c-bcf2-d16686b7ddd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:52:29.459260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2e403-f53a-411c-bcf2-d16686b7ddd2 service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:52:29.477324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 709/1425] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:52:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:52:30.337655 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e50a6-3bc8-4c69-bf6d-9091240baa9d None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:30.341362 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e50a6-3bc8-4c69-bf6d-9091240baa9d None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:30.341362 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e50a6-3bc8-4c69-bf6d-9091240baa9d None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:30.341362 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 09:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:52:30.344696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb50a2-9789-4e15-90e3-2df7f7b22756 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:30.345094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb50a2-9789-4e15-90e3-2df7f7b22756 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:30.345243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb50a2-9789-4e15-90e3-2df7f7b22756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:30.419701 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-a3bb50a2-9789-4e15-90e3-2df7f7b22756 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:52:30.420906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-a3bb50a2-9789-4e15-90e3-2df7f7b22756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:30.516645 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 09:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:52:30.676965 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e50a6-3bc8-4c69-bf6d-9091240baa9d None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:52:30.678516 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ed9e50a6-3bc8-4c69-bf6d-9091240baa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:30.760110 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:30.821438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e50a6-3bc8-4c69-bf6d-9091240baa9d None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:52:30.932276 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70871450-19f7-4669-89e0-62ef17594ea2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:52:30.932810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70871450-19f7-4669-89e0-62ef17594ea2 service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:30.933088 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70871450-19f7-4669-89e0-62ef17594ea2 service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:30.933355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70871450-19f7-4669-89e0-62ef17594ea2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:30.934975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-70871450-19f7-4669-89e0-62ef17594ea2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:30.982527 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:31.027137 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70871450-19f7-4669-89e0-62ef17594ea2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:52:31.028985 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70871450-19f7-4669-89e0-62ef17594ea2 service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:52:31.047476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 718/1428] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:52:31.951452 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44f5f4-2fb1-47f6-a763-75b2d7776e24 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:31.951989 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44f5f4-2fb1-47f6-a763-75b2d7776e24 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:31.951989 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44f5f4-2fb1-47f6-a763-75b2d7776e24 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:31.953269 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 09:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:52:31.958343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df062c08-dce6-4bc8-9736-e2e197437f35 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:31.958759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df062c08-dce6-4bc8-9736-e2e197437f35 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:31.959009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df062c08-dce6-4bc8-9736-e2e197437f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:32.037271 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-df062c08-dce6-4bc8-9736-e2e197437f35 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:52:32.038534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-df062c08-dce6-4bc8-9736-e2e197437f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:32.139270 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 09:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:52:32.295187 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44f5f4-2fb1-47f6-a763-75b2d7776e24 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:52:32.296732 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-7e44f5f4-2fb1-47f6-a763-75b2d7776e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:32.348083 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:32.449706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44f5f4-2fb1-47f6-a763-75b2d7776e24 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:52:32.558445 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fcf46-66d8-4825-a4e8-5a69d21b77ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:52:32.558966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fcf46-66d8-4825-a4e8-5a69d21b77ae service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:32.559260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fcf46-66d8-4825-a4e8-5a69d21b77ae service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:32.559524 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fcf46-66d8-4825-a4e8-5a69d21b77ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:32.561083 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-e51fcf46-66d8-4825-a4e8-5a69d21b77ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:32.567786 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:32.651937 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fcf46-66d8-4825-a4e8-5a69d21b77ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:52:32.653556 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fcf46-66d8-4825-a4e8-5a69d21b77ae service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:52:32.674330 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 712/1431] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:52:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:52:33.565697 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefcb64-7353-49cd-94f5-3114a2827cd0 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:33.566280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefcb64-7353-49cd-94f5-3114a2827cd0 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:33.566280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefcb64-7353-49cd-94f5-3114a2827cd0 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:33.567643 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 09:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:52:33.574260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d32a53-438a-4c0f-a3a7-52dd05c377f1 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:33.574744 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d32a53-438a-4c0f-a3a7-52dd05c377f1 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:33.574836 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d32a53-438a-4c0f-a3a7-52dd05c377f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:33.652627 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-47d32a53-438a-4c0f-a3a7-52dd05c377f1 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:52:33.653837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-47d32a53-438a-4c0f-a3a7-52dd05c377f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:33.722602 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:33.751298 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 09:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:52:33.904033 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefcb64-7353-49cd-94f5-3114a2827cd0 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:52:33.905459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-0fefcb64-7353-49cd-94f5-3114a2827cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:33.923338 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:34.049280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefcb64-7353-49cd-94f5-3114a2827cd0 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:52:34.138146 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:34.166588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd832d-d27b-4d7d-b022-04e63e538704 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:52:34.167307 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd832d-d27b-4d7d-b022-04e63e538704 service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:34.167800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd832d-d27b-4d7d-b022-04e63e538704 service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:34.168425 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd832d-d27b-4d7d-b022-04e63e538704 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:34.169975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-25dd832d-d27b-4d7d-b022-04e63e538704 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:34.258990 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd832d-d27b-4d7d-b022-04e63e538704 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:52:34.260561 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd832d-d27b-4d7d-b022-04e63e538704 service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:52:34.277771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 721/1434] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:52:35.134284 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02351a8d-85df-41e9-8776-029fd8702379 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:35.134871 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02351a8d-85df-41e9-8776-029fd8702379 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:35.134871 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02351a8d-85df-41e9-8776-029fd8702379 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:35.136150 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 09:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:52:35.141161 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a2281-e8b4-4439-96b5-3b9f983b7ce2 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:35.141562 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a2281-e8b4-4439-96b5-3b9f983b7ce2 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:35.141717 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a2281-e8b4-4439-96b5-3b9f983b7ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:35.216516 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-ca2a2281-e8b4-4439-96b5-3b9f983b7ce2 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:52:35.217722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ca2a2281-e8b4-4439-96b5-3b9f983b7ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:35.258616 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:35.312323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 09:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:52:35.462978 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02351a8d-85df-41e9-8776-029fd8702379 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:52:35.464438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-02351a8d-85df-41e9-8776-029fd8702379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:35.607172 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02351a8d-85df-41e9-8776-029fd8702379 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:52:35.661258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:35.720073 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07b853-2d80-479a-91e3-61f150138048 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:52:35.720602 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07b853-2d80-479a-91e3-61f150138048 service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:35.720873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07b853-2d80-479a-91e3-61f150138048 service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:35.721138 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07b853-2d80-479a-91e3-61f150138048 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:35.722738 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-9c07b853-2d80-479a-91e3-61f150138048 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:35.808562 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07b853-2d80-479a-91e3-61f150138048 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:52:35.810168 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07b853-2d80-479a-91e3-61f150138048 service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:52:35.828527 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 715/1437] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:52:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:52:36.717169 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bff49e-5dac-4615-9e18-3654d638f4c4 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:36.717594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bff49e-5dac-4615-9e18-3654d638f4c4 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:36.717716 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bff49e-5dac-4615-9e18-3654d638f4c4 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:36.719642 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 09:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:52:36.724431 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b9a62-c85b-473a-a171-353beee02eb9 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:36.724873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b9a62-c85b-473a-a171-353beee02eb9 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:36.724976 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b9a62-c85b-473a-a171-353beee02eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:36.799893 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-649b9a62-c85b-473a-a171-353beee02eb9 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:52:36.801103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-649b9a62-c85b-473a-a171-353beee02eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:36.803207 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:36.896611 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 09:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:52:37.048034 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bff49e-5dac-4615-9e18-3654d638f4c4 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:52:37.049553 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-87bff49e-5dac-4615-9e18-3654d638f4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:37.194559 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bff49e-5dac-4615-9e18-3654d638f4c4 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:52:37.219946 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:37.305123 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c896b-946c-4896-a0de-64e36e8bae02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:52:37.305659 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c896b-946c-4896-a0de-64e36e8bae02 service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:37.305911 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c896b-946c-4896-a0de-64e36e8bae02 service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:37.306198 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c896b-946c-4896-a0de-64e36e8bae02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:37.307762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-b57c896b-946c-4896-a0de-64e36e8bae02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:37.394006 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c896b-946c-4896-a0de-64e36e8bae02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:52:37.395609 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c896b-946c-4896-a0de-64e36e8bae02 service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:52:37.414003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 724/1440] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:52:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:52:39.344059 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cdaf6-058b-47ed-b10a-556257da9b62 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:39.344607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cdaf6-058b-47ed-b10a-556257da9b62 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:39.344607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cdaf6-058b-47ed-b10a-556257da9b62 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:39.345974 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 09:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:52:39.351106 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01432f-5e6c-4aa9-b183-2bab6bae50b4 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:39.351559 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01432f-5e6c-4aa9-b183-2bab6bae50b4 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:39.351655 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01432f-5e6c-4aa9-b183-2bab6bae50b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:39.392404 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:39.416578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-3f01432f-5e6c-4aa9-b183-2bab6bae50b4 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:52:39.417912 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-3f01432f-5e6c-4aa9-b183-2bab6bae50b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:39.511811 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 09:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:52:39.550849 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cdaf6-058b-47ed-b10a-556257da9b62 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:52:39.552407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-5c5cdaf6-058b-47ed-b10a-556257da9b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:39.653549 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cdaf6-058b-47ed-b10a-556257da9b62 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:52:39.686000 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:39.727540 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2ee69-e258-4a52-8f54-9d1a70287bbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:52:39.728145 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2ee69-e258-4a52-8f54-9d1a70287bbf service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:39.728419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2ee69-e258-4a52-8f54-9d1a70287bbf service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:39.728688 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2ee69-e258-4a52-8f54-9d1a70287bbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:39.730305 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-edb2ee69-e258-4a52-8f54-9d1a70287bbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:39.836074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2ee69-e258-4a52-8f54-9d1a70287bbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:52:39.837511 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2ee69-e258-4a52-8f54-9d1a70287bbf service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:52:39.855473 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 718/1443] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:52:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:52:42.013678 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46d67a-103a-4587-80eb-7a1158493370 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:42.014215 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46d67a-103a-4587-80eb-7a1158493370 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:42.014215 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46d67a-103a-4587-80eb-7a1158493370 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:42.015608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 09:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:52:42.020700 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9657645-0e14-4666-85be-33e656a78a43 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:42.021112 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9657645-0e14-4666-85be-33e656a78a43 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:42.021237 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9657645-0e14-4666-85be-33e656a78a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:42.085952 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-d9657645-0e14-4666-85be-33e656a78a43 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:52:42.087162 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-d9657645-0e14-4666-85be-33e656a78a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:42.099978 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:42.182128 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 09:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:52:42.222255 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46d67a-103a-4587-80eb-7a1158493370 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:52:42.223758 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-8d46d67a-103a-4587-80eb-7a1158493370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:42.324128 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46d67a-103a-4587-80eb-7a1158493370 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:52:42.336423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:42.397841 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e338e0-5cdc-4fa5-9787-9ea9bc893231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:52:42.398467 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e338e0-5cdc-4fa5-9787-9ea9bc893231 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:42.398738 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e338e0-5cdc-4fa5-9787-9ea9bc893231 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:42.399002 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e338e0-5cdc-4fa5-9787-9ea9bc893231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:42.400559 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-14e338e0-5cdc-4fa5-9787-9ea9bc893231 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:42.507965 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e338e0-5cdc-4fa5-9787-9ea9bc893231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:52:42.509367 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e338e0-5cdc-4fa5-9787-9ea9bc893231 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:52:42.527148 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 727/1446] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:52:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:52:44.919666 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595e6e0-f41d-4966-b545-7b9843138cf4 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:44.920200 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595e6e0-f41d-4966-b545-7b9843138cf4 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:44.920200 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595e6e0-f41d-4966-b545-7b9843138cf4 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:44.921474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 09:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:52:44.926960 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99239f46-e4c7-4f01-bd16-2a2e733c112e None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:44.927349 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99239f46-e4c7-4f01-bd16-2a2e733c112e None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:44.927511 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99239f46-e4c7-4f01-bd16-2a2e733c112e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:44.975309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:44.992363 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-99239f46-e4c7-4f01-bd16-2a2e733c112e None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:52:44.993563 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-99239f46-e4c7-4f01-bd16-2a2e733c112e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:45.088994 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 09:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:52:45.127813 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595e6e0-f41d-4966-b545-7b9843138cf4 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:52:45.129323 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-9595e6e0-f41d-4966-b545-7b9843138cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:45.230459 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595e6e0-f41d-4966-b545-7b9843138cf4 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:52:45.269561 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:45.303782 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0ce5c-d0fa-4d61-b433-2954ce5acc2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:52:45.304629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0ce5c-d0fa-4d61-b433-2954ce5acc2d service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:45.304914 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0ce5c-d0fa-4d61-b433-2954ce5acc2d service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:45.305160 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0ce5c-d0fa-4d61-b433-2954ce5acc2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:45.306764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-8cd0ce5c-d0fa-4d61-b433-2954ce5acc2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:45.414722 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0ce5c-d0fa-4d61-b433-2954ce5acc2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:52:45.416150 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0ce5c-d0fa-4d61-b433-2954ce5acc2d service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:52:45.434137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 721/1449] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:52:47.572390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d75d72-8077-4f13-971f-94ea84b8e35b None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:47.572969 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d75d72-8077-4f13-971f-94ea84b8e35b None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:47.572969 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d75d72-8077-4f13-971f-94ea84b8e35b None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:47.574320 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 09:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:52:47.580130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094dad2-6c90-4897-9da7-2699a76b6500 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:47.580557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094dad2-6c90-4897-9da7-2699a76b6500 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:47.580693 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094dad2-6c90-4897-9da7-2699a76b6500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:47.645816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-e094dad2-6c90-4897-9da7-2699a76b6500 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:52:47.647040 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-e094dad2-6c90-4897-9da7-2699a76b6500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:47.673188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:47.749800 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 09:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:52:47.788490 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d75d72-8077-4f13-971f-94ea84b8e35b None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:52:47.789990 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-71d75d72-8077-4f13-971f-94ea84b8e35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:47.889846 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d75d72-8077-4f13-971f-94ea84b8e35b None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:52:47.909012 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:47.967221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6552f-dc0c-4167-a6ed-bfdd53585b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:52:47.968375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6552f-dc0c-4167-a6ed-bfdd53585b71 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:47.968649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6552f-dc0c-4167-a6ed-bfdd53585b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:47.968915 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6552f-dc0c-4167-a6ed-bfdd53585b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:47.973567 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-9fd6552f-dc0c-4167-a6ed-bfdd53585b71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:48.085340 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6552f-dc0c-4167-a6ed-bfdd53585b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:52:48.086776 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6552f-dc0c-4167-a6ed-bfdd53585b71 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:52:48.104716 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 730/1452] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:52:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:52:50.186320 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baa7d2-df9b-42e8-9514-b212ce5df5c4 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:50.186875 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baa7d2-df9b-42e8-9514-b212ce5df5c4 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:50.186875 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baa7d2-df9b-42e8-9514-b212ce5df5c4 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:50.188243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 09:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:52:50.193698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc48b8-626c-4c1b-82ee-30769b8bb2f0 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:50.194136 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc48b8-626c-4c1b-82ee-30769b8bb2f0 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:50.194266 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc48b8-626c-4c1b-82ee-30769b8bb2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:50.260623 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:50.263990 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-44bc48b8-626c-4c1b-82ee-30769b8bb2f0 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:52:50.265217 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-44bc48b8-626c-4c1b-82ee-30769b8bb2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:50.361635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 09:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:52:50.400477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baa7d2-df9b-42e8-9514-b212ce5df5c4 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:52:50.402034 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-21baa7d2-df9b-42e8-9514-b212ce5df5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:50.504623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baa7d2-df9b-42e8-9514-b212ce5df5c4 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:52:50.553056 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:50.577853 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a64f2-afc9-49f1-b211-f471380b04a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:52:50.578493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a64f2-afc9-49f1-b211-f471380b04a0 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:50.578771 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a64f2-afc9-49f1-b211-f471380b04a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:50.579037 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a64f2-afc9-49f1-b211-f471380b04a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:50.580621 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-532a64f2-afc9-49f1-b211-f471380b04a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:50.689738 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a64f2-afc9-49f1-b211-f471380b04a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:52:50.691348 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a64f2-afc9-49f1-b211-f471380b04a0 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:52:50.709338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 724/1455] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:52:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:52:52.760526 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237531c-44e7-4e3f-81e5-936586e8f33d None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:52.761087 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237531c-44e7-4e3f-81e5-936586e8f33d None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:52.761087 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237531c-44e7-4e3f-81e5-936586e8f33d None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:52.762439 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 09:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:52:52.767837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03066340-56e2-4432-8690-9836a31ac77e None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:52.768238 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03066340-56e2-4432-8690-9836a31ac77e None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:52.768330 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03066340-56e2-4432-8690-9836a31ac77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:52.833876 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-03066340-56e2-4432-8690-9836a31ac77e None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:52:52.835124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-03066340-56e2-4432-8690-9836a31ac77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:52.864777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:52.931661 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 09:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:52:52.969955 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237531c-44e7-4e3f-81e5-936586e8f33d None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:52:52.971530 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-7237531c-44e7-4e3f-81e5-936586e8f33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:53.073585 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237531c-44e7-4e3f-81e5-936586e8f33d None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:52:53.101733 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:53.146263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5b2f2-f341-4beb-b1cc-53b5eb650193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:52:53.146887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5b2f2-f341-4beb-b1cc-53b5eb650193 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:53.147164 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5b2f2-f341-4beb-b1cc-53b5eb650193 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:53.147434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5b2f2-f341-4beb-b1cc-53b5eb650193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:53.149008 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-94f5b2f2-f341-4beb-b1cc-53b5eb650193 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:53.253541 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5b2f2-f341-4beb-b1cc-53b5eb650193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:52:53.254927 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5b2f2-f341-4beb-b1cc-53b5eb650193 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:52:53.272743 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 733/1458] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:52:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:52:55.328383 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514e6da-7cf7-4109-923a-e05bc840856f None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:55.328928 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514e6da-7cf7-4109-923a-e05bc840856f None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:55.328928 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514e6da-7cf7-4109-923a-e05bc840856f None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:55.330387 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 09:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:52:55.335576 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d773c77-48f5-485f-8012-b8325b9b58ac None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:55.338663 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d773c77-48f5-485f-8012-b8325b9b58ac None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:55.338663 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d773c77-48f5-485f-8012-b8325b9b58ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:55.402217 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-0d773c77-48f5-485f-8012-b8325b9b58ac None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:52:55.403426 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-0d773c77-48f5-485f-8012-b8325b9b58ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:55.412084 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:55.498781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 09:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:52:55.535739 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514e6da-7cf7-4109-923a-e05bc840856f None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:52:55.537250 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-e514e6da-7cf7-4109-923a-e05bc840856f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:55.647211 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514e6da-7cf7-4109-923a-e05bc840856f None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:52:55.701185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:55.720012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde262a6-78da-4978-b92c-ce1c9041528f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:52:55.720607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde262a6-78da-4978-b92c-ce1c9041528f service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:55.720878 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde262a6-78da-4978-b92c-ce1c9041528f service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:55.721141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde262a6-78da-4978-b92c-ce1c9041528f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:55.722792 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-fde262a6-78da-4978-b92c-ce1c9041528f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:55.826707 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde262a6-78da-4978-b92c-ce1c9041528f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:52:55.828659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde262a6-78da-4978-b92c-ce1c9041528f service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:52:55.847777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 727/1461] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:52:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:52:57.863823 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e297139-2662-4c6a-b35e-61db8677431f None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:57.864414 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e297139-2662-4c6a-b35e-61db8677431f None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:57.864414 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e297139-2662-4c6a-b35e-61db8677431f None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:57.865727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 09:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:52:57.870921 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ade67-331c-4b02-b68a-da90c4cfd8f5 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:57.871332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ade67-331c-4b02-b68a-da90c4cfd8f5 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:57.871440 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ade67-331c-4b02-b68a-da90c4cfd8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:57.935747 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-384ade67-331c-4b02-b68a-da90c4cfd8f5 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:52:57.937467 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-384ade67-331c-4b02-b68a-da90c4cfd8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:57.973876 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:58.030927 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 09:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:52:58.069110 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e297139-2662-4c6a-b35e-61db8677431f None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:52:58.070668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-1e297139-2662-4c6a-b35e-61db8677431f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:58.169925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e297139-2662-4c6a-b35e-61db8677431f None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:52:58.207805 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:52:58.242096 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465439dc-9683-4323-a8c9-0f7d33014520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:52:58.242711 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465439dc-9683-4323-a8c9-0f7d33014520 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:52:58.242985 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465439dc-9683-4323-a8c9-0f7d33014520 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:52:58.243245 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465439dc-9683-4323-a8c9-0f7d33014520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:52:58.244791 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-465439dc-9683-4323-a8c9-0f7d33014520 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:52:58.351471 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465439dc-9683-4323-a8c9-0f7d33014520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:52:58.352890 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465439dc-9683-4323-a8c9-0f7d33014520 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:52:58.371362 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 736/1464] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:52:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:53:00.452311 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca54ea-debb-423c-b307-e57551839159 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:00.452825 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca54ea-debb-423c-b307-e57551839159 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:00.452825 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca54ea-debb-423c-b307-e57551839159 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:00.454152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 09:53:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:53:00.459356 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48f609-680c-4558-889b-370c5c110749 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:00.459804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48f609-680c-4558-889b-370c5c110749 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:00.459912 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48f609-680c-4558-889b-370c5c110749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:00.525412 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-2b48f609-680c-4558-889b-370c5c110749 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:53:00.526644 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-2b48f609-680c-4558-889b-370c5c110749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:00.544832 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:53:00.622447 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 09:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:53:00.658651 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca54ea-debb-423c-b307-e57551839159 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:53:00.660162 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-0cca54ea-debb-423c-b307-e57551839159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:00.771984 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca54ea-debb-423c-b307-e57551839159 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:53:00.837623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:53:00.845182 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd076dde-5355-4b14-aacf-91c71ac42a5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:53:00.845770 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd076dde-5355-4b14-aacf-91c71ac42a5d service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:00.846044 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd076dde-5355-4b14-aacf-91c71ac42a5d service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:00.846359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd076dde-5355-4b14-aacf-91c71ac42a5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:00.847945 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-bd076dde-5355-4b14-aacf-91c71ac42a5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:00.956477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd076dde-5355-4b14-aacf-91c71ac42a5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:53:00.957913 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd076dde-5355-4b14-aacf-91c71ac42a5d service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:53:00.976713 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 730/1467] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:53:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:53:03.025622 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882b55e-07db-4606-a5fb-13cc2606644b None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:03.026204 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882b55e-07db-4606-a5fb-13cc2606644b None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:03.026204 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882b55e-07db-4606-a5fb-13cc2606644b None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:03.027517 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 09:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:53:03.033277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8365267-ccec-4c88-b3d6-8120990c6e27 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:03.033731 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8365267-ccec-4c88-b3d6-8120990c6e27 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:03.033847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8365267-ccec-4c88-b3d6-8120990c6e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:03.101947 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-b8365267-ccec-4c88-b3d6-8120990c6e27 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:53:03.103210 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-b8365267-ccec-4c88-b3d6-8120990c6e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:03.151220 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:53:03.200908 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 09:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:53:03.237357 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882b55e-07db-4606-a5fb-13cc2606644b None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:53:03.238895 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-f882b55e-07db-4606-a5fb-13cc2606644b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:03.353643 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882b55e-07db-4606-a5fb-13cc2606644b None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:53:03.398123 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:53:03.427012 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87402ca-b63a-402c-9074-a49e2a303123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:53:03.427636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87402ca-b63a-402c-9074-a49e2a303123 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:03.427905 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87402ca-b63a-402c-9074-a49e2a303123 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:03.428168 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87402ca-b63a-402c-9074-a49e2a303123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:03.430054 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-d87402ca-b63a-402c-9074-a49e2a303123 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:03.537295 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87402ca-b63a-402c-9074-a49e2a303123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:53:03.538756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87402ca-b63a-402c-9074-a49e2a303123 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:53:03.556932 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 739/1470] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:53:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:53:13.199182 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=22 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:53:13.554685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=66 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:53:23.083671 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c1e76-e5d4-4d5c-8c99-b6c07a307477 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:23.084316 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c1e76-e5d4-4d5c-8c99-b6c07a307477 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:23.084316 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c1e76-e5d4-4d5c-8c99-b6c07a307477 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:23.085583 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 732/1471] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:53:23.090790 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87660958-0b26-4c62-8e6c-02bbb1087099 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:23.091296 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87660958-0b26-4c62-8e6c-02bbb1087099 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:23.091401 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87660958-0b26-4c62-8e6c-02bbb1087099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:23.155432 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-87660958-0b26-4c62-8e6c-02bbb1087099 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:53:23.156632 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-87660958-0b26-4c62-8e6c-02bbb1087099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:23.250404 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 740/1472] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:53:23.332848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b049791-fbec-4fb3-bfd4-8ea4d98bd9aa None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:23.336150 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b049791-fbec-4fb3-bfd4-8ea4d98bd9aa None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:23.336150 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b049791-fbec-4fb3-bfd4-8ea4d98bd9aa None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:23.336150 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 733/1473] 10.222.0.13 () {54 vars in 967 bytes} [Thu Aug 11 09:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:53:23.339448 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd121acd-a69b-4996-b488-1fa131c1122c None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:23.339731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd121acd-a69b-4996-b488-1fa131c1122c None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:23.339996 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd121acd-a69b-4996-b488-1fa131c1122c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:23.415520 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-bd121acd-a69b-4996-b488-1fa131c1122c None None] MFA Rules not processed for user `a7791be968594cea9c32b51a7b3454b6`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:53:23.416733 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-bd121acd-a69b-4996-b488-1fa131c1122c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:23.437946 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:53:23.492178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 741/1474] 10.222.0.13 () {58 vars in 1064 bytes} [Thu Aug 11 09:53:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:53:23.500398 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b049791-fbec-4fb3-bfd4-8ea4d98bd9aa None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:53:23.501976 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-2b049791-fbec-4fb3-bfd4-8ea4d98bd9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:23.602289 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b049791-fbec-4fb3-bfd4-8ea4d98bd9aa None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:53:23.673178 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37aedd-ec6c-47d3-ac19-f5ab5d5f0061 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7791be968594cea9c32b51a7b3454b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:53:23.673776 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37aedd-ec6c-47d3-ac19-f5ab5d5f0061 service glance] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:23.674046 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37aedd-ec6c-47d3-ac19-f5ab5d5f0061 service glance] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:23.674339 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37aedd-ec6c-47d3-ac19-f5ab5d5f0061 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:23.675908 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-1d37aedd-ec6c-47d3-ac19-f5ab5d5f0061 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:23.727759 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:53:23.781322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37aedd-ec6c-47d3-ac19-f5ab5d5f0061 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:53:23.782792 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37aedd-ec6c-47d3-ac19-f5ab5d5f0061 service glance] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:53:23.801072 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 734/1475] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:53:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:53:25.854381 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd7829-0f8f-4ad2-939d-e6a22a103bab None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:25.854954 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd7829-0f8f-4ad2-939d-e6a22a103bab None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:25.854954 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd7829-0f8f-4ad2-939d-e6a22a103bab None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:25.856314 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 742/1476] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:53:25.861688 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52788c-6a15-4551-ab31-1e01f4b0d26b None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:25.862141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52788c-6a15-4551-ab31-1e01f4b0d26b None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:25.862265 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52788c-6a15-4551-ab31-1e01f4b0d26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:25.927085 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-3b52788c-6a15-4551-ab31-1e01f4b0d26b None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:53:25.928533 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-3b52788c-6a15-4551-ab31-1e01f4b0d26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:26.146155 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 735/1477] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:53:26.167562 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd7829-0f8f-4ad2-939d-e6a22a103bab None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:53:26.169101 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-b7bd7829-0f8f-4ad2-939d-e6a22a103bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:26.295187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd7829-0f8f-4ad2-939d-e6a22a103bab None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:53:26.345029 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:53:26.395722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d4af3-7645-4e09-8c90-8f23e0349c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:53:26.396380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d4af3-7645-4e09-8c90-8f23e0349c5c admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:26.396609 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d4af3-7645-4e09-8c90-8f23e0349c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:26.396871 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d4af3-7645-4e09-8c90-8f23e0349c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:26.397498 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d4af3-7645-4e09-8c90-8f23e0349c5c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:53:26.399229 dv-cinder-815660-9-smb devstack@keystone.service[98478]: WARNING py.warnings [None req-239d4af3-7645-4e09-8c90-8f23e0349c5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 09:53:26.399229 dv-cinder-815660-9-smb devstack@keystone.service[98478]: warnings.warn(msg) Aug 11 09:53:26.399229 dv-cinder-815660-9-smb devstack@keystone.service[98478]: Aug 11 09:53:26.400382 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d4af3-7645-4e09-8c90-8f23e0349c5c admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:53:26.419960 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 743/1478] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Aug 11 09:53:26 2022] GET /identity/v3/projects => generated 2553 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:53:28.432048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d3d07-1a38-42cb-ad6b-3bca33f8315e None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:28.432567 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d3d07-1a38-42cb-ad6b-3bca33f8315e None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:28.432567 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d3d07-1a38-42cb-ad6b-3bca33f8315e None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:28.433864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 736/1479] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:53:28.439127 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec802a-3f8b-4c04-bdac-8f3890c7169e None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:28.439536 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec802a-3f8b-4c04-bdac-8f3890c7169e None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:28.439667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec802a-3f8b-4c04-bdac-8f3890c7169e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:28.509245 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-16ec802a-3f8b-4c04-bdac-8f3890c7169e None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:53:28.510476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-16ec802a-3f8b-4c04-bdac-8f3890c7169e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:28.605067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 744/1480] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:53:28.649064 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d3d07-1a38-42cb-ad6b-3bca33f8315e None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:53:28.650626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-5f7d3d07-1a38-42cb-ad6b-3bca33f8315e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:28.660873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:53:28.793137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d3d07-1a38-42cb-ad6b-3bca33f8315e None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:53:28.869879 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:53:28.901732 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c037e9-c4bc-48b6-ad11-1e06f2ced911 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:53:28.902354 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c037e9-c4bc-48b6-ad11-1e06f2ced911 service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:28.902632 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c037e9-c4bc-48b6-ad11-1e06f2ced911 service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:28.902897 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c037e9-c4bc-48b6-ad11-1e06f2ced911 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:28.905053 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-29c037e9-c4bc-48b6-ad11-1e06f2ced911 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:28.989659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c037e9-c4bc-48b6-ad11-1e06f2ced911 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:53:28.991261 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c037e9-c4bc-48b6-ad11-1e06f2ced911 service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:53:29.008880 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 737/1481] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:53:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:53:31.193681 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48775e77-b0b1-40b0-97f1-4dc0fc55f8b2 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:31.194287 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48775e77-b0b1-40b0-97f1-4dc0fc55f8b2 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:31.194388 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48775e77-b0b1-40b0-97f1-4dc0fc55f8b2 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:31.195718 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 745/1482] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:53:31.201094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975506a-c83e-4433-a84b-f68e06126114 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:31.201486 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975506a-c83e-4433-a84b-f68e06126114 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:31.201635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975506a-c83e-4433-a84b-f68e06126114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:31.266065 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-2975506a-c83e-4433-a84b-f68e06126114 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:53:31.267347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-2975506a-c83e-4433-a84b-f68e06126114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:31.314857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:53:31.364065 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 738/1483] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:53:31.400513 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48775e77-b0b1-40b0-97f1-4dc0fc55f8b2 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:53:31.402026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-48775e77-b0b1-40b0-97f1-4dc0fc55f8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:31.426483 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:53:31.517313 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48775e77-b0b1-40b0-97f1-4dc0fc55f8b2 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:53:31.587929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae3cd5-c2a5-440a-b516-bad866f94c34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:53:31.588521 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae3cd5-c2a5-440a-b516-bad866f94c34 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:31.588790 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae3cd5-c2a5-440a-b516-bad866f94c34 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:31.589051 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae3cd5-c2a5-440a-b516-bad866f94c34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:31.591180 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-74ae3cd5-c2a5-440a-b516-bad866f94c34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:31.663399 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:53:31.697704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae3cd5-c2a5-440a-b516-bad866f94c34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:53:31.699162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae3cd5-c2a5-440a-b516-bad866f94c34 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:53:31.717561 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 746/1484] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:53:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:53:33.766973 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91181f2c-1395-47dc-9380-a3ce11d9bcfe None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:33.767382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91181f2c-1395-47dc-9380-a3ce11d9bcfe None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:33.767513 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91181f2c-1395-47dc-9380-a3ce11d9bcfe None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:33.768913 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 739/1485] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:53:33.774218 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db3359-5963-4e2e-8eab-6b53e800c60f None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:33.774675 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db3359-5963-4e2e-8eab-6b53e800c60f None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:33.774780 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db3359-5963-4e2e-8eab-6b53e800c60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:33.848861 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-b5db3359-5963-4e2e-8eab-6b53e800c60f None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:53:33.850075 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-b5db3359-5963-4e2e-8eab-6b53e800c60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:33.963073 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 747/1486] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:53:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:53:34.001529 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91181f2c-1395-47dc-9380-a3ce11d9bcfe None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:53:34.003168 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-91181f2c-1395-47dc-9380-a3ce11d9bcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:34.125815 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91181f2c-1395-47dc-9380-a3ce11d9bcfe None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:53:34.211822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:53:34.214775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a9a0f-69a9-49c8-a4dd-d278efa35f9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:53:34.215497 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a9a0f-69a9-49c8-a4dd-d278efa35f9b service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:34.215772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a9a0f-69a9-49c8-a4dd-d278efa35f9b service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:34.216045 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a9a0f-69a9-49c8-a4dd-d278efa35f9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:34.217668 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-569a9a0f-69a9-49c8-a4dd-d278efa35f9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:34.336425 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a9a0f-69a9-49c8-a4dd-d278efa35f9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:53:34.337860 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a9a0f-69a9-49c8-a4dd-d278efa35f9b service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:53:34.360290 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 740/1487] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:53:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:53:36.551582 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429593b-52b7-4c51-a981-5a58714fa30c None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:36.552172 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429593b-52b7-4c51-a981-5a58714fa30c None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:36.552172 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429593b-52b7-4c51-a981-5a58714fa30c None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:36.553725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 748/1488] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:53:36.558871 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0693d-6e1f-4379-92e4-58f47f61bcc3 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:36.559319 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0693d-6e1f-4379-92e4-58f47f61bcc3 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:36.559429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0693d-6e1f-4379-92e4-58f47f61bcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:36.623089 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-6eb0693d-6e1f-4379-92e4-58f47f61bcc3 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:53:36.624271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-6eb0693d-6e1f-4379-92e4-58f47f61bcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:36.676578 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:53:36.721109 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 741/1489] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:53:36.761418 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429593b-52b7-4c51-a981-5a58714fa30c None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:53:36.762969 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-3429593b-52b7-4c51-a981-5a58714fa30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:36.798948 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:53:36.867550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429593b-52b7-4c51-a981-5a58714fa30c None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:53:36.940447 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48034d73-d7bb-49c8-b9c6-04aab403d1ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:53:36.940970 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48034d73-d7bb-49c8-b9c6-04aab403d1ca service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:36.941244 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48034d73-d7bb-49c8-b9c6-04aab403d1ca service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:36.941510 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48034d73-d7bb-49c8-b9c6-04aab403d1ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:36.943228 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-48034d73-d7bb-49c8-b9c6-04aab403d1ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:37.021748 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:53:37.049574 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48034d73-d7bb-49c8-b9c6-04aab403d1ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:53:37.051053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48034d73-d7bb-49c8-b9c6-04aab403d1ca service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:53:37.068474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 749/1490] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:53:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:53:39.449585 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b361a3c-0c35-4ea7-9749-9cdc2d5a94e7 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:39.450155 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b361a3c-0c35-4ea7-9749-9cdc2d5a94e7 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:39.450155 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b361a3c-0c35-4ea7-9749-9cdc2d5a94e7 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:39.451518 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 742/1491] 10.222.0.13 () {54 vars in 927 bytes} [Thu Aug 11 09:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:53:39.456719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b01d25-15f1-4c89-be15-4a2dc4d1dc6c None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:39.457150 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b01d25-15f1-4c89-be15-4a2dc4d1dc6c None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:39.457247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b01d25-15f1-4c89-be15-4a2dc4d1dc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:39.524270 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-e1b01d25-15f1-4c89-be15-4a2dc4d1dc6c None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:53:39.525482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-e1b01d25-15f1-4c89-be15-4a2dc4d1dc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:39.620698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 750/1492] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Aug 11 09:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:53:39.661139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b361a3c-0c35-4ea7-9749-9cdc2d5a94e7 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:53:39.662753 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-0b361a3c-0c35-4ea7-9749-9cdc2d5a94e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:39.761857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b361a3c-0c35-4ea7-9749-9cdc2d5a94e7 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:53:39.833030 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7e36f-6dd5-4232-84f5-07f73ee71c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:53:39.833630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7e36f-6dd5-4232-84f5-07f73ee71c6e service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:53:39.833898 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7e36f-6dd5-4232-84f5-07f73ee71c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:53:39.834192 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7e36f-6dd5-4232-84f5-07f73ee71c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:53:39.835764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-e7e7e36f-6dd5-4232-84f5-07f73ee71c6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:53:39.845259 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:53:39.943698 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7e36f-6dd5-4232-84f5-07f73ee71c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:53:39.945133 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7e36f-6dd5-4232-84f5-07f73ee71c6e service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:53:39.962989 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 743/1493] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:53:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:53:49.618938 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=82 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:53:49.960846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=50 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:55:28.156578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c074880-0843-4f22-ab54-6c5f7600806b None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:55:28.157039 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c074880-0843-4f22-ab54-6c5f7600806b None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:55:28.157142 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c074880-0843-4f22-ab54-6c5f7600806b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:55:28.230351 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-8c074880-0843-4f22-ab54-6c5f7600806b None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:55:28.231547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-8c074880-0843-4f22-ab54-6c5f7600806b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:55:28.327046 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 751/1494] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:55:28.335163 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c0441-6980-4f13-b210-3acdff38047a None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:55:28.335660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c0441-6980-4f13-b210-3acdff38047a None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:55:28.335768 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c0441-6980-4f13-b210-3acdff38047a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:55:28.409257 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-362c0441-6980-4f13-b210-3acdff38047a None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:55:28.410418 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-362c0441-6980-4f13-b210-3acdff38047a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:55:28.503105 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 744/1495] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:55:28.507732 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c074880-0843-4f22-ab54-6c5f7600806b None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:55:28.508954 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-8c074880-0843-4f22-ab54-6c5f7600806b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:55:28.520586 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c074880-0843-4f22-ab54-6c5f7600806b None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:55:28.579364 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:55:28.611724 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ad5a4-174b-421b-8a4b-97f5facfea7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:55:28.612357 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ad5a4-174b-421b-8a4b-97f5facfea7f admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:55:28.612626 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ad5a4-174b-421b-8a4b-97f5facfea7f admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:55:28.612890 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ad5a4-174b-421b-8a4b-97f5facfea7f admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:55:28.613511 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ad5a4-174b-421b-8a4b-97f5facfea7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:55:28.613804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ad5a4-174b-421b-8a4b-97f5facfea7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:55:28.614829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: WARNING py.warnings [None req-057ad5a4-174b-421b-8a4b-97f5facfea7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 09:55:28.614829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: warnings.warn(msg) Aug 11 09:55:28.614829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: Aug 11 09:55:28.615725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ad5a4-174b-421b-8a4b-97f5facfea7f admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:55:28.627450 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 752/1496] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 09:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:55:28.635811 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c0441-6980-4f13-b210-3acdff38047a None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:55:28.644845 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c0441-6980-4f13-b210-3acdff38047a None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:55:28.705987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:55:28.738945 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86353bd-d54e-46ae-8679-252972105afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:55:28.739547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86353bd-d54e-46ae-8679-252972105afa admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:55:28.739821 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86353bd-d54e-46ae-8679-252972105afa admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:55:28.740086 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86353bd-d54e-46ae-8679-252972105afa admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:55:28.740708 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86353bd-d54e-46ae-8679-252972105afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:55:28.742483 dv-cinder-815660-9-smb devstack@keystone.service[98479]: WARNING py.warnings [None req-f86353bd-d54e-46ae-8679-252972105afa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 09:55:28.742483 dv-cinder-815660-9-smb devstack@keystone.service[98479]: warnings.warn(msg) Aug 11 09:55:28.742483 dv-cinder-815660-9-smb devstack@keystone.service[98479]: Aug 11 09:55:28.744275 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86353bd-d54e-46ae-8679-252972105afa admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:55:28.871338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 745/1497] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:55:28 2022] POST /identity/v3/projects => generated 379 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:55:28.875613 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ad5a4-174b-421b-8a4b-97f5facfea7f admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:55:28.877117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-057ad5a4-174b-421b-8a4b-97f5facfea7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:55:28.909802 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ad5a4-174b-421b-8a4b-97f5facfea7f admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:55:29.007007 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705eea82-1ea0-4168-8f22-7479642b1c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:55:29.007531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705eea82-1ea0-4168-8f22-7479642b1c0c admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:55:29.007806 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705eea82-1ea0-4168-8f22-7479642b1c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:55:29.008074 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705eea82-1ea0-4168-8f22-7479642b1c0c admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:55:29.008680 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705eea82-1ea0-4168-8f22-7479642b1c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:55:29.009728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: WARNING py.warnings [None req-705eea82-1ea0-4168-8f22-7479642b1c0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 09:55:29.009728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: warnings.warn(msg) Aug 11 09:55:29.009728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: Aug 11 09:55:29.010969 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705eea82-1ea0-4168-8f22-7479642b1c0c admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:55:29.091815 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 753/1498] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:55:28 2022] POST /identity/v3/users => generated 290 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 09:55:29.096141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86353bd-d54e-46ae-8679-252972105afa admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:55:29.097639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-f86353bd-d54e-46ae-8679-252972105afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:55:29.158158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86353bd-d54e-46ae-8679-252972105afa admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:55:29.239404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:55:29.249478 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4366e-74c7-4488-8dc0-c7790fdda31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:55:29.250075 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4366e-74c7-4488-8dc0-c7790fdda31c admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:55:29.250381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4366e-74c7-4488-8dc0-c7790fdda31c admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:55:29.250652 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4366e-74c7-4488-8dc0-c7790fdda31c admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:55:29.251284 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af4366e-74c7-4488-8dc0-c7790fdda31c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:55:29.252321 dv-cinder-815660-9-smb devstack@keystone.service[98479]: WARNING py.warnings [None req-3af4366e-74c7-4488-8dc0-c7790fdda31c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 09:55:29.252321 dv-cinder-815660-9-smb devstack@keystone.service[98479]: warnings.warn(msg) Aug 11 09:55:29.252321 dv-cinder-815660-9-smb devstack@keystone.service[98479]: Aug 11 09:55:29.253197 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af4366e-74c7-4488-8dc0-c7790fdda31c admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:55:29.265187 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 746/1499] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 09:55:29.269298 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705eea82-1ea0-4168-8f22-7479642b1c0c admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:55:29.270840 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-705eea82-1ea0-4168-8f22-7479642b1c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:55:29.282717 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705eea82-1ea0-4168-8f22-7479642b1c0c admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:55:29.308290 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:55:29.377873 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f79ee-2843-4a3a-9409-e82f0eb9c1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:55:29.378571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f79ee-2843-4a3a-9409-e82f0eb9c1ee admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:55:29.378847 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f79ee-2843-4a3a-9409-e82f0eb9c1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:55:29.379113 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f79ee-2843-4a3a-9409-e82f0eb9c1ee admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:55:29.379746 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f79ee-2843-4a3a-9409-e82f0eb9c1ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:55:29.380742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: WARNING py.warnings [None req-af7f79ee-2843-4a3a-9409-e82f0eb9c1ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 09:55:29.380742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: warnings.warn(msg) Aug 11 09:55:29.380742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: Aug 11 09:55:29.381626 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f79ee-2843-4a3a-9409-e82f0eb9c1ee admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:55:29.394203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 754/1500] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:55:29.398358 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4366e-74c7-4488-8dc0-c7790fdda31c admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:55:29.400567 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-3af4366e-74c7-4488-8dc0-c7790fdda31c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:55:29.432981 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4366e-74c7-4488-8dc0-c7790fdda31c admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:55:29.524411 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d808b-53dc-4842-bb95-648afd2bb923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:55:29.525584 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d808b-53dc-4842-bb95-648afd2bb923 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:55:29.525854 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d808b-53dc-4842-bb95-648afd2bb923 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:55:29.526145 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d808b-53dc-4842-bb95-648afd2bb923 admin admin] PATH_INFO: `/v3/projects/91c045fad3ff43d790afa6a1c7494f47/users/669045115b4e4f9ba51e4589eac10310/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:55:29.547023 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d808b-53dc-4842-bb95-648afd2bb923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91c045fad3ff43d790afa6a1c7494f47, user_id=669045115b4e4f9ba51e4589eac10310, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:55:29.548043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: WARNING py.warnings [None req-847d808b-53dc-4842-bb95-648afd2bb923 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 09:55:29.548043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: warnings.warn(msg) Aug 11 09:55:29.548043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: Aug 11 09:55:29.549988 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d808b-53dc-4842-bb95-648afd2bb923 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:55:29.641485 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 747/1501] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:55:29 2022] PUT /identity/v3/projects/91c045fad3ff43d790afa6a1c7494f47/users/669045115b4e4f9ba51e4589eac10310/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:55:29.654286 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a49958-148f-49c8-bb91-07684a7f552e None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:55:29.654570 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a49958-148f-49c8-bb91-07684a7f552e None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:55:29.654839 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a49958-148f-49c8-bb91-07684a7f552e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:55:29.711107 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-09a49958-148f-49c8-bb91-07684a7f552e None None] MFA Rules not processed for user `669045115b4e4f9ba51e4589eac10310`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:55:29.715313 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-09a49958-148f-49c8-bb91-07684a7f552e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:55:29.787642 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 755/1502] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:55:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:55:29.800893 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cdd69-edaf-4c9d-a351-18e06e5faa72 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:55:29.801176 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cdd69-edaf-4c9d-a351-18e06e5faa72 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:55:29.801445 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cdd69-edaf-4c9d-a351-18e06e5faa72 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:55:29.802819 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 748/1503] 10.222.0.13 () {54 vars in 964 bytes} [Thu Aug 11 09:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:55:29.808208 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f60938-5c43-4f84-ba35-61a13cf9ce78 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:55:29.808513 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f60938-5c43-4f84-ba35-61a13cf9ce78 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:55:29.808779 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f60938-5c43-4f84-ba35-61a13cf9ce78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:55:29.839192 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:55:29.882626 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-18f60938-5c43-4f84-ba35-61a13cf9ce78 None None] MFA Rules not processed for user `740fc24dc2134f5ca2fba8caa9abb3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:55:29.883828 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-18f60938-5c43-4f84-ba35-61a13cf9ce78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:55:29.958236 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 756/1504] 10.222.0.13 () {58 vars in 1061 bytes} [Thu Aug 11 09:55:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:55:29.966243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cdd69-edaf-4c9d-a351-18e06e5faa72 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:55:29.967786 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-af0cdd69-edaf-4c9d-a351-18e06e5faa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:55:30.017123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:55:30.071767 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cdd69-edaf-4c9d-a351-18e06e5faa72 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:55:30.142567 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb4bb4-c8b2-480f-833e-f45757ac7618 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:55:30.143165 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb4bb4-c8b2-480f-833e-f45757ac7618 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:55:30.143441 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb4bb4-c8b2-480f-833e-f45757ac7618 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:55:30.143710 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb4bb4-c8b2-480f-833e-f45757ac7618 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:55:30.145292 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-9deb4bb4-c8b2-480f-833e-f45757ac7618 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:55:30.241014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb4bb4-c8b2-480f-833e-f45757ac7618 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:55:30.242536 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb4bb4-c8b2-480f-833e-f45757ac7618 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:55:30.246503 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:55:30.260173 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 749/1505] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:55:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:55:30.307807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c06aa-b345-4656-b870-3b845ed3d9e0 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:55:30.308212 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c06aa-b345-4656-b870-3b845ed3d9e0 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:55:30.308477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c06aa-b345-4656-b870-3b845ed3d9e0 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:55:30.309742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 757/1506] 10.222.0.13 () {52 vars in 830 bytes} [Thu Aug 11 09:55:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:55:30.313343 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb4bb4-c8b2-480f-833e-f45757ac7618 service cinder] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:55:30.314600 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-9deb4bb4-c8b2-480f-833e-f45757ac7618 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:55:30.411727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb4bb4-c8b2-480f-833e-f45757ac7618 service cinder] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:55:30.504874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8437a-6741-4300-9b79-1605bd8b5ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:55:30.505488 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8437a-6741-4300-9b79-1605bd8b5ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:55:30.505758 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8437a-6741-4300-9b79-1605bd8b5ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:55:30.506023 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8437a-6741-4300-9b79-1605bd8b5ba0 admin admin] PATH_INFO: `/v3/users/669045115b4e4f9ba51e4589eac10310` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:55:30.518011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8437a-6741-4300-9b79-1605bd8b5ba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=669045115b4e4f9ba51e4589eac10310)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:55:30.519140 dv-cinder-815660-9-smb devstack@keystone.service[98479]: WARNING py.warnings [None req-57b8437a-6741-4300-9b79-1605bd8b5ba0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 09:55:30.519140 dv-cinder-815660-9-smb devstack@keystone.service[98479]: warnings.warn(msg) Aug 11 09:55:30.519140 dv-cinder-815660-9-smb devstack@keystone.service[98479]: Aug 11 09:55:30.520337 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8437a-6741-4300-9b79-1605bd8b5ba0 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:55:30.530336 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:55:30.705161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-57b8437a-6741-4300-9b79-1605bd8b5ba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '669045115b4e4f9ba51e4589eac10310'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:55:30.728924 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-57b8437a-6741-4300-9b79-1605bd8b5ba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '669045115b4e4f9ba51e4589eac10310'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:55:30.730490 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-57b8437a-6741-4300-9b79-1605bd8b5ba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '669045115b4e4f9ba51e4589eac10310'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:55:30.744462 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-57b8437a-6741-4300-9b79-1605bd8b5ba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '669045115b4e4f9ba51e4589eac10310'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:55:30.788102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-57b8437a-6741-4300-9b79-1605bd8b5ba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '669045115b4e4f9ba51e4589eac10310'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:55:30.794497 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 750/1507] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:55:30 2022] DELETE /identity/v3/users/669045115b4e4f9ba51e4589eac10310 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:55:30.799003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a971f-df25-499c-a89e-d2b80adc8462 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:55:30.799360 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a971f-df25-499c-a89e-d2b80adc8462 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:55:30.799736 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a971f-df25-499c-a89e-d2b80adc8462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:55:30.858164 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-8f8a971f-df25-499c-a89e-d2b80adc8462 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:55:30.858934 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-8f8a971f-df25-499c-a89e-d2b80adc8462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:55:30.934653 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:55:30.946908 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 758/1508] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 09:55:30.962344 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8437a-6741-4300-9b79-1605bd8b5ba0 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:55:30.963593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-57b8437a-6741-4300-9b79-1605bd8b5ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:55:31.061166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8437a-6741-4300-9b79-1605bd8b5ba0 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:55:31.113594 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:55:31.132775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a93d52-04f2-4e60-8d05-96cc89f2574d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:55:31.133453 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a93d52-04f2-4e60-8d05-96cc89f2574d service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:55:31.133730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a93d52-04f2-4e60-8d05-96cc89f2574d service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:55:31.133998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a93d52-04f2-4e60-8d05-96cc89f2574d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:55:31.135656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-61a93d52-04f2-4e60-8d05-96cc89f2574d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:55:31.245269 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a93d52-04f2-4e60-8d05-96cc89f2574d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:55:31.246671 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a93d52-04f2-4e60-8d05-96cc89f2574d service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:55:31.265136 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 751/1509] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:55:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 09:55:31.716947 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a971f-df25-499c-a89e-d2b80adc8462 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:55:31.718224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-8f8a971f-df25-499c-a89e-d2b80adc8462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:55:31.729571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a971f-df25-499c-a89e-d2b80adc8462 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:55:31.833963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44192b2-574a-4a91-bc51-1cba737d79ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:55:31.834753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44192b2-574a-4a91-bc51-1cba737d79ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:55:31.835026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44192b2-574a-4a91-bc51-1cba737d79ae admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:55:31.835288 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44192b2-574a-4a91-bc51-1cba737d79ae admin admin] PATH_INFO: `/v3/projects/91c045fad3ff43d790afa6a1c7494f47` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:55:31.846337 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44192b2-574a-4a91-bc51-1cba737d79ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=91c045fad3ff43d790afa6a1c7494f47)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:55:31.847367 dv-cinder-815660-9-smb devstack@keystone.service[98478]: WARNING py.warnings [None req-e44192b2-574a-4a91-bc51-1cba737d79ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 09:55:31.847367 dv-cinder-815660-9-smb devstack@keystone.service[98478]: warnings.warn(msg) Aug 11 09:55:31.847367 dv-cinder-815660-9-smb devstack@keystone.service[98478]: Aug 11 09:55:31.848568 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44192b2-574a-4a91-bc51-1cba737d79ae admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:55:31.961489 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e44192b2-574a-4a91-bc51-1cba737d79ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91c045fad3ff43d790afa6a1c7494f47', 'request_id': 'req-e44192b2-574a-4a91-bc51-1cba737d79ae'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:55:31.968089 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e44192b2-574a-4a91-bc51-1cba737d79ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91c045fad3ff43d790afa6a1c7494f47', 'request_id': 'req-e44192b2-574a-4a91-bc51-1cba737d79ae'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:55:32.033767 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e44192b2-574a-4a91-bc51-1cba737d79ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91c045fad3ff43d790afa6a1c7494f47', 'request_id': 'req-e44192b2-574a-4a91-bc51-1cba737d79ae'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:55:32.064222 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e44192b2-574a-4a91-bc51-1cba737d79ae admin admin] The token cache is being invalidate because project 91c045fad3ff43d790afa6a1c7494f47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 09:55:32.064510 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e44192b2-574a-4a91-bc51-1cba737d79ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:55:32.065037 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e44192b2-574a-4a91-bc51-1cba737d79ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:55:32.066445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 759/1510] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:55:31 2022] DELETE /identity/v3/projects/91c045fad3ff43d790afa6a1c7494f47 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:55:41.263840 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=62 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:55:42.062239 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:57:04.265484 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054fe57-dbde-41c5-bdba-ea8fb667f2d2 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:04.266043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054fe57-dbde-41c5-bdba-ea8fb667f2d2 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:04.266043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054fe57-dbde-41c5-bdba-ea8fb667f2d2 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:04.267475 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 09:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:57:04.272183 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6adc6-06c3-4b6a-8e10-b736a6280a1e None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:04.272601 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6adc6-06c3-4b6a-8e10-b736a6280a1e None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:04.272732 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6adc6-06c3-4b6a-8e10-b736a6280a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:04.351561 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-e6c6adc6-06c3-4b6a-8e10-b736a6280a1e None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:57:04.352753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-e6c6adc6-06c3-4b6a-8e10-b736a6280a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:57:04.456980 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 09:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:57:04.614509 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054fe57-dbde-41c5-bdba-ea8fb667f2d2 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:57:04.618591 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-c054fe57-dbde-41c5-bdba-ea8fb667f2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:57:04.735218 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054fe57-dbde-41c5-bdba-ea8fb667f2d2 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:57:04.740509 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7652fbf-5723-4df1-92b8-9ed4784c8278 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:57:04.741113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7652fbf-5723-4df1-92b8-9ed4784c8278 service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:04.741385 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7652fbf-5723-4df1-92b8-9ed4784c8278 service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:04.741652 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7652fbf-5723-4df1-92b8-9ed4784c8278 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:04.750030 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7652fbf-5723-4df1-92b8-9ed4784c8278 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:57:04.751615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7652fbf-5723-4df1-92b8-9ed4784c8278 service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:57:04.761146 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 753/1513] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:57:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:57:05.577816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9904108-dc4d-4d51-8dc8-1ae62a0fe5ef None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:05.578395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9904108-dc4d-4d51-8dc8-1ae62a0fe5ef None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:05.578395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9904108-dc4d-4d51-8dc8-1ae62a0fe5ef None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:05.579705 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 09:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:57:05.584384 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a769e0-d5fe-44a9-ab24-e32d01562fc2 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:05.584834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a769e0-d5fe-44a9-ab24-e32d01562fc2 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:05.584945 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a769e0-d5fe-44a9-ab24-e32d01562fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:05.604210 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-14a769e0-d5fe-44a9-ab24-e32d01562fc2 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:57:05.605390 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-14a769e0-d5fe-44a9-ab24-e32d01562fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:57:05.613044 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 09:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:57:05.761876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9904108-dc4d-4d51-8dc8-1ae62a0fe5ef None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:57:05.776460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9904108-dc4d-4d51-8dc8-1ae62a0fe5ef None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:57:05.781771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c2b29-5a47-4ef4-b901-4284419b57fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:57:05.782379 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c2b29-5a47-4ef4-b901-4284419b57fd service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:05.782654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c2b29-5a47-4ef4-b901-4284419b57fd service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:05.782917 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c2b29-5a47-4ef4-b901-4284419b57fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:05.790938 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c2b29-5a47-4ef4-b901-4284419b57fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:57:05.792498 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c2b29-5a47-4ef4-b901-4284419b57fd service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:57:05.802272 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 762/1516] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:57:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:57:05.991085 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02670b20-2bf5-426c-a0f5-771a8b6b234f None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:05.991363 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02670b20-2bf5-426c-a0f5-771a8b6b234f None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:05.991635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02670b20-2bf5-426c-a0f5-771a8b6b234f None None] PATH_INFO: `/v3` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:05.993408 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 755/1517] 10.222.0.42 () {54 vars in 925 bytes} [Thu Aug 11 09:57:05 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:57:06.001802 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ec401-f3eb-4c39-b43c-c82db98c4259 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:06.002114 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ec401-f3eb-4c39-b43c-c82db98c4259 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:06.002392 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ec401-f3eb-4c39-b43c-c82db98c4259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:06.061057 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-926ec401-f3eb-4c39-b43c-c82db98c4259 None None] MFA Rules not processed for user `0061ce46df224f4491599ed10548b2ae`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:57:06.062284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-926ec401-f3eb-4c39-b43c-c82db98c4259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:57:06.079073 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:57:06.132124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 763/1518] 10.222.0.42 () {58 vars in 1015 bytes} [Thu Aug 11 09:57:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:57:15.302773 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60c9f6-e805-424b-9f05-bff3eeb09626 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:15.303320 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60c9f6-e805-424b-9f05-bff3eeb09626 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:15.303320 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60c9f6-e805-424b-9f05-bff3eeb09626 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:15.305142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 756/1519] 10.222.0.13 () {54 vars in 961 bytes} [Thu Aug 11 09:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:57:15.310133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e5110-3fa3-4241-8d95-fda48bfa81aa None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:15.310537 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e5110-3fa3-4241-8d95-fda48bfa81aa None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:15.310682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e5110-3fa3-4241-8d95-fda48bfa81aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:15.329408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-f36e5110-3fa3-4241-8d95-fda48bfa81aa None None] MFA Rules not processed for user `0061ce46df224f4491599ed10548b2ae`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:57:15.330702 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-f36e5110-3fa3-4241-8d95-fda48bfa81aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:57:15.339059 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 764/1520] 10.222.0.13 () {58 vars in 1058 bytes} [Thu Aug 11 09:57:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:57:15.346329 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60c9f6-e805-424b-9f05-bff3eeb09626 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:57:15.360122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60c9f6-e805-424b-9f05-bff3eeb09626 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:57:15.365023 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae58f01-430f-43b5-acba-432c7a267492 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0061ce46df224f4491599ed10548b2ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:57:15.365612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae58f01-430f-43b5-acba-432c7a267492 service placement] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:15.365888 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae58f01-430f-43b5-acba-432c7a267492 service placement] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:15.366196 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae58f01-430f-43b5-acba-432c7a267492 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:15.375142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae58f01-430f-43b5-acba-432c7a267492 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:57:15.376712 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae58f01-430f-43b5-acba-432c7a267492 service placement] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:57:15.386171 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 757/1521] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:57:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:57:17.027782 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20fcba-24d9-4549-955e-f2726fae74b9 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:17.028403 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20fcba-24d9-4549-955e-f2726fae74b9 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:17.028403 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20fcba-24d9-4549-955e-f2726fae74b9 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:17.029656 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 09:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:57:17.034433 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51e976-f704-4e88-9b44-c6b675614ed8 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:17.034842 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51e976-f704-4e88-9b44-c6b675614ed8 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:17.034975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51e976-f704-4e88-9b44-c6b675614ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:17.056412 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-dd51e976-f704-4e88-9b44-c6b675614ed8 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:57:17.057603 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-dd51e976-f704-4e88-9b44-c6b675614ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:57:17.065311 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 09:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 09:57:17.217125 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20fcba-24d9-4549-955e-f2726fae74b9 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:57:17.232004 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20fcba-24d9-4549-955e-f2726fae74b9 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:57:17.237473 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478da9e-9f0c-4e74-a166-f44fccf7516c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:57:17.238067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478da9e-9f0c-4e74-a166-f44fccf7516c service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:17.238375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478da9e-9f0c-4e74-a166-f44fccf7516c service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:17.238682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478da9e-9f0c-4e74-a166-f44fccf7516c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:17.250397 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478da9e-9f0c-4e74-a166-f44fccf7516c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:57:17.251979 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478da9e-9f0c-4e74-a166-f44fccf7516c service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:57:17.262040 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 766/1524] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:57:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:57:18.071073 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70227bd3-96f7-4d4e-b951-e76e21d75b02 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:18.071630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70227bd3-96f7-4d4e-b951-e76e21d75b02 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:18.071630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70227bd3-96f7-4d4e-b951-e76e21d75b02 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:18.072953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 09:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:57:18.077616 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4aeae-0340-47dc-be82-c71ec9dea11d None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:18.078100 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4aeae-0340-47dc-be82-c71ec9dea11d None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:18.078212 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4aeae-0340-47dc-be82-c71ec9dea11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:18.097952 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-73e4aeae-0340-47dc-be82-c71ec9dea11d None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:57:18.099165 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-73e4aeae-0340-47dc-be82-c71ec9dea11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:57:18.107490 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 09:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:57:18.256765 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70227bd3-96f7-4d4e-b951-e76e21d75b02 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:57:18.270841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70227bd3-96f7-4d4e-b951-e76e21d75b02 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:57:18.276743 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02ff8b-a47f-4f68-b7a7-c6bba8187de0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:57:18.277320 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02ff8b-a47f-4f68-b7a7-c6bba8187de0 service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:18.277596 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02ff8b-a47f-4f68-b7a7-c6bba8187de0 service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:18.277864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02ff8b-a47f-4f68-b7a7-c6bba8187de0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:18.285671 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02ff8b-a47f-4f68-b7a7-c6bba8187de0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:57:18.287277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02ff8b-a47f-4f68-b7a7-c6bba8187de0 service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:57:18.296908 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 760/1527] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:57:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 09:57:22.527307 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcff66-29bb-44bc-8387-10dbd81c25af None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:22.527847 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcff66-29bb-44bc-8387-10dbd81c25af None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:22.527847 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcff66-29bb-44bc-8387-10dbd81c25af None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:22.529213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 09:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:57:22.534535 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe0f09-c818-4b4b-abd1-a2a3c8f65b72 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:22.535006 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe0f09-c818-4b4b-abd1-a2a3c8f65b72 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:22.535107 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe0f09-c818-4b4b-abd1-a2a3c8f65b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:22.554613 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-47fe0f09-c818-4b4b-abd1-a2a3c8f65b72 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:57:22.555787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-47fe0f09-c818-4b4b-abd1-a2a3c8f65b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:57:22.563372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 09:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:57:22.635472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcff66-29bb-44bc-8387-10dbd81c25af None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:57:22.637316 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-01dcff66-29bb-44bc-8387-10dbd81c25af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:57:22.715129 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcff66-29bb-44bc-8387-10dbd81c25af None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:57:22.718644 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c113282-dc67-4391-9e85-5cdf08124d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:57:22.719237 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c113282-dc67-4391-9e85-5cdf08124d05 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:22.719509 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c113282-dc67-4391-9e85-5cdf08124d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:22.719775 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c113282-dc67-4391-9e85-5cdf08124d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:22.729165 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c113282-dc67-4391-9e85-5cdf08124d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:57:22.730616 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c113282-dc67-4391-9e85-5cdf08124d05 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:57:22.739975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 769/1530] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:57:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:57:24.735001 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f722d3-0389-4590-942e-a8f93a4f2d47 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:24.735573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f722d3-0389-4590-942e-a8f93a4f2d47 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:24.735573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f722d3-0389-4590-942e-a8f93a4f2d47 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:24.736873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 09:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:57:24.742576 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ae336-b7fb-4473-a746-e18a0feb8747 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:24.743004 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ae336-b7fb-4473-a746-e18a0feb8747 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:24.743151 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ae336-b7fb-4473-a746-e18a0feb8747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:24.762838 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-410ae336-b7fb-4473-a746-e18a0feb8747 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:57:24.764028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-410ae336-b7fb-4473-a746-e18a0feb8747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:57:24.771675 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 09:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:57:24.807560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f722d3-0389-4590-942e-a8f93a4f2d47 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:57:24.818522 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f722d3-0389-4590-942e-a8f93a4f2d47 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:57:24.822671 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3015cf-4312-4e67-9e8c-e2193fd9e81b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:57:24.823259 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3015cf-4312-4e67-9e8c-e2193fd9e81b service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:24.823530 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3015cf-4312-4e67-9e8c-e2193fd9e81b service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:24.823892 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3015cf-4312-4e67-9e8c-e2193fd9e81b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:24.832780 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3015cf-4312-4e67-9e8c-e2193fd9e81b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:57:24.834225 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3015cf-4312-4e67-9e8c-e2193fd9e81b service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:57:24.843376 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 763/1533] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:57:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:57:28.259301 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db34d21-589e-423c-a5c9-8c48f68d47fe None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:28.259825 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db34d21-589e-423c-a5c9-8c48f68d47fe None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:28.259825 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db34d21-589e-423c-a5c9-8c48f68d47fe None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:28.261181 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 09:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:57:28.266195 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ab4cd-7924-4144-a49d-e3ac71de5cf4 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:28.266629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ab4cd-7924-4144-a49d-e3ac71de5cf4 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:28.266732 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ab4cd-7924-4144-a49d-e3ac71de5cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:28.285645 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-767ab4cd-7924-4144-a49d-e3ac71de5cf4 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:57:28.286884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-767ab4cd-7924-4144-a49d-e3ac71de5cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:57:28.295288 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 09:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:57:28.596136 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db34d21-589e-423c-a5c9-8c48f68d47fe None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:57:28.597891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-2db34d21-589e-423c-a5c9-8c48f68d47fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:57:28.662722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:57:28.676433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db34d21-589e-423c-a5c9-8c48f68d47fe None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:57:28.680022 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75bf9e-0ebb-4754-b955-e79edc8a0246 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:57:28.680617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75bf9e-0ebb-4754-b955-e79edc8a0246 service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:28.682722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75bf9e-0ebb-4754-b955-e79edc8a0246 service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:28.682722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75bf9e-0ebb-4754-b955-e79edc8a0246 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:28.690086 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75bf9e-0ebb-4754-b955-e79edc8a0246 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:57:28.691562 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75bf9e-0ebb-4754-b955-e79edc8a0246 service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:57:28.700861 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 772/1536] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:57:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:57:30.700640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2692f-e178-4859-9f76-316a5974e9b1 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:30.701156 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2692f-e178-4859-9f76-316a5974e9b1 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:30.701156 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2692f-e178-4859-9f76-316a5974e9b1 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:30.702544 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 09:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:57:30.707651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc3826-008a-4786-9bb3-687650fdf791 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:30.708078 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc3826-008a-4786-9bb3-687650fdf791 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:30.708181 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc3826-008a-4786-9bb3-687650fdf791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:30.727251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-79dc3826-008a-4786-9bb3-687650fdf791 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:57:30.728434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-79dc3826-008a-4786-9bb3-687650fdf791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:57:30.736208 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 09:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:57:31.037635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2692f-e178-4859-9f76-316a5974e9b1 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:57:31.039989 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-02d2692f-e178-4859-9f76-316a5974e9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:57:31.053293 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2692f-e178-4859-9f76-316a5974e9b1 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:57:31.057520 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd215c-0b00-4b15-a928-5cf664d4dace service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:57:31.058132 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd215c-0b00-4b15-a928-5cf664d4dace service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:57:31.058417 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd215c-0b00-4b15-a928-5cf664d4dace service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:57:31.058686 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd215c-0b00-4b15-a928-5cf664d4dace service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:57:31.067492 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd215c-0b00-4b15-a928-5cf664d4dace service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:57:31.068913 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd215c-0b00-4b15-a928-5cf664d4dace service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:57:31.078100 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 766/1539] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:57:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:57:40.722543 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=11 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:57:41.074036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:58:58.431471 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d7f69-cad3-4845-8565-0a58084440d7 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:58.432133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d7f69-cad3-4845-8565-0a58084440d7 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:58.432133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d7f69-cad3-4845-8565-0a58084440d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:58.467132 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-799d7f69-cad3-4845-8565-0a58084440d7 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:58:58.468381 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-799d7f69-cad3-4845-8565-0a58084440d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:58:58.477242 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 774/1540] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 09:58:58.485759 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbed98a-faa3-47fd-8656-6eec56f88573 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:58.486754 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbed98a-faa3-47fd-8656-6eec56f88573 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:58.487283 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbed98a-faa3-47fd-8656-6eec56f88573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:58.500926 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b314c0-b765-4002-b9b1-2620f4413a62 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:58.501252 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b314c0-b765-4002-b9b1-2620f4413a62 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:58.501474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b314c0-b765-4002-b9b1-2620f4413a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:58.523140 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-5cbed98a-faa3-47fd-8656-6eec56f88573 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:58:58.524385 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-5cbed98a-faa3-47fd-8656-6eec56f88573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:58:58.531971 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-45b314c0-b765-4002-b9b1-2620f4413a62 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:58:58.533401 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-45b314c0-b765-4002-b9b1-2620f4413a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:58:58.539580 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 767/1541] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:58:58.546728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 775/1542] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 11 09:58:58.550715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbed98a-faa3-47fd-8656-6eec56f88573 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:58:58.557512 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc17b50-8667-457f-ae0a-0fd62906e9d9 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:58.557935 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc17b50-8667-457f-ae0a-0fd62906e9d9 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:58.558368 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc17b50-8667-457f-ae0a-0fd62906e9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:58.564608 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbed98a-faa3-47fd-8656-6eec56f88573 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:58:58.578759 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a21c0-4abd-4f17-93b6-a3286073cdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:58:58.579381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a21c0-4abd-4f17-93b6-a3286073cdf1 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:58.579654 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a21c0-4abd-4f17-93b6-a3286073cdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:58.579921 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a21c0-4abd-4f17-93b6-a3286073cdf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:58.580831 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a21c0-4abd-4f17-93b6-a3286073cdf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:58:58.581136 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a21c0-4abd-4f17-93b6-a3286073cdf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:58:58.582187 dv-cinder-815660-9-smb devstack@keystone.service[98479]: WARNING py.warnings [None req-9c0a21c0-4abd-4f17-93b6-a3286073cdf1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 09:58:58.582187 dv-cinder-815660-9-smb devstack@keystone.service[98479]: warnings.warn(msg) Aug 11 09:58:58.582187 dv-cinder-815660-9-smb devstack@keystone.service[98479]: Aug 11 09:58:58.583070 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a21c0-4abd-4f17-93b6-a3286073cdf1 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:58:58.595534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-1fc17b50-8667-457f-ae0a-0fd62906e9d9 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:58:58.597293 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-1fc17b50-8667-457f-ae0a-0fd62906e9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:58:58.606663 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 768/1543] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 09:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:58:58.607930 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f69886-dd3f-43c2-bfd9-4fbe86c64d38 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:58.608214 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f69886-dd3f-43c2-bfd9-4fbe86c64d38 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:58.614403 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f69886-dd3f-43c2-bfd9-4fbe86c64d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:58.619415 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 776/1544] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:58:58.621305 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e7e43-2f61-4ed9-9f90-65fe639b9b95 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:58.621584 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e7e43-2f61-4ed9-9f90-65fe639b9b95 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:58.621852 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e7e43-2f61-4ed9-9f90-65fe639b9b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:58.636506 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-75f69886-dd3f-43c2-bfd9-4fbe86c64d38 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:58:58.637712 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-75f69886-dd3f-43c2-bfd9-4fbe86c64d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:58:58.645868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 769/1545] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:58:58.647126 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ed142-21a2-420c-b94a-9f97e8ebc449 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:58.647462 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ed142-21a2-420c-b94a-9f97e8ebc449 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:58.647731 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ed142-21a2-420c-b94a-9f97e8ebc449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:58.655030 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-ab4e7e43-2f61-4ed9-9f90-65fe639b9b95 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:58:58.656253 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ab4e7e43-2f61-4ed9-9f90-65fe639b9b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:58:58.668353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-635ed142-21a2-420c-b94a-9f97e8ebc449 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:58:58.669917 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-635ed142-21a2-420c-b94a-9f97e8ebc449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:58:58.673997 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 777/1546] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:58:58.674976 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e7e43-2f61-4ed9-9f90-65fe639b9b95 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:58:58.680249 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 770/1547] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:58:58.682114 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee434e-c249-4760-99c0-d52c59e12eb1 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:58.682400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee434e-c249-4760-99c0-d52c59e12eb1 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:58.682698 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee434e-c249-4760-99c0-d52c59e12eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:58.687354 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e7e43-2f61-4ed9-9f90-65fe639b9b95 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:58:58.692060 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656f631-12cd-4941-937c-aaf5a804cce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:58:58.692659 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656f631-12cd-4941-937c-aaf5a804cce9 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:58.692933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656f631-12cd-4941-937c-aaf5a804cce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:58.693201 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656f631-12cd-4941-937c-aaf5a804cce9 admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:58.693842 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656f631-12cd-4941-937c-aaf5a804cce9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:58:58.694228 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656f631-12cd-4941-937c-aaf5a804cce9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:58:58.695900 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656f631-12cd-4941-937c-aaf5a804cce9 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:58:58.702266 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-66ee434e-c249-4760-99c0-d52c59e12eb1 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:58:58.703437 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-66ee434e-c249-4760-99c0-d52c59e12eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:58:58.707635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 778/1548] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 09:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:58:58.708489 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656f631-12cd-4941-937c-aaf5a804cce9 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:58:58.711399 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 771/1549] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:58:58.712538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5389e8-5ea1-4f2b-a4e0-ca560a5aee6d None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:58.712817 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5389e8-5ea1-4f2b-a4e0-ca560a5aee6d None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:58.713081 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5389e8-5ea1-4f2b-a4e0-ca560a5aee6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:58.721986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656f631-12cd-4941-937c-aaf5a804cce9 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:58:58.727399 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd54772-d1d6-48ea-8b10-5832e1ed537c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:58:58.727943 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd54772-d1d6-48ea-8b10-5832e1ed537c admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:58.728220 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd54772-d1d6-48ea-8b10-5832e1ed537c admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:58.728492 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd54772-d1d6-48ea-8b10-5832e1ed537c admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:58.729241 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd54772-d1d6-48ea-8b10-5832e1ed537c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:58:58.730293 dv-cinder-815660-9-smb devstack@keystone.service[98478]: WARNING py.warnings [None req-bdd54772-d1d6-48ea-8b10-5832e1ed537c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 09:58:58.730293 dv-cinder-815660-9-smb devstack@keystone.service[98478]: warnings.warn(msg) Aug 11 09:58:58.730293 dv-cinder-815660-9-smb devstack@keystone.service[98478]: Aug 11 09:58:58.731487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd54772-d1d6-48ea-8b10-5832e1ed537c admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:58:58.733031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-8f5389e8-5ea1-4f2b-a4e0-ca560a5aee6d None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:58:58.734392 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-8f5389e8-5ea1-4f2b-a4e0-ca560a5aee6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:58:58.745080 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 772/1550] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:58:58.746965 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160b0fe-ff56-49c9-8586-a8edbfdaf5c5 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:58.747471 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160b0fe-ff56-49c9-8586-a8edbfdaf5c5 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:58.747957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160b0fe-ff56-49c9-8586-a8edbfdaf5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:58.768963 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-7160b0fe-ff56-49c9-8586-a8edbfdaf5c5 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:58:58.770212 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-7160b0fe-ff56-49c9-8586-a8edbfdaf5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:58:58.777943 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 773/1551] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:58:58.786691 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3db637-ef10-4d26-ad76-e7f1421444c8 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:58.786691 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3db637-ef10-4d26-ad76-e7f1421444c8 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:58.786691 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3db637-ef10-4d26-ad76-e7f1421444c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:58.800229 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-8a3db637-ef10-4d26-ad76-e7f1421444c8 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:58:58.801505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-8a3db637-ef10-4d26-ad76-e7f1421444c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:58:58.810051 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 774/1552] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:58:58.811244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5551a9-a906-4fda-85de-ccc5261705b6 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:58.811543 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5551a9-a906-4fda-85de-ccc5261705b6 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:58.811795 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5551a9-a906-4fda-85de-ccc5261705b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:58.830228 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-5e5551a9-a906-4fda-85de-ccc5261705b6 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:58:58.831407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-5e5551a9-a906-4fda-85de-ccc5261705b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:58:58.839351 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 775/1553] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:58:58.840488 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a473f8f-fba3-4ae5-98a0-a75404d50377 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:58.840773 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a473f8f-fba3-4ae5-98a0-a75404d50377 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:58.841046 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a473f8f-fba3-4ae5-98a0-a75404d50377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:58.859465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-9a473f8f-fba3-4ae5-98a0-a75404d50377 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:58:58.860616 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-9a473f8f-fba3-4ae5-98a0-a75404d50377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:58:58.869203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 776/1554] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:58:58.869760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a473f8f-fba3-4ae5-98a0-a75404d50377 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:58:58.878647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a473f8f-fba3-4ae5-98a0-a75404d50377 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:58:58.883300 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602ac06-eede-4167-9d36-4e7205adca04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:58:58.883868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602ac06-eede-4167-9d36-4e7205adca04 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:58.884145 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602ac06-eede-4167-9d36-4e7205adca04 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:58.884417 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602ac06-eede-4167-9d36-4e7205adca04 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:58.885019 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602ac06-eede-4167-9d36-4e7205adca04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:58:58.886954 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602ac06-eede-4167-9d36-4e7205adca04 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:58:58.891531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 779/1555] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:58:58 2022] POST /identity/v3/projects => generated 367 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:58:58.891531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0c5ce-5a43-4f29-b7b9-6e496dbe6ea2 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:58.891531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0c5ce-5a43-4f29-b7b9-6e496dbe6ea2 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:58.891531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0c5ce-5a43-4f29-b7b9-6e496dbe6ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:58.908962 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-2ed0c5ce-5a43-4f29-b7b9-6e496dbe6ea2 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:58:58.910211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-2ed0c5ce-5a43-4f29-b7b9-6e496dbe6ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:58:58.976582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 777/1556] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:58:58 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:58:58.978812 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd48d8-020a-4a12-ab4c-a233cdab5fc8 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:58.979259 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd48d8-020a-4a12-ab4c-a233cdab5fc8 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:58.979894 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd48d8-020a-4a12-ab4c-a233cdab5fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:58.980020 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 780/1557] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:58:58.981609 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0c5ce-5a43-4f29-b7b9-6e496dbe6ea2 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:58:58.993987 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0c5ce-5a43-4f29-b7b9-6e496dbe6ea2 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:58:59.005737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-d2fd48d8-020a-4a12-ab4c-a233cdab5fc8 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:58:59.007070 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-d2fd48d8-020a-4a12-ab4c-a233cdab5fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:58:59.057837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837db31b-4e45-4e09-9267-b574a5e26464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:58:59.058472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837db31b-4e45-4e09-9267-b574a5e26464 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:59.058749 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837db31b-4e45-4e09-9267-b574a5e26464 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:59.059019 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837db31b-4e45-4e09-9267-b574a5e26464 admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:59.059774 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837db31b-4e45-4e09-9267-b574a5e26464 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:58:59.060076 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837db31b-4e45-4e09-9267-b574a5e26464 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:58:59.061696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837db31b-4e45-4e09-9267-b574a5e26464 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:58:59.064651 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 778/1558] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:58:59.066010 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6a530-495a-4640-a292-b1cd21dcfec8 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:59.066319 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6a530-495a-4640-a292-b1cd21dcfec8 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:59.066587 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6a530-495a-4640-a292-b1cd21dcfec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:59.083948 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 781/1559] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 09:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:58:59.083948 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837db31b-4e45-4e09-9267-b574a5e26464 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:58:59.086203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-0ef6a530-495a-4640-a292-b1cd21dcfec8 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:58:59.087379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-0ef6a530-495a-4640-a292-b1cd21dcfec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:58:59.089676 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837db31b-4e45-4e09-9267-b574a5e26464 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:58:59.094386 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb9efb-2121-423e-9014-173b55e4b31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:58:59.094992 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb9efb-2121-423e-9014-173b55e4b31a admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:59.095481 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb9efb-2121-423e-9014-173b55e4b31a admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:59.095603 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 779/1560] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:58:59.095697 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb9efb-2121-423e-9014-173b55e4b31a admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:59.096164 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb9efb-2121-423e-9014-173b55e4b31a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:58:59.096313 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6a530-495a-4640-a292-b1cd21dcfec8 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:58:59.096467 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb9efb-2121-423e-9014-173b55e4b31a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:58:59.098043 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb9efb-2121-423e-9014-173b55e4b31a admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:58:59.108442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6a530-495a-4640-a292-b1cd21dcfec8 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:58:59.117687 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 782/1561] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 09:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:58:59.117687 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb9efb-2121-423e-9014-173b55e4b31a admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:58:59.117926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd8a57-8ad4-4efb-b608-91935667ce37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:58:59.117926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd8a57-8ad4-4efb-b608-91935667ce37 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:59.117926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd8a57-8ad4-4efb-b608-91935667ce37 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:59.117926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd8a57-8ad4-4efb-b608-91935667ce37 admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:59.118278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd8a57-8ad4-4efb-b608-91935667ce37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:58:59.118278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd8a57-8ad4-4efb-b608-91935667ce37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:58:59.118278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd8a57-8ad4-4efb-b608-91935667ce37 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:58:59.120924 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb9efb-2121-423e-9014-173b55e4b31a admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:58:59.125536 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0aee-51bb-4bf0-a364-b3b1ca4f86cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:58:59.126137 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0aee-51bb-4bf0-a364-b3b1ca4f86cd admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:59.126417 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0aee-51bb-4bf0-a364-b3b1ca4f86cd admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:59.126687 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0aee-51bb-4bf0-a364-b3b1ca4f86cd admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:59.127288 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c0aee-51bb-4bf0-a364-b3b1ca4f86cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:58:59.136222 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 780/1562] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 09:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:58:59.136388 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c0aee-51bb-4bf0-a364-b3b1ca4f86cd admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:58:59.136487 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd8a57-8ad4-4efb-b608-91935667ce37 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:58:59.139084 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:58:59.139356 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd8a57-8ad4-4efb-b608-91935667ce37 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:58:59.144355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d9cfa-3a6a-486a-aa81-a85315adf987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:58:59.144932 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d9cfa-3a6a-486a-aa81-a85315adf987 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:59.145204 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d9cfa-3a6a-486a-aa81-a85315adf987 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:59.145467 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d9cfa-3a6a-486a-aa81-a85315adf987 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:59.146069 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d9cfa-3a6a-486a-aa81-a85315adf987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:58:59.149039 dv-cinder-815660-9-smb devstack@keystone.service[98479]: WARNING py.warnings [None req-2d1d9cfa-3a6a-486a-aa81-a85315adf987 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 09:58:59.149039 dv-cinder-815660-9-smb devstack@keystone.service[98479]: warnings.warn(msg) Aug 11 09:58:59.149039 dv-cinder-815660-9-smb devstack@keystone.service[98479]: Aug 11 09:58:59.149039 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d9cfa-3a6a-486a-aa81-a85315adf987 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:58:59.223429 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 783/1563] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:58:59 2022] POST /identity/v3/users => generated 284 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:58:59.225272 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0aee-51bb-4bf0-a364-b3b1ca4f86cd admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:58:59.234205 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0aee-51bb-4bf0-a364-b3b1ca4f86cd admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:58:59.238946 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ea2cf-a67e-4df4-a944-aca16f041773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:58:59.239601 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ea2cf-a67e-4df4-a944-aca16f041773 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:59.240080 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ea2cf-a67e-4df4-a944-aca16f041773 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:59.240408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ea2cf-a67e-4df4-a944-aca16f041773 admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:59.241235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ea2cf-a67e-4df4-a944-aca16f041773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:58:59.241576 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ea2cf-a67e-4df4-a944-aca16f041773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:58:59.243593 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ea2cf-a67e-4df4-a944-aca16f041773 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:58:59.247075 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 781/1564] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:58:59 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:58:59.251059 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d9cfa-3a6a-486a-aa81-a85315adf987 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:58:59.262772 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 784/1565] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 09:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:58:59.262772 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ea2cf-a67e-4df4-a944-aca16f041773 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:58:59.266144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ea2cf-a67e-4df4-a944-aca16f041773 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:58:59.266939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d9cfa-3a6a-486a-aa81-a85315adf987 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:58:59.270900 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764846b2-66d8-475a-bffd-078a6fcb8aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:58:59.271473 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764846b2-66d8-475a-bffd-078a6fcb8aff admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:59.271678 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afde9c-03c2-4c5b-b90e-804b91462b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:58:59.271800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764846b2-66d8-475a-bffd-078a6fcb8aff admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:59.272014 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764846b2-66d8-475a-bffd-078a6fcb8aff admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:59.272946 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afde9c-03c2-4c5b-b90e-804b91462b14 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:59.273125 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764846b2-66d8-475a-bffd-078a6fcb8aff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:58:59.273250 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afde9c-03c2-4c5b-b90e-804b91462b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:59.273476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afde9c-03c2-4c5b-b90e-804b91462b14 admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:59.274161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afde9c-03c2-4c5b-b90e-804b91462b14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:58:59.274488 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afde9c-03c2-4c5b-b90e-804b91462b14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:58:59.275038 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764846b2-66d8-475a-bffd-078a6fcb8aff admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:58:59.276065 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afde9c-03c2-4c5b-b90e-804b91462b14 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:58:59.293352 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 782/1566] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 09:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:58:59.293352 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afde9c-03c2-4c5b-b90e-804b91462b14 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:58:59.300349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afde9c-03c2-4c5b-b90e-804b91462b14 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:58:59.305800 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6e957-a69e-4cf3-90cb-a13c5bbaba8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:58:59.307654 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6e957-a69e-4cf3-90cb-a13c5bbaba8e admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:59.307932 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6e957-a69e-4cf3-90cb-a13c5bbaba8e admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:59.308203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6e957-a69e-4cf3-90cb-a13c5bbaba8e admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:59.308852 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6e957-a69e-4cf3-90cb-a13c5bbaba8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:58:59.309154 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6e957-a69e-4cf3-90cb-a13c5bbaba8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:58:59.310794 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6e957-a69e-4cf3-90cb-a13c5bbaba8e admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:58:59.325467 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 783/1567] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 09:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:58:59.326272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6e957-a69e-4cf3-90cb-a13c5bbaba8e admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:58:59.331056 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:58:59.336805 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6e957-a69e-4cf3-90cb-a13c5bbaba8e admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:58:59.341450 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec2553-7cde-461d-9a22-b72d4a87872e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:58:59.342013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec2553-7cde-461d-9a22-b72d4a87872e admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:59.342348 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec2553-7cde-461d-9a22-b72d4a87872e admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:59.342611 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec2553-7cde-461d-9a22-b72d4a87872e admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:59.343239 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec2553-7cde-461d-9a22-b72d4a87872e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:58:59.345108 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec2553-7cde-461d-9a22-b72d4a87872e admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:58:59.382691 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 785/1568] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:58:59 2022] POST /identity/v3/projects => generated 391 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:58:59.383520 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764846b2-66d8-475a-bffd-078a6fcb8aff admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:58:59.443886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764846b2-66d8-475a-bffd-078a6fcb8aff admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:58:59.449056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29462e4e-83be-4040-8c3e-03abf3091478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:58:59.449672 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29462e4e-83be-4040-8c3e-03abf3091478 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:59.449943 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29462e4e-83be-4040-8c3e-03abf3091478 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:59.450277 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29462e4e-83be-4040-8c3e-03abf3091478 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:59.450897 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29462e4e-83be-4040-8c3e-03abf3091478 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:58:59.452781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29462e4e-83be-4040-8c3e-03abf3091478 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:58:59.476287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 784/1569] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:58:59 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:58:59.477115 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec2553-7cde-461d-9a22-b72d4a87872e admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:58:59.536973 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec2553-7cde-461d-9a22-b72d4a87872e admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:58:59.542538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed857fa-9c20-43aa-9626-bf0c5bc6a86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:58:59.543145 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed857fa-9c20-43aa-9626-bf0c5bc6a86a admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:59.543421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed857fa-9c20-43aa-9626-bf0c5bc6a86a admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:59.543690 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed857fa-9c20-43aa-9626-bf0c5bc6a86a admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:59.544326 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed857fa-9c20-43aa-9626-bf0c5bc6a86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:58:59.546210 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed857fa-9c20-43aa-9626-bf0c5bc6a86a admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:58:59.556041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 785/1570] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:58:59.556810 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed857fa-9c20-43aa-9626-bf0c5bc6a86a admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:58:59.565228 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 786/1571] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:58:59 2022] POST /identity/v3/projects => generated 405 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:58:59.566132 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed857fa-9c20-43aa-9626-bf0c5bc6a86a admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:58:59.566427 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29462e4e-83be-4040-8c3e-03abf3091478 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:58:59.628835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd25560-d982-4454-b5e4-d47ea8366d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:58:59.629444 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd25560-d982-4454-b5e4-d47ea8366d4b admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:59.629719 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd25560-d982-4454-b5e4-d47ea8366d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:59.629982 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd25560-d982-4454-b5e4-d47ea8366d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:59.630654 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd25560-d982-4454-b5e4-d47ea8366d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:58:59.632872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd25560-d982-4454-b5e4-d47ea8366d4b admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:58:59.634030 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29462e4e-83be-4040-8c3e-03abf3091478 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:58:59.640605 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ea2a2-79b5-4031-9132-a1e7599c2de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:58:59.641326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ea2a2-79b5-4031-9132-a1e7599c2de6 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:59.641600 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ea2a2-79b5-4031-9132-a1e7599c2de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:59.641864 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ea2a2-79b5-4031-9132-a1e7599c2de6 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:59.642509 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ea2a2-79b5-4031-9132-a1e7599c2de6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:58:59.644464 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ea2a2-79b5-4031-9132-a1e7599c2de6 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:58:59.644575 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 786/1572] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:58:59.645293 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd25560-d982-4454-b5e4-d47ea8366d4b admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:58:59.661155 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd25560-d982-4454-b5e4-d47ea8366d4b admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:58:59.665888 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29840dc8-8fa5-49f0-b696-9c95c7186fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:58:59.666521 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29840dc8-8fa5-49f0-b696-9c95c7186fce admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:59.666800 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29840dc8-8fa5-49f0-b696-9c95c7186fce admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:59.667071 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29840dc8-8fa5-49f0-b696-9c95c7186fce admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:59.667718 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29840dc8-8fa5-49f0-b696-9c95c7186fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:58:59.669963 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29840dc8-8fa5-49f0-b696-9c95c7186fce admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:58:59.771748 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 787/1573] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:58:59 2022] POST /identity/v3/projects => generated 379 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:58:59.773178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ea2a2-79b5-4031-9132-a1e7599c2de6 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:58:59.780386 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 787/1574] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:58:59 2022] POST /identity/v3/projects => generated 365 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:58:59.781051 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29840dc8-8fa5-49f0-b696-9c95c7186fce admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:58:59.807264 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:58:59.836804 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:58:59.840104 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ea2a2-79b5-4031-9132-a1e7599c2de6 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:58:59.845689 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f242f95-b16e-4b82-96e6-157a7819facb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:58:59.846318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f242f95-b16e-4b82-96e6-157a7819facb admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:59.846596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f242f95-b16e-4b82-96e6-157a7819facb admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:59.846861 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f242f95-b16e-4b82-96e6-157a7819facb admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:59.847474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f242f95-b16e-4b82-96e6-157a7819facb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:58:59.847659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29840dc8-8fa5-49f0-b696-9c95c7186fce admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:58:59.849369 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f242f95-b16e-4b82-96e6-157a7819facb admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:58:59.852490 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22d9a0-8e2c-4430-a512-edb4223b2ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:58:59.853411 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22d9a0-8e2c-4430-a512-edb4223b2ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:59.853411 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22d9a0-8e2c-4430-a512-edb4223b2ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:59.853823 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22d9a0-8e2c-4430-a512-edb4223b2ed5 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:59.854474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b22d9a0-8e2c-4430-a512-edb4223b2ed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:58:59.856519 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b22d9a0-8e2c-4430-a512-edb4223b2ed5 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:58:59.970657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 788/1575] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:58:59 2022] POST /identity/v3/users => generated 296 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:58:59.971547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22d9a0-8e2c-4430-a512-edb4223b2ed5 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:58:59.981672 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22d9a0-8e2c-4430-a512-edb4223b2ed5 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:58:59.985371 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 788/1576] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:58:59 2022] POST /identity/v3/projects => generated 365 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:58:59.985371 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f242f95-b16e-4b82-96e6-157a7819facb admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:58:59.986413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039d166-0812-4cea-9c06-11b0f43b6d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:58:59.987112 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039d166-0812-4cea-9c06-11b0f43b6d67 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:58:59.987568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039d166-0812-4cea-9c06-11b0f43b6d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:58:59.987685 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039d166-0812-4cea-9c06-11b0f43b6d67 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:58:59.988248 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039d166-0812-4cea-9c06-11b0f43b6d67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:58:59.990182 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039d166-0812-4cea-9c06-11b0f43b6d67 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:00.046399 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f242f95-b16e-4b82-96e6-157a7819facb admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:00.051280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf16724-5d55-4e74-835a-49d3c942f035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:00.051878 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf16724-5d55-4e74-835a-49d3c942f035 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:00.052155 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf16724-5d55-4e74-835a-49d3c942f035 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:00.052425 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf16724-5d55-4e74-835a-49d3c942f035 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:00.053057 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf16724-5d55-4e74-835a-49d3c942f035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:00.054710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf16724-5d55-4e74-835a-49d3c942f035 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:00.064497 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 789/1577] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:00.065217 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf16724-5d55-4e74-835a-49d3c942f035 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:00.074403 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf16724-5d55-4e74-835a-49d3c942f035 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:00.079177 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f61c1-5ad2-4b4b-ab7b-d5882a352e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:00.079535 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f61c1-5ad2-4b4b-ab7b-d5882a352e81 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:00.079817 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f61c1-5ad2-4b4b-ab7b-d5882a352e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:00.080086 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f61c1-5ad2-4b4b-ab7b-d5882a352e81 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:00.080676 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f61c1-5ad2-4b4b-ab7b-d5882a352e81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:00.082566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f61c1-5ad2-4b4b-ab7b-d5882a352e81 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:00.090959 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 789/1578] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:58:59 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:00.092327 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039d166-0812-4cea-9c06-11b0f43b6d67 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:00.102731 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039d166-0812-4cea-9c06-11b0f43b6d67 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:00.107267 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d4dd7-f73f-45ff-82b8-5646640c137c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:00.107839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d4dd7-f73f-45ff-82b8-5646640c137c admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:00.108112 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d4dd7-f73f-45ff-82b8-5646640c137c admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:00.108380 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d4dd7-f73f-45ff-82b8-5646640c137c admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:00.109005 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d4dd7-f73f-45ff-82b8-5646640c137c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:00.110633 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d4dd7-f73f-45ff-82b8-5646640c137c admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:00.120793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 790/1579] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:00.121521 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d4dd7-f73f-45ff-82b8-5646640c137c admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:00.130801 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d4dd7-f73f-45ff-82b8-5646640c137c admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:00.135323 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0f6ba-26e8-4ad5-b586-8a7538a00e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:00.136540 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0f6ba-26e8-4ad5-b586-8a7538a00e82 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:00.136540 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0f6ba-26e8-4ad5-b586-8a7538a00e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:00.136540 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0f6ba-26e8-4ad5-b586-8a7538a00e82 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:00.136964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0f6ba-26e8-4ad5-b586-8a7538a00e82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:00.138839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0f6ba-26e8-4ad5-b586-8a7538a00e82 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:00.161179 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 790/1580] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:00 2022] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:00.163448 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f61c1-5ad2-4b4b-ab7b-d5882a352e81 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:00.172186 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f61c1-5ad2-4b4b-ab7b-d5882a352e81 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:00.176820 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c6ced-8112-45b9-a1b5-3a14aedbec4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:00.177377 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c6ced-8112-45b9-a1b5-3a14aedbec4a admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:00.177653 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c6ced-8112-45b9-a1b5-3a14aedbec4a admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:00.177916 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c6ced-8112-45b9-a1b5-3a14aedbec4a admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:00.178550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c6ced-8112-45b9-a1b5-3a14aedbec4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:00.180516 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c6ced-8112-45b9-a1b5-3a14aedbec4a admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:00.223225 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 791/1581] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:00 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:00.224063 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0f6ba-26e8-4ad5-b586-8a7538a00e82 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:00.233880 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0f6ba-26e8-4ad5-b586-8a7538a00e82 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:00.238734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31132dd8-71b5-49d8-b20a-f9f19a1d5eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:00.239323 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31132dd8-71b5-49d8-b20a-f9f19a1d5eed admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:00.239600 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31132dd8-71b5-49d8-b20a-f9f19a1d5eed admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:00.239868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31132dd8-71b5-49d8-b20a-f9f19a1d5eed admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:00.240503 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31132dd8-71b5-49d8-b20a-f9f19a1d5eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:00.242126 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31132dd8-71b5-49d8-b20a-f9f19a1d5eed admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:00.252091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 792/1582] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:00.252859 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31132dd8-71b5-49d8-b20a-f9f19a1d5eed admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:00.263312 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31132dd8-71b5-49d8-b20a-f9f19a1d5eed admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:00.267786 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a90e31-7532-4ec3-ba6d-9b475d147b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:00.268381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a90e31-7532-4ec3-ba6d-9b475d147b06 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:00.268652 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a90e31-7532-4ec3-ba6d-9b475d147b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:00.268929 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a90e31-7532-4ec3-ba6d-9b475d147b06 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:00.269564 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a90e31-7532-4ec3-ba6d-9b475d147b06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:00.271681 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a90e31-7532-4ec3-ba6d-9b475d147b06 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:00.276248 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 791/1583] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:00 2022] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:00.280073 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c6ced-8112-45b9-a1b5-3a14aedbec4a admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:00.287257 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c6ced-8112-45b9-a1b5-3a14aedbec4a admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:00.292160 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24357030-1353-4976-bcf9-44b614661dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:00.292801 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24357030-1353-4976-bcf9-44b614661dee admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:00.293078 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24357030-1353-4976-bcf9-44b614661dee admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:00.293381 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24357030-1353-4976-bcf9-44b614661dee admin admin] PATH_INFO: `/v3/projects/c0b5611ea2ca4c278b473b92f7b659f5/users/13443e2da7474098800614ec8e09e77d/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:00.307841 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24357030-1353-4976-bcf9-44b614661dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0b5611ea2ca4c278b473b92f7b659f5, user_id=13443e2da7474098800614ec8e09e77d, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:00.308867 dv-cinder-815660-9-smb devstack@keystone.service[98478]: WARNING py.warnings [None req-24357030-1353-4976-bcf9-44b614661dee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 09:59:00.308867 dv-cinder-815660-9-smb devstack@keystone.service[98478]: warnings.warn(msg) Aug 11 09:59:00.308867 dv-cinder-815660-9-smb devstack@keystone.service[98478]: Aug 11 09:59:00.310854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24357030-1353-4976-bcf9-44b614661dee admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:00.351511 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 793/1584] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:00 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:00.352260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a90e31-7532-4ec3-ba6d-9b475d147b06 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:00.361722 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a90e31-7532-4ec3-ba6d-9b475d147b06 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:00.366280 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6376fa-2d73-4e15-95dd-400ba487c9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:00.366844 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6376fa-2d73-4e15-95dd-400ba487c9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:00.367107 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6376fa-2d73-4e15-95dd-400ba487c9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:00.367369 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6376fa-2d73-4e15-95dd-400ba487c9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:00.367982 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6376fa-2d73-4e15-95dd-400ba487c9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:00.369543 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6376fa-2d73-4e15-95dd-400ba487c9d9 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:00.372654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 792/1585] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:00 2022] PUT /identity/v3/projects/c0b5611ea2ca4c278b473b92f7b659f5/users/13443e2da7474098800614ec8e09e77d/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:00.373430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24357030-1353-4976-bcf9-44b614661dee admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:00.379703 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 794/1586] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:00.380493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6376fa-2d73-4e15-95dd-400ba487c9d9 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:00.390600 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6376fa-2d73-4e15-95dd-400ba487c9d9 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:00.438197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:00.446642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315f086-901b-42f0-8158-a79e38ab67aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:00.447278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315f086-901b-42f0-8158-a79e38ab67aa admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:00.448232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315f086-901b-42f0-8158-a79e38ab67aa admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:00.448232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315f086-901b-42f0-8158-a79e38ab67aa admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:00.448513 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315f086-901b-42f0-8158-a79e38ab67aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:00.449860 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24357030-1353-4976-bcf9-44b614661dee admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:00.450476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315f086-901b-42f0-8158-a79e38ab67aa admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:00.454533 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8c29c-eb2e-47f2-99a5-0965de399f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:00.455191 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8c29c-eb2e-47f2-99a5-0965de399f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:00.455485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8c29c-eb2e-47f2-99a5-0965de399f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:00.455735 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8c29c-eb2e-47f2-99a5-0965de399f25 admin admin] PATH_INFO: `/v3/projects/f1c39fc0779a464399a3050bba588e59/users/20bf487c5b8e490da15060ea798a83ca/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:00.463985 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 795/1587] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:00.463985 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315f086-901b-42f0-8158-a79e38ab67aa admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:00.472525 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8c29c-eb2e-47f2-99a5-0965de399f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c39fc0779a464399a3050bba588e59, user_id=20bf487c5b8e490da15060ea798a83ca, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:00.473365 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315f086-901b-42f0-8158-a79e38ab67aa admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:00.475997 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8c29c-eb2e-47f2-99a5-0965de399f25 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:00.480121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17391641-044f-4b92-8b8f-127dbcbc1bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:00.480121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17391641-044f-4b92-8b8f-127dbcbc1bca admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:00.480121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17391641-044f-4b92-8b8f-127dbcbc1bca admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:00.480121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17391641-044f-4b92-8b8f-127dbcbc1bca admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:00.480516 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17391641-044f-4b92-8b8f-127dbcbc1bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:00.481477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17391641-044f-4b92-8b8f-127dbcbc1bca admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:00.491474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 796/1588] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:00.492388 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17391641-044f-4b92-8b8f-127dbcbc1bca admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:00.501698 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17391641-044f-4b92-8b8f-127dbcbc1bca admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:00.506390 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923459a-27d8-4365-a2e8-8af4f8cb95bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:00.507458 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923459a-27d8-4365-a2e8-8af4f8cb95bc admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:00.507736 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923459a-27d8-4365-a2e8-8af4f8cb95bc admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:00.508007 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923459a-27d8-4365-a2e8-8af4f8cb95bc admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:00.508618 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923459a-27d8-4365-a2e8-8af4f8cb95bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:00.510172 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923459a-27d8-4365-a2e8-8af4f8cb95bc admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:00.520094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 797/1589] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:00.520972 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923459a-27d8-4365-a2e8-8af4f8cb95bc admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:00.530596 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923459a-27d8-4365-a2e8-8af4f8cb95bc admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:00.535082 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4f74c-9072-41b0-b305-1cea0d72262c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:00.535632 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4f74c-9072-41b0-b305-1cea0d72262c admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:00.535908 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4f74c-9072-41b0-b305-1cea0d72262c admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:00.536179 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4f74c-9072-41b0-b305-1cea0d72262c admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:00.536781 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4f74c-9072-41b0-b305-1cea0d72262c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:00.538358 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4f74c-9072-41b0-b305-1cea0d72262c admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:00.548474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 798/1590] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:00.549451 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4f74c-9072-41b0-b305-1cea0d72262c admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:00.560142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4f74c-9072-41b0-b305-1cea0d72262c admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:00.560579 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 793/1591] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:00 2022] PUT /identity/v3/projects/f1c39fc0779a464399a3050bba588e59/users/20bf487c5b8e490da15060ea798a83ca/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:00.561532 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8c29c-eb2e-47f2-99a5-0965de399f25 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:00.575736 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:00.618996 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d13db5-7dfe-4b0d-b627-6fee7547abee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:00.619530 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d13db5-7dfe-4b0d-b627-6fee7547abee admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:00.619805 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d13db5-7dfe-4b0d-b627-6fee7547abee admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:00.620072 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d13db5-7dfe-4b0d-b627-6fee7547abee admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:00.620710 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d13db5-7dfe-4b0d-b627-6fee7547abee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:00.622333 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d13db5-7dfe-4b0d-b627-6fee7547abee admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:00.624333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8c29c-eb2e-47f2-99a5-0965de399f25 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:00.629024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da9950-4925-4744-8dc1-4830f2c49b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:00.629623 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da9950-4925-4744-8dc1-4830f2c49b22 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:00.629898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da9950-4925-4744-8dc1-4830f2c49b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:00.630199 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da9950-4925-4744-8dc1-4830f2c49b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:00.630836 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da9950-4925-4744-8dc1-4830f2c49b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:00.632680 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 799/1592] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:00.633763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5392f0-1424-4050-bb49-cfc8b3c56787 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:00.634041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5392f0-1424-4050-bb49-cfc8b3c56787 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:00.634331 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5392f0-1424-4050-bb49-cfc8b3c56787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:00.639722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da9950-4925-4744-8dc1-4830f2c49b22 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:00.647333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 794/1593] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:00.648228 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da9950-4925-4744-8dc1-4830f2c49b22 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:00.658648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da9950-4925-4744-8dc1-4830f2c49b22 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:00.663272 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c4d1f-db4e-4ed7-9cbf-721cafd6256b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:00.664054 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c4d1f-db4e-4ed7-9cbf-721cafd6256b admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:00.664336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c4d1f-db4e-4ed7-9cbf-721cafd6256b admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:00.664432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-7e5392f0-1424-4050-bb49-cfc8b3c56787 None None] MFA Rules not processed for user `13443e2da7474098800614ec8e09e77d`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:00.664605 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c4d1f-db4e-4ed7-9cbf-721cafd6256b admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:00.665238 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c4d1f-db4e-4ed7-9cbf-721cafd6256b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:00.666108 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-7e5392f0-1424-4050-bb49-cfc8b3c56787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:00.666952 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c4d1f-db4e-4ed7-9cbf-721cafd6256b admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:00.677311 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 795/1594] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:00.678182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c4d1f-db4e-4ed7-9cbf-721cafd6256b admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:00.687849 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c4d1f-db4e-4ed7-9cbf-721cafd6256b admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:00.692671 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c36534-5d57-4f3b-afb3-06692d7593c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:00.693251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c36534-5d57-4f3b-afb3-06692d7593c2 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:00.693522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c36534-5d57-4f3b-afb3-06692d7593c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:00.693792 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c36534-5d57-4f3b-afb3-06692d7593c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:00.695045 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c36534-5d57-4f3b-afb3-06692d7593c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:00.696621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c36534-5d57-4f3b-afb3-06692d7593c2 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:00.707317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 796/1595] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:00.707317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c36534-5d57-4f3b-afb3-06692d7593c2 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:00.717281 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c36534-5d57-4f3b-afb3-06692d7593c2 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:00.722013 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228dfb0-c4da-420e-bfa3-af7ffa690bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:00.722650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228dfb0-c4da-420e-bfa3-af7ffa690bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:00.722920 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228dfb0-c4da-420e-bfa3-af7ffa690bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:00.723286 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228dfb0-c4da-420e-bfa3-af7ffa690bcf admin admin] PATH_INFO: `/v3/projects/103b459c84b84542a1542d3af83b91ab/users/d6ea1e39eb2b47b5b29d63ed8a2d7990/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:00.734857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 800/1596] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:00.735698 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5392f0-1424-4050-bb49-cfc8b3c56787 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:00.738195 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228dfb0-c4da-420e-bfa3-af7ffa690bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=103b459c84b84542a1542d3af83b91ab, user_id=d6ea1e39eb2b47b5b29d63ed8a2d7990, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:00.741863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228dfb0-c4da-420e-bfa3-af7ffa690bcf admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:00.746316 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5392f0-1424-4050-bb49-cfc8b3c56787 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:00.750831 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89326f-5132-4d6e-a989-75ffd407f16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:00.751406 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89326f-5132-4d6e-a989-75ffd407f16e admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:00.751682 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89326f-5132-4d6e-a989-75ffd407f16e admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:00.751949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89326f-5132-4d6e-a989-75ffd407f16e admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:00.752577 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89326f-5132-4d6e-a989-75ffd407f16e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:00.754179 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89326f-5132-4d6e-a989-75ffd407f16e admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:00.764328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 801/1597] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:00.765433 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20145c99-f241-469f-902b-eab65f4a48f2 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:00.765710 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20145c99-f241-469f-902b-eab65f4a48f2 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:00.765976 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20145c99-f241-469f-902b-eab65f4a48f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:00.783900 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-20145c99-f241-469f-902b-eab65f4a48f2 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:00.785163 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-20145c99-f241-469f-902b-eab65f4a48f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:00.793011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 802/1598] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:00.796991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20145c99-f241-469f-902b-eab65f4a48f2 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:00.804680 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20145c99-f241-469f-902b-eab65f4a48f2 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:00.809530 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70155069-5527-4c18-a965-8b29fd00f02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:00.810207 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70155069-5527-4c18-a965-8b29fd00f02b admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:00.810587 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70155069-5527-4c18-a965-8b29fd00f02b admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:00.810880 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70155069-5527-4c18-a965-8b29fd00f02b admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:00.811511 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70155069-5527-4c18-a965-8b29fd00f02b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:00.813121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70155069-5527-4c18-a965-8b29fd00f02b admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:00.813540 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 797/1599] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:00 2022] PUT /identity/v3/projects/103b459c84b84542a1542d3af83b91ab/users/d6ea1e39eb2b47b5b29d63ed8a2d7990/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:00.814650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228dfb0-c4da-420e-bfa3-af7ffa690bcf admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:00.824551 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 803/1600] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:00.825436 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70155069-5527-4c18-a965-8b29fd00f02b admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:00.835196 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70155069-5527-4c18-a965-8b29fd00f02b admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:00.885292 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228dfb0-c4da-420e-bfa3-af7ffa690bcf admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:00.889998 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92692e75-4be7-41f2-a9be-aeb80aaa1446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:00.890708 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92692e75-4be7-41f2-a9be-aeb80aaa1446 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:00.890988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92692e75-4be7-41f2-a9be-aeb80aaa1446 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:00.891092 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967e327-d61f-4378-baa4-644ea43b19a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:00.891324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92692e75-4be7-41f2-a9be-aeb80aaa1446 admin admin] PATH_INFO: `/v3/projects/8bf23dfb10574079833d8defa2e10ed2/users/06ed3b08376e460087fafc4fccfdd2a9/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:00.891739 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967e327-d61f-4378-baa4-644ea43b19a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:00.892015 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967e327-d61f-4378-baa4-644ea43b19a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:00.892284 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967e327-d61f-4378-baa4-644ea43b19a5 admin admin] PATH_INFO: `/v3/projects/b68e744ede8e4e5fb44c73816fe6cf1a/users/b101f7a91b8d4f46b5eaeca440fbb512/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:00.905862 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92692e75-4be7-41f2-a9be-aeb80aaa1446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf23dfb10574079833d8defa2e10ed2, user_id=06ed3b08376e460087fafc4fccfdd2a9, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:00.907037 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967e327-d61f-4378-baa4-644ea43b19a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b68e744ede8e4e5fb44c73816fe6cf1a, user_id=b101f7a91b8d4f46b5eaeca440fbb512, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:00.908593 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92692e75-4be7-41f2-a9be-aeb80aaa1446 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:00.909681 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967e327-d61f-4378-baa4-644ea43b19a5 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:00.988554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 798/1601] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:00 2022] PUT /identity/v3/projects/8bf23dfb10574079833d8defa2e10ed2/users/06ed3b08376e460087fafc4fccfdd2a9/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:00.989399 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92692e75-4be7-41f2-a9be-aeb80aaa1446 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:00.993976 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:00.998866 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:00.999844 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 804/1602] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:00 2022] PUT /identity/v3/projects/b68e744ede8e4e5fb44c73816fe6cf1a/users/b101f7a91b8d4f46b5eaeca440fbb512/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:01.000688 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967e327-d61f-4378-baa4-644ea43b19a5 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:01.051298 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92692e75-4be7-41f2-a9be-aeb80aaa1446 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:01.067501 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967e327-d61f-4378-baa4-644ea43b19a5 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:01.072318 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45107686-28e1-4b09-8446-d7b3eb6de5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:01.072914 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45107686-28e1-4b09-8446-d7b3eb6de5d6 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:01.073189 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45107686-28e1-4b09-8446-d7b3eb6de5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:01.073456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45107686-28e1-4b09-8446-d7b3eb6de5d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:01.074066 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45107686-28e1-4b09-8446-d7b3eb6de5d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:01.075997 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45107686-28e1-4b09-8446-d7b3eb6de5d6 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:01.108232 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40feeee-7253-4c74-a41e-1391331e26f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:01.108877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40feeee-7253-4c74-a41e-1391331e26f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:01.109146 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40feeee-7253-4c74-a41e-1391331e26f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:01.109410 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40feeee-7253-4c74-a41e-1391331e26f0 admin admin] PATH_INFO: `/v3/projects/37723d4b6fc749e4969def02d826fca1/users/55c67b8ae8fb42f5b45e58d38e985507/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:01.123640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40feeee-7253-4c74-a41e-1391331e26f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37723d4b6fc749e4969def02d826fca1, user_id=55c67b8ae8fb42f5b45e58d38e985507, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:01.126935 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40feeee-7253-4c74-a41e-1391331e26f0 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:01.168370 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 805/1603] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:59:00 2022] POST /identity/v3/projects => generated 367 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:01.169135 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45107686-28e1-4b09-8446-d7b3eb6de5d6 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:01.193369 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 799/1604] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:00 2022] PUT /identity/v3/projects/37723d4b6fc749e4969def02d826fca1/users/55c67b8ae8fb42f5b45e58d38e985507/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:01.194377 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40feeee-7253-4c74-a41e-1391331e26f0 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:01.196053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-f40feeee-7253-4c74-a41e-1391331e26f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:01.232445 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45107686-28e1-4b09-8446-d7b3eb6de5d6 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:01.252541 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40feeee-7253-4c74-a41e-1391331e26f0 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:01.256172 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f4a49-d0ec-4338-956f-9e2338231178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:01.256790 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f4a49-d0ec-4338-956f-9e2338231178 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:01.257065 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f4a49-d0ec-4338-956f-9e2338231178 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:01.257332 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f4a49-d0ec-4338-956f-9e2338231178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:01.292206 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad8f4b-b202-4d8e-accd-411e893a25d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:01.292871 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad8f4b-b202-4d8e-accd-411e893a25d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:01.293161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad8f4b-b202-4d8e-accd-411e893a25d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:01.293424 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad8f4b-b202-4d8e-accd-411e893a25d7 admin admin] PATH_INFO: `/v3/projects/efc3ba9309d14fe2ae3ea70cd04ccb27/users/600f52e8e90e4751be4067cfa7d3a827/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:01.308955 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:01.310338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad8f4b-b202-4d8e-accd-411e893a25d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc3ba9309d14fe2ae3ea70cd04ccb27, user_id=600f52e8e90e4751be4067cfa7d3a827, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:01.313259 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad8f4b-b202-4d8e-accd-411e893a25d7 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:01.321588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f4a49-d0ec-4338-956f-9e2338231178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:01.323152 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f4a49-d0ec-4338-956f-9e2338231178 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:01.332497 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 800/1605] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:01.333708 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9435371-316b-45b5-958e-3fa16ce1987b None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:01.333983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9435371-316b-45b5-958e-3fa16ce1987b None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:01.334281 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9435371-316b-45b5-958e-3fa16ce1987b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:01.353978 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-b9435371-316b-45b5-958e-3fa16ce1987b None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:01.355226 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-b9435371-316b-45b5-958e-3fa16ce1987b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:01.363696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 801/1606] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:01.364505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9435371-316b-45b5-958e-3fa16ce1987b None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:01.373517 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9435371-316b-45b5-958e-3fa16ce1987b None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:01.378108 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4c159-4e4a-4864-8ca6-9de947e4a034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:01.378747 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4c159-4e4a-4864-8ca6-9de947e4a034 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:01.379023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4c159-4e4a-4864-8ca6-9de947e4a034 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:01.379311 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4c159-4e4a-4864-8ca6-9de947e4a034 admin admin] PATH_INFO: `/v3/projects/97d75164ca6949a4bb5643fe3b3e5e42/users/d7b38cdf614041619a6b3a24fac7b17f/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:01.393676 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4c159-4e4a-4864-8ca6-9de947e4a034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97d75164ca6949a4bb5643fe3b3e5e42, user_id=d7b38cdf614041619a6b3a24fac7b17f, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:01.396377 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4c159-4e4a-4864-8ca6-9de947e4a034 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:01.416837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 806/1607] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:01 2022] PUT /identity/v3/projects/efc3ba9309d14fe2ae3ea70cd04ccb27/users/600f52e8e90e4751be4067cfa7d3a827/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:01.418131 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cdc57-2335-4726-a4cc-9251f729cd44 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:01.420101 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cdc57-2335-4726-a4cc-9251f729cd44 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:01.420101 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cdc57-2335-4726-a4cc-9251f729cd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:01.436864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-3d3cdc57-2335-4726-a4cc-9251f729cd44 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:01.438116 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-3d3cdc57-2335-4726-a4cc-9251f729cd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:01.446975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:01.487989 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 802/1608] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:01 2022] PUT /identity/v3/projects/97d75164ca6949a4bb5643fe3b3e5e42/users/d7b38cdf614041619a6b3a24fac7b17f/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:01.489447 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1d959-81ba-4cf4-b230-ede9997e6d1d None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:01.489827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1d959-81ba-4cf4-b230-ede9997e6d1d None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:01.490251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1d959-81ba-4cf4-b230-ede9997e6d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:01.512687 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 807/1609] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:01.514386 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3cdc57-2335-4726-a4cc-9251f729cd44 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:01.523280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-14f1d959-81ba-4cf4-b230-ede9997e6d1d None None] MFA Rules not processed for user `b101f7a91b8d4f46b5eaeca440fbb512`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:01.524484 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-14f1d959-81ba-4cf4-b230-ede9997e6d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:01.526624 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3cdc57-2335-4726-a4cc-9251f729cd44 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:01.585901 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda569e2-0047-4099-a226-a3a5f0c733b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:01.586672 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda569e2-0047-4099-a226-a3a5f0c733b7 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:01.586785 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda569e2-0047-4099-a226-a3a5f0c733b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:01.587044 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda569e2-0047-4099-a226-a3a5f0c733b7 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:01.587654 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda569e2-0047-4099-a226-a3a5f0c733b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:01.589665 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda569e2-0047-4099-a226-a3a5f0c733b7 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:01.594840 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 803/1610] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:01 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:01.596100 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274a6e4-ca9e-4e72-87dd-d2544564019b None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:01.596380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274a6e4-ca9e-4e72-87dd-d2544564019b None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:01.596649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274a6e4-ca9e-4e72-87dd-d2544564019b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:01.616213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-b274a6e4-ca9e-4e72-87dd-d2544564019b None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:01.617409 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-b274a6e4-ca9e-4e72-87dd-d2544564019b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:01.624958 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 804/1611] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:01.625758 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274a6e4-ca9e-4e72-87dd-d2544564019b None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:01.684896 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274a6e4-ca9e-4e72-87dd-d2544564019b None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:01.688675 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e6631-e1eb-4ccc-b537-e1d2b1c0729d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:01.689347 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e6631-e1eb-4ccc-b537-e1d2b1c0729d service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:01.689628 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e6631-e1eb-4ccc-b537-e1d2b1c0729d service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:01.689899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e6631-e1eb-4ccc-b537-e1d2b1c0729d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:01.700206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e6631-e1eb-4ccc-b537-e1d2b1c0729d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:01.701777 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e6631-e1eb-4ccc-b537-e1d2b1c0729d service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:01.714402 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 808/1612] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:01 2022] POST /identity/v3/users => generated 290 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:01.714402 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35ca42-eca0-4f9b-970f-698a3528f32b None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:01.714402 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35ca42-eca0-4f9b-970f-698a3528f32b None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:01.714402 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35ca42-eca0-4f9b-970f-698a3528f32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:01.716543 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 805/1613] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:01.718548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd4e1a-1888-4b17-8799-1a0801be6866 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:01.718877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd4e1a-1888-4b17-8799-1a0801be6866 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:01.719151 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd4e1a-1888-4b17-8799-1a0801be6866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:01.747392 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-4a35ca42-eca0-4f9b-970f-698a3528f32b None None] MFA Rules not processed for user `600f52e8e90e4751be4067cfa7d3a827`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:01.748808 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-4a35ca42-eca0-4f9b-970f-698a3528f32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:01.751147 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-79bd4e1a-1888-4b17-8799-1a0801be6866 None None] MFA Rules not processed for user `d7b38cdf614041619a6b3a24fac7b17f`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:01.752396 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-79bd4e1a-1888-4b17-8799-1a0801be6866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:01.792298 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:01.831681 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 809/1614] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:01.831681 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35ca42-eca0-4f9b-970f-698a3528f32b None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:01.833054 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 806/1615] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:01.834579 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd4e1a-1888-4b17-8799-1a0801be6866 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:01.844890 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35ca42-eca0-4f9b-970f-698a3528f32b None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:01.847949 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd4e1a-1888-4b17-8799-1a0801be6866 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:01.850675 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59162fae-b3d1-4ecf-8816-e42407def68c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:01.851534 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59162fae-b3d1-4ecf-8816-e42407def68c service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:01.853999 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59162fae-b3d1-4ecf-8816-e42407def68c service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:01.853999 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59162fae-b3d1-4ecf-8816-e42407def68c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:01.854221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b9cb4-6eed-4f2f-b3fc-dfbece547bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:01.854221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b9cb4-6eed-4f2f-b3fc-dfbece547bad admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:01.854221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b9cb4-6eed-4f2f-b3fc-dfbece547bad admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:01.854221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b9cb4-6eed-4f2f-b3fc-dfbece547bad admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:01.854705 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b9cb4-6eed-4f2f-b3fc-dfbece547bad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:01.857220 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b9cb4-6eed-4f2f-b3fc-dfbece547bad admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:01.863468 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59162fae-b3d1-4ecf-8816-e42407def68c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:01.865111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59162fae-b3d1-4ecf-8816-e42407def68c service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:01.878684 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 810/1616] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:01.879522 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59162fae-b3d1-4ecf-8816-e42407def68c service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:01.888224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59162fae-b3d1-4ecf-8816-e42407def68c service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:01.892257 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15810f62-4567-4902-9beb-11b5b88f1c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:01.893073 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15810f62-4567-4902-9beb-11b5b88f1c9d service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:01.893073 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15810f62-4567-4902-9beb-11b5b88f1c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:01.893378 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15810f62-4567-4902-9beb-11b5b88f1c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:01.903700 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15810f62-4567-4902-9beb-11b5b88f1c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:01.906130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15810f62-4567-4902-9beb-11b5b88f1c9d service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:01.915193 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 811/1617] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:01.915990 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15810f62-4567-4902-9beb-11b5b88f1c9d service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:01.925565 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15810f62-4567-4902-9beb-11b5b88f1c9d service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:01.930890 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24d7fd-6149-4d9e-8e72-3722b8dc1da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:01.931074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24d7fd-6149-4d9e-8e72-3722b8dc1da1 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:01.931297 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24d7fd-6149-4d9e-8e72-3722b8dc1da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:01.931594 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24d7fd-6149-4d9e-8e72-3722b8dc1da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:01.932196 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c24d7fd-6149-4d9e-8e72-3722b8dc1da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:01.933941 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c24d7fd-6149-4d9e-8e72-3722b8dc1da1 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:01.935523 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:01.945370 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 812/1618] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:01.946187 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24d7fd-6149-4d9e-8e72-3722b8dc1da1 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:01.955603 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24d7fd-6149-4d9e-8e72-3722b8dc1da1 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:01.961482 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522a075-b2ca-4807-a605-16269acb9197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:01.962379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522a075-b2ca-4807-a605-16269acb9197 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:01.962775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522a075-b2ca-4807-a605-16269acb9197 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:01.963866 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522a075-b2ca-4807-a605-16269acb9197 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:01.964567 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522a075-b2ca-4807-a605-16269acb9197 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:01.966793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522a075-b2ca-4807-a605-16269acb9197 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:01.989239 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 807/1619] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:59:01 2022] POST /identity/v3/projects => generated 405 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:01.990353 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b9cb4-6eed-4f2f-b3fc-dfbece547bad admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:02.048924 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b9cb4-6eed-4f2f-b3fc-dfbece547bad admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:02.053218 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64266484-d56e-4cf9-bd62-608741aa7efe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:02.054686 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64266484-d56e-4cf9-bd62-608741aa7efe service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:02.056154 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64266484-d56e-4cf9-bd62-608741aa7efe service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:02.056493 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64266484-d56e-4cf9-bd62-608741aa7efe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:02.106365 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 813/1620] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:59:01 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:02.106365 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522a075-b2ca-4807-a605-16269acb9197 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:02.130964 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64266484-d56e-4cf9-bd62-608741aa7efe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:02.137590 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64266484-d56e-4cf9-bd62-608741aa7efe service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:02.144500 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 808/1621] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:02.145321 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64266484-d56e-4cf9-bd62-608741aa7efe service cinder] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:02.229134 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64266484-d56e-4cf9-bd62-608741aa7efe service cinder] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:02.235397 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fce9c6-9d12-498f-9c07-a12a43c3005b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:02.235397 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fce9c6-9d12-498f-9c07-a12a43c3005b admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:02.235643 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fce9c6-9d12-498f-9c07-a12a43c3005b admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:02.235807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fce9c6-9d12-498f-9c07-a12a43c3005b admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:02.236748 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fce9c6-9d12-498f-9c07-a12a43c3005b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:02.239085 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fce9c6-9d12-498f-9c07-a12a43c3005b admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:02.241930 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522a075-b2ca-4807-a605-16269acb9197 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:02.252770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:02.264353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa5178-6e94-405e-8479-96c5edfe26c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:02.265203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa5178-6e94-405e-8479-96c5edfe26c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:02.265551 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa5178-6e94-405e-8479-96c5edfe26c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:02.266174 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa5178-6e94-405e-8479-96c5edfe26c2 admin admin] PATH_INFO: `/v3/projects/b666e2552cfe4df2973c64135002fa02/users/c50907a785494658a4a5dfb0d0bfd0e6/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:02.288405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa5178-6e94-405e-8479-96c5edfe26c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b666e2552cfe4df2973c64135002fa02, user_id=c50907a785494658a4a5dfb0d0bfd0e6, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:02.292035 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa5178-6e94-405e-8479-96c5edfe26c2 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:02.354789 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 809/1622] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:02 2022] POST /identity/v3/users => generated 309 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:02.355960 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fce9c6-9d12-498f-9c07-a12a43c3005b admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:02.370269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fce9c6-9d12-498f-9c07-a12a43c3005b admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:02.384144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 814/1623] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:02 2022] PUT /identity/v3/projects/b666e2552cfe4df2973c64135002fa02/users/c50907a785494658a4a5dfb0d0bfd0e6/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:02.384144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa5178-6e94-405e-8479-96c5edfe26c2 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:02.385049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a715d5-48a9-426c-8023-bbda88ed6e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:02.385653 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a715d5-48a9-426c-8023-bbda88ed6e8e admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:02.385998 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a715d5-48a9-426c-8023-bbda88ed6e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:02.386359 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a715d5-48a9-426c-8023-bbda88ed6e8e admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:02.387563 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a715d5-48a9-426c-8023-bbda88ed6e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:02.391111 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a715d5-48a9-426c-8023-bbda88ed6e8e admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:02.491550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 810/1624] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:02 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:02.495711 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a715d5-48a9-426c-8023-bbda88ed6e8e admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:02.514134 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a715d5-48a9-426c-8023-bbda88ed6e8e admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:02.570222 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa5178-6e94-405e-8479-96c5edfe26c2 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:02.586784 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373a1e0-fc5e-4e0a-a743-ad7b7f029078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:02.587374 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373a1e0-fc5e-4e0a-a743-ad7b7f029078 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:02.587655 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373a1e0-fc5e-4e0a-a743-ad7b7f029078 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:02.588075 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373a1e0-fc5e-4e0a-a743-ad7b7f029078 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:02.588722 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373a1e0-fc5e-4e0a-a743-ad7b7f029078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:02.590224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2a555-3859-48bc-8386-f7a67d652279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:02.590388 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373a1e0-fc5e-4e0a-a743-ad7b7f029078 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:02.591072 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2a555-3859-48bc-8386-f7a67d652279 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:02.591438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2a555-3859-48bc-8386-f7a67d652279 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:02.591827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2a555-3859-48bc-8386-f7a67d652279 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:02.592573 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2a555-3859-48bc-8386-f7a67d652279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:02.594558 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2a555-3859-48bc-8386-f7a67d652279 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:02.606803 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 811/1625] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:02.607747 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2a555-3859-48bc-8386-f7a67d652279 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:02.613106 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 815/1626] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:02.613872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373a1e0-fc5e-4e0a-a743-ad7b7f029078 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:02.623236 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2a555-3859-48bc-8386-f7a67d652279 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:02.630660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629ac2e-8d5a-40e5-9048-1cf4bd716e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:02.630660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629ac2e-8d5a-40e5-9048-1cf4bd716e07 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:02.630660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629ac2e-8d5a-40e5-9048-1cf4bd716e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:02.630660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629ac2e-8d5a-40e5-9048-1cf4bd716e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:02.631084 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629ac2e-8d5a-40e5-9048-1cf4bd716e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:02.632630 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629ac2e-8d5a-40e5-9048-1cf4bd716e07 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:02.633167 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373a1e0-fc5e-4e0a-a743-ad7b7f029078 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:02.647169 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d529df-915c-489e-adb2-bc2fa5f4ff6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:02.648059 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d529df-915c-489e-adb2-bc2fa5f4ff6d admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:02.648341 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d529df-915c-489e-adb2-bc2fa5f4ff6d admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:02.648764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d529df-915c-489e-adb2-bc2fa5f4ff6d admin admin] PATH_INFO: `/v3/projects/b666e2552cfe4df2973c64135002fa02/users/c50907a785494658a4a5dfb0d0bfd0e6/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:02.651938 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d529df-915c-489e-adb2-bc2fa5f4ff6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b666e2552cfe4df2973c64135002fa02, user_id=c50907a785494658a4a5dfb0d0bfd0e6, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:02.659168 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 812/1627] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:02.659168 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629ac2e-8d5a-40e5-9048-1cf4bd716e07 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:02.659809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d529df-915c-489e-adb2-bc2fa5f4ff6d admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:02.672030 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629ac2e-8d5a-40e5-9048-1cf4bd716e07 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:02.684788 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 816/1628] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:02 2022] PUT /identity/v3/projects/b666e2552cfe4df2973c64135002fa02/users/c50907a785494658a4a5dfb0d0bfd0e6/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:02.686039 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d529df-915c-489e-adb2-bc2fa5f4ff6d admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:02.735124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29ae80-dbdc-497e-85ba-849a0a7ab6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:02.736340 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29ae80-dbdc-497e-85ba-849a0a7ab6d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:02.736340 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29ae80-dbdc-497e-85ba-849a0a7ab6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:02.736551 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29ae80-dbdc-497e-85ba-849a0a7ab6d2 admin admin] PATH_INFO: `/v3/projects/38ac5367510a4d0b83d19da6107d53e0/users/b1002870ed25494da3a2db371c01f43c/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:02.748381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:02.752477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29ae80-dbdc-497e-85ba-849a0a7ab6d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38ac5367510a4d0b83d19da6107d53e0, user_id=b1002870ed25494da3a2db371c01f43c, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:02.773750 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29ae80-dbdc-497e-85ba-849a0a7ab6d2 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:02.783685 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d529df-915c-489e-adb2-bc2fa5f4ff6d admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:02.791732 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecc9f7-551f-45c2-be22-9db954a81f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:02.792658 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecc9f7-551f-45c2-be22-9db954a81f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:02.793308 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecc9f7-551f-45c2-be22-9db954a81f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:02.793756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecc9f7-551f-45c2-be22-9db954a81f5a admin admin] PATH_INFO: `/v3/projects/cf57a8ef50ee4f00b2f89a3baa3f38a6/users/06d874465a2648ee951aa876e3efbc56/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:02.815864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecc9f7-551f-45c2-be22-9db954a81f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf57a8ef50ee4f00b2f89a3baa3f38a6, user_id=06d874465a2648ee951aa876e3efbc56, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:02.821469 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecc9f7-551f-45c2-be22-9db954a81f5a admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:02.933828 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 813/1629] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:02 2022] PUT /identity/v3/projects/38ac5367510a4d0b83d19da6107d53e0/users/b1002870ed25494da3a2db371c01f43c/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:02.937037 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 817/1630] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:02 2022] PUT /identity/v3/projects/cf57a8ef50ee4f00b2f89a3baa3f38a6/users/06d874465a2648ee951aa876e3efbc56/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:02.938544 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c2aa4-8e40-4496-9f65-bcdca930709a None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:02.939531 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecc9f7-551f-45c2-be22-9db954a81f5a admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:02.940259 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c2aa4-8e40-4496-9f65-bcdca930709a None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:02.941929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c2aa4-8e40-4496-9f65-bcdca930709a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:02.988244 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-c21c2aa4-8e40-4496-9f65-bcdca930709a None None] MFA Rules not processed for user `c50907a785494658a4a5dfb0d0bfd0e6`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:02.989620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-c21c2aa4-8e40-4496-9f65-bcdca930709a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:03.042840 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:03.086573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecc9f7-551f-45c2-be22-9db954a81f5a admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:03.093692 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 814/1631] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:03.094029 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c2aa4-8e40-4496-9f65-bcdca930709a None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:03.169962 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c2aa4-8e40-4496-9f65-bcdca930709a None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:03.175609 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45cf1f-954e-4fb0-8aa0-453d11e5d058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:03.176234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45cf1f-954e-4fb0-8aa0-453d11e5d058 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:03.176515 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45cf1f-954e-4fb0-8aa0-453d11e5d058 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:03.176867 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45cf1f-954e-4fb0-8aa0-453d11e5d058 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:03.177744 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45cf1f-954e-4fb0-8aa0-453d11e5d058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:03.179577 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45cf1f-954e-4fb0-8aa0-453d11e5d058 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:03.193640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 815/1632] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:03.196256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45cf1f-954e-4fb0-8aa0-453d11e5d058 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:03.219576 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75524098-2273-43cc-8e90-3fab972ff1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:03.223005 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75524098-2273-43cc-8e90-3fab972ff1fe admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:03.223005 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75524098-2273-43cc-8e90-3fab972ff1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:03.223005 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75524098-2273-43cc-8e90-3fab972ff1fe admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:03.223005 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75524098-2273-43cc-8e90-3fab972ff1fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:03.225320 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75524098-2273-43cc-8e90-3fab972ff1fe admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:03.239047 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 818/1633] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:03.240404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75524098-2273-43cc-8e90-3fab972ff1fe admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:03.253525 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75524098-2273-43cc-8e90-3fab972ff1fe admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:03.260757 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52cf938-3f93-4b11-a48c-b89433aa7437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:03.263158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52cf938-3f93-4b11-a48c-b89433aa7437 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:03.263538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52cf938-3f93-4b11-a48c-b89433aa7437 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:03.263906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52cf938-3f93-4b11-a48c-b89433aa7437 admin admin] PATH_INFO: `/v3/projects/cf57a8ef50ee4f00b2f89a3baa3f38a6/users/06d874465a2648ee951aa876e3efbc56/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:03.264996 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45cf1f-954e-4fb0-8aa0-453d11e5d058 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:03.267436 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52cf938-3f93-4b11-a48c-b89433aa7437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf57a8ef50ee4f00b2f89a3baa3f38a6, user_id=06d874465a2648ee951aa876e3efbc56, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:03.268836 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52d7e1-c26b-4c05-ad2a-429cec2416eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:03.269519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52d7e1-c26b-4c05-ad2a-429cec2416eb service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:03.269806 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52d7e1-c26b-4c05-ad2a-429cec2416eb service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:03.270326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52d7e1-c26b-4c05-ad2a-429cec2416eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:03.271481 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52cf938-3f93-4b11-a48c-b89433aa7437 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:03.281907 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52d7e1-c26b-4c05-ad2a-429cec2416eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:03.286289 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52d7e1-c26b-4c05-ad2a-429cec2416eb service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:03.302140 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 816/1635] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:03.304751 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52d7e1-c26b-4c05-ad2a-429cec2416eb service cinder] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:03.317377 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 819/1635] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:03 2022] PUT /identity/v3/projects/cf57a8ef50ee4f00b2f89a3baa3f38a6/users/06d874465a2648ee951aa876e3efbc56/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:03.319797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524e8ba-2340-4dcb-a00e-f17ad8afec8d None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:03.323184 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524e8ba-2340-4dcb-a00e-f17ad8afec8d None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:03.323934 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524e8ba-2340-4dcb-a00e-f17ad8afec8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:03.345168 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52d7e1-c26b-4c05-ad2a-429cec2416eb service cinder] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:03.379135 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-f524e8ba-2340-4dcb-a00e-f17ad8afec8d None None] MFA Rules not processed for user `06d874465a2648ee951aa876e3efbc56`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:03.381145 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-f524e8ba-2340-4dcb-a00e-f17ad8afec8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:03.424162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c5b99-5ce0-4ab9-8988-a3132614dfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:03.425309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c5b99-5ce0-4ab9-8988-a3132614dfd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:03.426120 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c5b99-5ce0-4ab9-8988-a3132614dfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:03.426608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c5b99-5ce0-4ab9-8988-a3132614dfd1 admin admin] PATH_INFO: `/v3/projects/38ac5367510a4d0b83d19da6107d53e0/users/b1002870ed25494da3a2db371c01f43c/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:03.429213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c5b99-5ce0-4ab9-8988-a3132614dfd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38ac5367510a4d0b83d19da6107d53e0, user_id=b1002870ed25494da3a2db371c01f43c, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:03.432767 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c5b99-5ce0-4ab9-8988-a3132614dfd1 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:03.458122 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 817/1636] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:03 2022] PUT /identity/v3/projects/38ac5367510a4d0b83d19da6107d53e0/users/b1002870ed25494da3a2db371c01f43c/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:03.458122 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa734d-96fa-45f5-bc90-2bc9a09d4b51 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:03.458786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa734d-96fa-45f5-bc90-2bc9a09d4b51 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:03.459073 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa734d-96fa-45f5-bc90-2bc9a09d4b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:03.495581 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:03.525696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 820/1637] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:03.537517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524e8ba-2340-4dcb-a00e-f17ad8afec8d None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:03.539670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-4daa734d-96fa-45f5-bc90-2bc9a09d4b51 None None] MFA Rules not processed for user `b1002870ed25494da3a2db371c01f43c`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:03.541304 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-4daa734d-96fa-45f5-bc90-2bc9a09d4b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:03.656695 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524e8ba-2340-4dcb-a00e-f17ad8afec8d None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:03.675371 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 818/1638] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:03 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:03.711889 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa734d-96fa-45f5-bc90-2bc9a09d4b51 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:03.781922 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa088e8-a9ec-45f0-bc31-a2b86c54da20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:03.782871 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa088e8-a9ec-45f0-bc31-a2b86c54da20 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:03.783436 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa088e8-a9ec-45f0-bc31-a2b86c54da20 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:03.783810 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa088e8-a9ec-45f0-bc31-a2b86c54da20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:03.823522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa734d-96fa-45f5-bc90-2bc9a09d4b51 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:03.832678 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006620b-0601-4314-89f8-4fb50ef9c78e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:03.833310 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006620b-0601-4314-89f8-4fb50ef9c78e service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:03.833590 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006620b-0601-4314-89f8-4fb50ef9c78e service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:03.835855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006620b-0601-4314-89f8-4fb50ef9c78e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:03.856510 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006620b-0601-4314-89f8-4fb50ef9c78e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:03.859861 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006620b-0601-4314-89f8-4fb50ef9c78e service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:03.876095 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 819/1639] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:03 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 09:59:03.883105 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa088e8-a9ec-45f0-bc31-a2b86c54da20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:03.884157 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa088e8-a9ec-45f0-bc31-a2b86c54da20 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:03.897566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 821/1640] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:03 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:04.091362 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:04.318537 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006620b-0601-4314-89f8-4fb50ef9c78e service cinder] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:04.445350 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006620b-0601-4314-89f8-4fb50ef9c78e service cinder] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:04.451021 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8dba9-e4a3-4b15-b288-a6580720128b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:04.451784 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8dba9-e4a3-4b15-b288-a6580720128b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:04.452123 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8dba9-e4a3-4b15-b288-a6580720128b admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:04.452495 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8dba9-e4a3-4b15-b288-a6580720128b admin admin] PATH_INFO: `/v3/users/b101f7a91b8d4f46b5eaeca440fbb512` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:04.453936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8dba9-e4a3-4b15-b288-a6580720128b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b101f7a91b8d4f46b5eaeca440fbb512)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:04.460105 dv-cinder-815660-9-smb devstack@keystone.service[98478]: WARNING py.warnings [None req-55f8dba9-e4a3-4b15-b288-a6580720128b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 09:59:04.460105 dv-cinder-815660-9-smb devstack@keystone.service[98478]: warnings.warn(msg) Aug 11 09:59:04.460105 dv-cinder-815660-9-smb devstack@keystone.service[98478]: Aug 11 09:59:04.460105 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8dba9-e4a3-4b15-b288-a6580720128b admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:05.058464 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-55f8dba9-e4a3-4b15-b288-a6580720128b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b101f7a91b8d4f46b5eaeca440fbb512'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:05.085462 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-55f8dba9-e4a3-4b15-b288-a6580720128b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b101f7a91b8d4f46b5eaeca440fbb512'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:05.086703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-55f8dba9-e4a3-4b15-b288-a6580720128b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b101f7a91b8d4f46b5eaeca440fbb512'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:05.088562 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-55f8dba9-e4a3-4b15-b288-a6580720128b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b101f7a91b8d4f46b5eaeca440fbb512'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:05.102963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-55f8dba9-e4a3-4b15-b288-a6580720128b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b101f7a91b8d4f46b5eaeca440fbb512'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:05.229895 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 820/1641] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:59:04 2022] DELETE /identity/v3/users/b101f7a91b8d4f46b5eaeca440fbb512 => generated 0 bytes in 915 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:05.236700 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66c88e-1d2a-4ea0-8835-3431195f7a9a None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:05.236700 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66c88e-1d2a-4ea0-8835-3431195f7a9a None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:05.236700 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66c88e-1d2a-4ea0-8835-3431195f7a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:05.248306 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:05.275350 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-ed66c88e-1d2a-4ea0-8835-3431195f7a9a None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:05.276787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-ed66c88e-1d2a-4ea0-8835-3431195f7a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:05.361940 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:05.409280 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 822/1642] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 09:59:05.490182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8dba9-e4a3-4b15-b288-a6580720128b admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:05.490182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-55f8dba9-e4a3-4b15-b288-a6580720128b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:05.641951 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8dba9-e4a3-4b15-b288-a6580720128b admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:05.648108 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177fa49-89f4-41a7-9c20-2f99f043abd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:05.649318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177fa49-89f4-41a7-9c20-2f99f043abd4 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:05.649812 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177fa49-89f4-41a7-9c20-2f99f043abd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:05.650154 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177fa49-89f4-41a7-9c20-2f99f043abd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:05.671982 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66c88e-1d2a-4ea0-8835-3431195f7a9a None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:05.671982 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-ed66c88e-1d2a-4ea0-8835-3431195f7a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:05.705086 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66c88e-1d2a-4ea0-8835-3431195f7a9a None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:05.705280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177fa49-89f4-41a7-9c20-2f99f043abd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:05.706981 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177fa49-89f4-41a7-9c20-2f99f043abd4 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:05.719446 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33a9d0-2995-45af-937f-3ca44b850b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:05.720494 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33a9d0-2995-45af-937f-3ca44b850b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:05.722283 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33a9d0-2995-45af-937f-3ca44b850b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:05.722720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33a9d0-2995-45af-937f-3ca44b850b90 admin admin] PATH_INFO: `/v3/users/d7b38cdf614041619a6b3a24fac7b17f` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:05.726337 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33a9d0-2995-45af-937f-3ca44b850b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7b38cdf614041619a6b3a24fac7b17f)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:05.726493 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 821/1643] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:05.730834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33a9d0-2995-45af-937f-3ca44b850b90 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:05.985566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-8f33a9d0-2995-45af-937f-3ca44b850b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7b38cdf614041619a6b3a24fac7b17f'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:06.009161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-8f33a9d0-2995-45af-937f-3ca44b850b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7b38cdf614041619a6b3a24fac7b17f'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:06.010565 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-8f33a9d0-2995-45af-937f-3ca44b850b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7b38cdf614041619a6b3a24fac7b17f'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:06.024494 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-8f33a9d0-2995-45af-937f-3ca44b850b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7b38cdf614041619a6b3a24fac7b17f'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:06.136105 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-8f33a9d0-2995-45af-937f-3ca44b850b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7b38cdf614041619a6b3a24fac7b17f'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:06.142854 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 823/1644] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:59:05 2022] DELETE /identity/v3/users/d7b38cdf614041619a6b3a24fac7b17f => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:06.148092 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98109421-f1e2-4eba-b49e-551cad49630d None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:06.149769 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98109421-f1e2-4eba-b49e-551cad49630d None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:06.150865 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98109421-f1e2-4eba-b49e-551cad49630d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:06.188059 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-98109421-f1e2-4eba-b49e-551cad49630d None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:06.189789 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-98109421-f1e2-4eba-b49e-551cad49630d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:06.407600 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 822/1645] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:06.431978 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33a9d0-2995-45af-937f-3ca44b850b90 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:06.433664 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-8f33a9d0-2995-45af-937f-3ca44b850b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:06.441517 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bc5e2-d23e-4f41-a29e-bafb4eb695dc None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:06.467002 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bc5e2-d23e-4f41-a29e-bafb4eb695dc None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:06.470621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bc5e2-d23e-4f41-a29e-bafb4eb695dc None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:06.472277 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 823/1646] 10.222.0.13 () {54 vars in 962 bytes} [Thu Aug 11 09:59:06 2022] GET /identity => generated 270 bytes in 33 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:59:06.481496 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6c387-116f-4942-b12d-7f83ad9c3a41 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:06.481783 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6c387-116f-4942-b12d-7f83ad9c3a41 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:06.482060 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6c387-116f-4942-b12d-7f83ad9c3a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:06.591243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-26f6c387-116f-4942-b12d-7f83ad9c3a41 None None] MFA Rules not processed for user `4c1dc8e0d9454ad98894ed1e8d31f931`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:06.591243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-26f6c387-116f-4942-b12d-7f83ad9c3a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:06.617503 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33a9d0-2995-45af-937f-3ca44b850b90 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:06.627413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e01d4b-5597-4bb8-a552-e0162266cae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:06.628055 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e01d4b-5597-4bb8-a552-e0162266cae9 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:06.628336 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e01d4b-5597-4bb8-a552-e0162266cae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:06.628607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e01d4b-5597-4bb8-a552-e0162266cae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:06.648060 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e01d4b-5597-4bb8-a552-e0162266cae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:06.649765 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e01d4b-5597-4bb8-a552-e0162266cae9 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:06.668402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:06.673881 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 824/1647] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 09:59:06.761285 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa10182-93ef-4ecf-a801-af7cf700a897 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:06.761506 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa10182-93ef-4ecf-a801-af7cf700a897 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:06.761781 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa10182-93ef-4ecf-a801-af7cf700a897 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:06.763663 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 825/1648] 10.222.0.13 () {54 vars in 912 bytes} [Thu Aug 11 09:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:59:06.768490 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 824/1649] 10.222.0.13 () {58 vars in 1059 bytes} [Thu Aug 11 09:59:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:06.770728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2e980-155f-4ed8-9ac4-2b3403ac5d72 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:06.773813 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2e980-155f-4ed8-9ac4-2b3403ac5d72 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:06.773813 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2e980-155f-4ed8-9ac4-2b3403ac5d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:06.816711 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-61b2e980-155f-4ed8-9ac4-2b3403ac5d72 None None] MFA Rules not processed for user `4c1dc8e0d9454ad98894ed1e8d31f931`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:06.823018 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-61b2e980-155f-4ed8-9ac4-2b3403ac5d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:06.857713 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 826/1650] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Aug 11 09:59:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 09:59:06.871000 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6c387-116f-4942-b12d-7f83ad9c3a41 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:06.872820 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-26f6c387-116f-4942-b12d-7f83ad9c3a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:06.995269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6c387-116f-4942-b12d-7f83ad9c3a41 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:07.000114 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af7022-7572-4bdb-ac6b-b13de04f0cca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:07.002739 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af7022-7572-4bdb-ac6b-b13de04f0cca service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:07.002893 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af7022-7572-4bdb-ac6b-b13de04f0cca service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:07.003178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af7022-7572-4bdb-ac6b-b13de04f0cca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:07.023730 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af7022-7572-4bdb-ac6b-b13de04f0cca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:07.025510 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af7022-7572-4bdb-ac6b-b13de04f0cca service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:07.046236 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 825/1651] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:07.447100 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2e980-155f-4ed8-9ac4-2b3403ac5d72 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:07.450196 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-61b2e980-155f-4ed8-9ac4-2b3403ac5d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:07.473766 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2e980-155f-4ed8-9ac4-2b3403ac5d72 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:07.480378 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d44c5-8ae2-41e5-a3df-87ec3ae58ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:07.481376 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d44c5-8ae2-41e5-a3df-87ec3ae58ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:07.482176 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d44c5-8ae2-41e5-a3df-87ec3ae58ece admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:07.482647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d44c5-8ae2-41e5-a3df-87ec3ae58ece admin admin] PATH_INFO: `/v3/projects/b68e744ede8e4e5fb44c73816fe6cf1a` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:07.484395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d44c5-8ae2-41e5-a3df-87ec3ae58ece admin admin] RBAC: Authorizing `identity:delete_project(project_id=b68e744ede8e4e5fb44c73816fe6cf1a)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:07.485643 dv-cinder-815660-9-smb devstack@keystone.service[98479]: WARNING py.warnings [None req-5c9d44c5-8ae2-41e5-a3df-87ec3ae58ece admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 09:59:07.485643 dv-cinder-815660-9-smb devstack@keystone.service[98479]: warnings.warn(msg) Aug 11 09:59:07.485643 dv-cinder-815660-9-smb devstack@keystone.service[98479]: Aug 11 09:59:07.488208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d44c5-8ae2-41e5-a3df-87ec3ae58ece admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:07.719184 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:07.722337 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-5c9d44c5-8ae2-41e5-a3df-87ec3ae58ece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b68e744ede8e4e5fb44c73816fe6cf1a', 'request_id': 'req-5c9d44c5-8ae2-41e5-a3df-87ec3ae58ece'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:07.742549 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-5c9d44c5-8ae2-41e5-a3df-87ec3ae58ece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b68e744ede8e4e5fb44c73816fe6cf1a', 'request_id': 'req-5c9d44c5-8ae2-41e5-a3df-87ec3ae58ece'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:07.802840 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-5c9d44c5-8ae2-41e5-a3df-87ec3ae58ece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b68e744ede8e4e5fb44c73816fe6cf1a', 'request_id': 'req-5c9d44c5-8ae2-41e5-a3df-87ec3ae58ece'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:07.915041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-5c9d44c5-8ae2-41e5-a3df-87ec3ae58ece admin admin] The token cache is being invalidate because project b68e744ede8e4e5fb44c73816fe6cf1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 09:59:07.915560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-5c9d44c5-8ae2-41e5-a3df-87ec3ae58ece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:07.916361 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-5c9d44c5-8ae2-41e5-a3df-87ec3ae58ece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:07.921238 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 827/1652] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:59:07 2022] DELETE /identity/v3/projects/b68e744ede8e4e5fb44c73816fe6cf1a => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:07.925018 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af7022-7572-4bdb-ac6b-b13de04f0cca service cinder] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:07.947515 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af7022-7572-4bdb-ac6b-b13de04f0cca service cinder] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:08.107046 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d44c5-8ae2-41e5-a3df-87ec3ae58ece admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:08.110522 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-5c9d44c5-8ae2-41e5-a3df-87ec3ae58ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:08.183290 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b05e9-d0ae-45d9-82cb-4752e7c1dcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:08.184182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b05e9-d0ae-45d9-82cb-4752e7c1dcee admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:08.198433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b05e9-d0ae-45d9-82cb-4752e7c1dcee admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:08.200761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b05e9-d0ae-45d9-82cb-4752e7c1dcee admin admin] PATH_INFO: `/v3/users/b1002870ed25494da3a2db371c01f43c` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:08.207198 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b05e9-d0ae-45d9-82cb-4752e7c1dcee admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1002870ed25494da3a2db371c01f43c)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:08.209262 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b05e9-d0ae-45d9-82cb-4752e7c1dcee admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:08.414473 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d44c5-8ae2-41e5-a3df-87ec3ae58ece admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:08.445134 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651e5c4-5ecd-43d0-af79-c501b06bb1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:08.445845 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651e5c4-5ecd-43d0-af79-c501b06bb1c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:08.446171 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651e5c4-5ecd-43d0-af79-c501b06bb1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:08.446455 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651e5c4-5ecd-43d0-af79-c501b06bb1c1 admin admin] PATH_INFO: `/v3/projects/97d75164ca6949a4bb5643fe3b3e5e42` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:08.451490 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651e5c4-5ecd-43d0-af79-c501b06bb1c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97d75164ca6949a4bb5643fe3b3e5e42)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:08.455156 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651e5c4-5ecd-43d0-af79-c501b06bb1c1 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:08.578183 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-fa2b05e9-d0ae-45d9-82cb-4752e7c1dcee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1002870ed25494da3a2db371c01f43c'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:08.613465 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-fa2b05e9-d0ae-45d9-82cb-4752e7c1dcee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1002870ed25494da3a2db371c01f43c'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:08.614810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-fa2b05e9-d0ae-45d9-82cb-4752e7c1dcee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1002870ed25494da3a2db371c01f43c'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:08.618195 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-fa2b05e9-d0ae-45d9-82cb-4752e7c1dcee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1002870ed25494da3a2db371c01f43c'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:08.636462 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-fa2b05e9-d0ae-45d9-82cb-4752e7c1dcee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1002870ed25494da3a2db371c01f43c'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:08.730733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c651e5c4-5ecd-43d0-af79-c501b06bb1c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97d75164ca6949a4bb5643fe3b3e5e42', 'request_id': 'req-c651e5c4-5ecd-43d0-af79-c501b06bb1c1'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:08.744958 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c651e5c4-5ecd-43d0-af79-c501b06bb1c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97d75164ca6949a4bb5643fe3b3e5e42', 'request_id': 'req-c651e5c4-5ecd-43d0-af79-c501b06bb1c1'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:08.749807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 826/1653] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:59:07 2022] DELETE /identity/v3/users/b1002870ed25494da3a2db371c01f43c => generated 0 bytes in 825 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:08.751885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b05e9-d0ae-45d9-82cb-4752e7c1dcee admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:08.760689 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-fa2b05e9-d0ae-45d9-82cb-4752e7c1dcee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:08.765158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c651e5c4-5ecd-43d0-af79-c501b06bb1c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97d75164ca6949a4bb5643fe3b3e5e42', 'request_id': 'req-c651e5c4-5ecd-43d0-af79-c501b06bb1c1'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:08.934503 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c651e5c4-5ecd-43d0-af79-c501b06bb1c1 admin admin] The token cache is being invalidate because project 97d75164ca6949a4bb5643fe3b3e5e42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 09:59:08.934503 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c651e5c4-5ecd-43d0-af79-c501b06bb1c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:08.934503 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c651e5c4-5ecd-43d0-af79-c501b06bb1c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:08.934503 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 828/1654] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:59:08 2022] DELETE /identity/v3/projects/97d75164ca6949a4bb5643fe3b3e5e42 => generated 0 bytes in 824 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:08.937280 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651e5c4-5ecd-43d0-af79-c501b06bb1c1 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:08.938703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:08.944556 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-c651e5c4-5ecd-43d0-af79-c501b06bb1c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:08.979673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b05e9-d0ae-45d9-82cb-4752e7c1dcee admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:08.992859 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0e487-ab2f-4368-b96b-4ee03dee50f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:08.993598 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0e487-ab2f-4368-b96b-4ee03dee50f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:08.993863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0e487-ab2f-4368-b96b-4ee03dee50f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:08.994162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0e487-ab2f-4368-b96b-4ee03dee50f9 admin admin] PATH_INFO: `/v3/users/13443e2da7474098800614ec8e09e77d` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:08.997419 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0e487-ab2f-4368-b96b-4ee03dee50f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13443e2da7474098800614ec8e09e77d)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:08.999635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0e487-ab2f-4368-b96b-4ee03dee50f9 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:09.095779 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651e5c4-5ecd-43d0-af79-c501b06bb1c1 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:09.112066 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb969da-0538-4984-933e-0f14115f370d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:09.112724 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb969da-0538-4984-933e-0f14115f370d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:09.112998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb969da-0538-4984-933e-0f14115f370d admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:09.113333 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb969da-0538-4984-933e-0f14115f370d admin admin] PATH_INFO: `/v3/users/06d874465a2648ee951aa876e3efbc56` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:09.114535 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb969da-0538-4984-933e-0f14115f370d admin admin] RBAC: Authorizing `identity:delete_user(user_id=06d874465a2648ee951aa876e3efbc56)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:09.116537 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb969da-0538-4984-933e-0f14115f370d admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:09.283144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e7c0e487-ab2f-4368-b96b-4ee03dee50f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13443e2da7474098800614ec8e09e77d'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:09.319115 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e7c0e487-ab2f-4368-b96b-4ee03dee50f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13443e2da7474098800614ec8e09e77d'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:09.320726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e7c0e487-ab2f-4368-b96b-4ee03dee50f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13443e2da7474098800614ec8e09e77d'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:09.322978 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e7c0e487-ab2f-4368-b96b-4ee03dee50f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13443e2da7474098800614ec8e09e77d'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:09.341790 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e7c0e487-ab2f-4368-b96b-4ee03dee50f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13443e2da7474098800614ec8e09e77d'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:09.416112 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-eeb969da-0538-4984-933e-0f14115f370d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06d874465a2648ee951aa876e3efbc56'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:09.445172 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-eeb969da-0538-4984-933e-0f14115f370d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06d874465a2648ee951aa876e3efbc56'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:09.446355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-eeb969da-0538-4984-933e-0f14115f370d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06d874465a2648ee951aa876e3efbc56'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:09.459800 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-eeb969da-0538-4984-933e-0f14115f370d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06d874465a2648ee951aa876e3efbc56'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:09.473237 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 827/1655] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:59:08 2022] DELETE /identity/v3/users/13443e2da7474098800614ec8e09e77d => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:09.477685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6be27-6ab0-4e54-8f29-be4c7beb10ee None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:09.477974 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6be27-6ab0-4e54-8f29-be4c7beb10ee None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:09.478274 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6be27-6ab0-4e54-8f29-be4c7beb10ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:09.517844 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-26a6be27-6ab0-4e54-8f29-be4c7beb10ee None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:09.519105 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-26a6be27-6ab0-4e54-8f29-be4c7beb10ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:09.577918 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-eeb969da-0538-4984-933e-0f14115f370d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06d874465a2648ee951aa876e3efbc56'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:09.586117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 829/1656] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:59:08 2022] DELETE /identity/v3/users/06d874465a2648ee951aa876e3efbc56 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:09.903194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 828/1657] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 09:59:09.949203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb969da-0538-4984-933e-0f14115f370d admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:09.949203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-eeb969da-0538-4984-933e-0f14115f370d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:10.129642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb969da-0538-4984-933e-0f14115f370d admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:10.140296 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f53d19-52f7-4f36-9285-bcfd13ac65ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:10.143274 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f53d19-52f7-4f36-9285-bcfd13ac65ca service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:10.143577 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f53d19-52f7-4f36-9285-bcfd13ac65ca service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:10.146736 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f53d19-52f7-4f36-9285-bcfd13ac65ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:10.219938 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:10.298346 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f53d19-52f7-4f36-9285-bcfd13ac65ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:10.300796 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f53d19-52f7-4f36-9285-bcfd13ac65ca service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:10.324177 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 830/1658] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:10.531216 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6be27-6ab0-4e54-8f29-be4c7beb10ee None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:10.533536 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-26a6be27-6ab0-4e54-8f29-be4c7beb10ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:10.558320 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6be27-6ab0-4e54-8f29-be4c7beb10ee None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:10.576411 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4705b73-f1db-4531-94a7-5fcc1d600057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:10.577488 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4705b73-f1db-4531-94a7-5fcc1d600057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:10.577912 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4705b73-f1db-4531-94a7-5fcc1d600057 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:10.578348 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4705b73-f1db-4531-94a7-5fcc1d600057 admin admin] PATH_INFO: `/v3/projects/38ac5367510a4d0b83d19da6107d53e0` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:10.581342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4705b73-f1db-4531-94a7-5fcc1d600057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38ac5367510a4d0b83d19da6107d53e0)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:10.583857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4705b73-f1db-4531-94a7-5fcc1d600057 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:10.813550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e4705b73-f1db-4531-94a7-5fcc1d600057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38ac5367510a4d0b83d19da6107d53e0', 'request_id': 'req-e4705b73-f1db-4531-94a7-5fcc1d600057'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:10.829916 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e4705b73-f1db-4531-94a7-5fcc1d600057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38ac5367510a4d0b83d19da6107d53e0', 'request_id': 'req-e4705b73-f1db-4531-94a7-5fcc1d600057'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:10.954342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e4705b73-f1db-4531-94a7-5fcc1d600057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38ac5367510a4d0b83d19da6107d53e0', 'request_id': 'req-e4705b73-f1db-4531-94a7-5fcc1d600057'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:10.984338 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e4705b73-f1db-4531-94a7-5fcc1d600057 admin admin] The token cache is being invalidate because project 38ac5367510a4d0b83d19da6107d53e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 09:59:10.984804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e4705b73-f1db-4531-94a7-5fcc1d600057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:10.987564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e4705b73-f1db-4531-94a7-5fcc1d600057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:10.993368 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 829/1659] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:59:10 2022] DELETE /identity/v3/projects/38ac5367510a4d0b83d19da6107d53e0 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:10.998611 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69151e40-68fe-49f5-939a-38df96789788 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:10.999158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69151e40-68fe-49f5-939a-38df96789788 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:10.999158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69151e40-68fe-49f5-939a-38df96789788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:11.042243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-69151e40-68fe-49f5-939a-38df96789788 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:11.048461 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-69151e40-68fe-49f5-939a-38df96789788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:11.130386 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:11.279031 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e9136-5ff0-45fe-9c0f-29e5e30a423e None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:11.279338 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e9136-5ff0-45fe-9c0f-29e5e30a423e None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:11.279614 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 831/1660] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:11.279813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e9136-5ff0-45fe-9c0f-29e5e30a423e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:11.332218 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-ee8e9136-5ff0-45fe-9c0f-29e5e30a423e None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:11.349239 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ee8e9136-5ff0-45fe-9c0f-29e5e30a423e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:11.379935 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 830/1661] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:11.384277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69151e40-68fe-49f5-939a-38df96789788 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:11.403108 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69151e40-68fe-49f5-939a-38df96789788 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:11.423723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477401a-18c1-4123-b6f7-6bb8c8f29534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:11.424352 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477401a-18c1-4123-b6f7-6bb8c8f29534 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:11.424768 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477401a-18c1-4123-b6f7-6bb8c8f29534 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:11.424889 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477401a-18c1-4123-b6f7-6bb8c8f29534 admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:11.425542 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477401a-18c1-4123-b6f7-6bb8c8f29534 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:59:11.425844 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477401a-18c1-4123-b6f7-6bb8c8f29534 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:11.428870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477401a-18c1-4123-b6f7-6bb8c8f29534 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:11.481079 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 832/1662] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 09:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:59:11.484723 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e9136-5ff0-45fe-9c0f-29e5e30a423e None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:11.503710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e9136-5ff0-45fe-9c0f-29e5e30a423e None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:11.529145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515a41b-2cd1-4f8e-bec9-c859ec284843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:11.534207 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515a41b-2cd1-4f8e-bec9-c859ec284843 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:11.534207 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515a41b-2cd1-4f8e-bec9-c859ec284843 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:11.534207 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515a41b-2cd1-4f8e-bec9-c859ec284843 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:11.534207 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515a41b-2cd1-4f8e-bec9-c859ec284843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:11.534207 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515a41b-2cd1-4f8e-bec9-c859ec284843 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:11.672078 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 831/1663] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:59:11 2022] POST /identity/v3/projects => generated 357 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:11.676011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477401a-18c1-4123-b6f7-6bb8c8f29534 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:11.693090 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477401a-18c1-4123-b6f7-6bb8c8f29534 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:11.852297 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d10102-9f1f-404d-a542-100954662c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:11.853148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d10102-9f1f-404d-a542-100954662c92 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:11.853841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d10102-9f1f-404d-a542-100954662c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:11.854136 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d10102-9f1f-404d-a542-100954662c92 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:11.856169 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d10102-9f1f-404d-a542-100954662c92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:11.860586 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d10102-9f1f-404d-a542-100954662c92 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:11.950664 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 833/1664] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:11 2022] POST /identity/v3/users => generated 279 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:11.950953 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515a41b-2cd1-4f8e-bec9-c859ec284843 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:11.980850 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515a41b-2cd1-4f8e-bec9-c859ec284843 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:11.992573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd75d8-a1e7-476e-9262-e1b62343547d None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:11.993146 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd75d8-a1e7-476e-9262-e1b62343547d None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:11.993446 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd75d8-a1e7-476e-9262-e1b62343547d None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:11.996160 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 834/1665] 10.222.0.13 () {54 vars in 962 bytes} [Thu Aug 11 09:59:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:59:12.012017 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc832d8-56c4-4e00-acbb-1536198019e0 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:12.012731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f417d-1a59-496b-9ffe-3ac87b807356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:12.013370 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f417d-1a59-496b-9ffe-3ac87b807356 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:12.013637 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc832d8-56c4-4e00-acbb-1536198019e0 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:12.013751 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f417d-1a59-496b-9ffe-3ac87b807356 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:12.013906 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f417d-1a59-496b-9ffe-3ac87b807356 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:12.014243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc832d8-56c4-4e00-acbb-1536198019e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:12.014753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f417d-1a59-496b-9ffe-3ac87b807356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:12.016378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f417d-1a59-496b-9ffe-3ac87b807356 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:12.025705 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:12.048317 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-9dc832d8-56c4-4e00-acbb-1536198019e0 None None] MFA Rules not processed for user `4c1dc8e0d9454ad98894ed1e8d31f931`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:12.049835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-9dc832d8-56c4-4e00-acbb-1536198019e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:12.054133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 832/1666] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:12.061309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f417d-1a59-496b-9ffe-3ac87b807356 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:12.081070 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f417d-1a59-496b-9ffe-3ac87b807356 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:12.097767 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6a2a0-72fa-463e-b9a6-7fb24efe3ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:12.098489 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6a2a0-72fa-463e-b9a6-7fb24efe3ddb admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:12.098767 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6a2a0-72fa-463e-b9a6-7fb24efe3ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:12.099038 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6a2a0-72fa-463e-b9a6-7fb24efe3ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:12.102545 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6a2a0-72fa-463e-b9a6-7fb24efe3ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:12.104183 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6a2a0-72fa-463e-b9a6-7fb24efe3ddb admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:12.137371 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 833/1667] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:12.138978 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6a2a0-72fa-463e-b9a6-7fb24efe3ddb admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:12.166799 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6a2a0-72fa-463e-b9a6-7fb24efe3ddb admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:12.176728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd2bdc-0609-4ea2-8a14-8257ad6c449b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:12.177484 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd2bdc-0609-4ea2-8a14-8257ad6c449b admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:12.177805 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd2bdc-0609-4ea2-8a14-8257ad6c449b admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:12.178146 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd2bdc-0609-4ea2-8a14-8257ad6c449b admin admin] PATH_INFO: `/v3/projects/6c02066a20cc429cb12d9210ab00a266/users/71828f07c7ae42cdb0e38a54cb17d06f/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:12.213448 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd2bdc-0609-4ea2-8a14-8257ad6c449b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c02066a20cc429cb12d9210ab00a266, user_id=71828f07c7ae42cdb0e38a54cb17d06f, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:12.225676 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd2bdc-0609-4ea2-8a14-8257ad6c449b admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:12.234489 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 835/1668] 10.222.0.13 () {58 vars in 1059 bytes} [Thu Aug 11 09:59:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 09:59:12.235371 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc832d8-56c4-4e00-acbb-1536198019e0 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:12.244801 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-9dc832d8-56c4-4e00-acbb-1536198019e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:12.297176 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc832d8-56c4-4e00-acbb-1536198019e0 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:12.311463 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 834/1669] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:12 2022] PUT /identity/v3/projects/6c02066a20cc429cb12d9210ab00a266/users/71828f07c7ae42cdb0e38a54cb17d06f/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:12.313943 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fd72b-23ec-4b19-a789-f93fd7bb23e3 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:12.314439 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fd72b-23ec-4b19-a789-f93fd7bb23e3 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:12.314860 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fd72b-23ec-4b19-a789-f93fd7bb23e3 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:12.316439 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 835/1670] 10.222.0.13 () {54 vars in 912 bytes} [Thu Aug 11 09:59:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:59:12.318069 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d15b14-6655-4651-b04a-e650903dd2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:12.319658 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d15b14-6655-4651-b04a-e650903dd2b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:12.320097 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d15b14-6655-4651-b04a-e650903dd2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:12.320507 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d15b14-6655-4651-b04a-e650903dd2b1 admin admin] PATH_INFO: `/v3/projects/cf57a8ef50ee4f00b2f89a3baa3f38a6` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:12.322582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d15b14-6655-4651-b04a-e650903dd2b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf57a8ef50ee4f00b2f89a3baa3f38a6)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:12.324375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5972f-5133-4497-8bbd-51e2272ef460 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:12.324802 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5972f-5133-4497-8bbd-51e2272ef460 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:12.325267 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5972f-5133-4497-8bbd-51e2272ef460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:12.331056 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d15b14-6655-4651-b04a-e650903dd2b1 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:12.379708 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-34d5972f-5133-4497-8bbd-51e2272ef460 None None] MFA Rules not processed for user `4c1dc8e0d9454ad98894ed1e8d31f931`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:12.387203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-34d5972f-5133-4497-8bbd-51e2272ef460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:12.519256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 836/1671] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Aug 11 09:59:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:12.521297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9a2e9-a9f6-4f97-9f99-d4805b3e808e None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:12.522624 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9a2e9-a9f6-4f97-9f99-d4805b3e808e None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:12.523615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9a2e9-a9f6-4f97-9f99-d4805b3e808e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:12.586622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-30d15b14-6655-4651-b04a-e650903dd2b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf57a8ef50ee4f00b2f89a3baa3f38a6', 'request_id': 'req-30d15b14-6655-4651-b04a-e650903dd2b1'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:12.607695 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-30d15b14-6655-4651-b04a-e650903dd2b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf57a8ef50ee4f00b2f89a3baa3f38a6', 'request_id': 'req-30d15b14-6655-4651-b04a-e650903dd2b1'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:12.617197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-33f9a2e9-a9f6-4f97-9f99-d4805b3e808e None None] MFA Rules not processed for user `71828f07c7ae42cdb0e38a54cb17d06f`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:12.619046 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-33f9a2e9-a9f6-4f97-9f99-d4805b3e808e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:12.622660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-30d15b14-6655-4651-b04a-e650903dd2b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf57a8ef50ee4f00b2f89a3baa3f38a6', 'request_id': 'req-30d15b14-6655-4651-b04a-e650903dd2b1'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:12.711748 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 837/1672] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:12.712858 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9a2e9-a9f6-4f97-9f99-d4805b3e808e None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:12.719901 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-33f9a2e9-a9f6-4f97-9f99-d4805b3e808e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:12.737719 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-30d15b14-6655-4651-b04a-e650903dd2b1 admin admin] The token cache is being invalidate because project cf57a8ef50ee4f00b2f89a3baa3f38a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 09:59:12.742520 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-30d15b14-6655-4651-b04a-e650903dd2b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:12.742520 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-30d15b14-6655-4651-b04a-e650903dd2b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:12.743832 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 836/1673] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:59:12 2022] DELETE /identity/v3/projects/cf57a8ef50ee4f00b2f89a3baa3f38a6 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:12.744879 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d15b14-6655-4651-b04a-e650903dd2b1 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:12.748534 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-30d15b14-6655-4651-b04a-e650903dd2b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:12.880774 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:12.888402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9a2e9-a9f6-4f97-9f99-d4805b3e808e None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:12.903059 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae65c5-44ce-44ef-b8c6-2d47d7cf27bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:12.903734 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae65c5-44ce-44ef-b8c6-2d47d7cf27bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:12.904019 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae65c5-44ce-44ef-b8c6-2d47d7cf27bf admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:12.904296 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae65c5-44ce-44ef-b8c6-2d47d7cf27bf admin admin] PATH_INFO: `/v3/projects/c0b5611ea2ca4c278b473b92f7b659f5` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:12.906410 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d15b14-6655-4651-b04a-e650903dd2b1 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:12.907838 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae65c5-44ce-44ef-b8c6-2d47d7cf27bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0b5611ea2ca4c278b473b92f7b659f5)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:12.914281 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae65c5-44ce-44ef-b8c6-2d47d7cf27bf admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:12.915782 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570c427-dc90-4dae-af42-a5d29c259aac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:12.916770 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570c427-dc90-4dae-af42-a5d29c259aac service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:12.917049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570c427-dc90-4dae-af42-a5d29c259aac service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:12.917324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570c427-dc90-4dae-af42-a5d29c259aac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:12.923858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-d570c427-dc90-4dae-af42-a5d29c259aac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:13.080610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-7cae65c5-44ce-44ef-b8c6-2d47d7cf27bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0b5611ea2ca4c278b473b92f7b659f5', 'request_id': 'req-7cae65c5-44ce-44ef-b8c6-2d47d7cf27bf'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:13.110382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570c427-dc90-4dae-af42-a5d29c259aac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:13.112373 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-7cae65c5-44ce-44ef-b8c6-2d47d7cf27bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0b5611ea2ca4c278b473b92f7b659f5', 'request_id': 'req-7cae65c5-44ce-44ef-b8c6-2d47d7cf27bf'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:13.113984 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570c427-dc90-4dae-af42-a5d29c259aac service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:13.137048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 837/1674] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:13.137996 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570c427-dc90-4dae-af42-a5d29c259aac service cinder] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:13.139756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-d570c427-dc90-4dae-af42-a5d29c259aac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:13.156067 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570c427-dc90-4dae-af42-a5d29c259aac service cinder] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:13.227867 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401ff8d-1eff-40bd-8399-9e3910e18ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:13.228497 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401ff8d-1eff-40bd-8399-9e3910e18ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:13.229649 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401ff8d-1eff-40bd-8399-9e3910e18ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:13.229649 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401ff8d-1eff-40bd-8399-9e3910e18ef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:13.236069 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401ff8d-1eff-40bd-8399-9e3910e18ef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:13.236069 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401ff8d-1eff-40bd-8399-9e3910e18ef6 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:13.258016 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-7cae65c5-44ce-44ef-b8c6-2d47d7cf27bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0b5611ea2ca4c278b473b92f7b659f5', 'request_id': 'req-7cae65c5-44ce-44ef-b8c6-2d47d7cf27bf'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:13.279369 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-7cae65c5-44ce-44ef-b8c6-2d47d7cf27bf admin admin] The token cache is being invalidate because project c0b5611ea2ca4c278b473b92f7b659f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 09:59:13.281487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-7cae65c5-44ce-44ef-b8c6-2d47d7cf27bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:13.284901 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-7cae65c5-44ce-44ef-b8c6-2d47d7cf27bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:13.287124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 838/1675] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:59:12 2022] DELETE /identity/v3/projects/c0b5611ea2ca4c278b473b92f7b659f5 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:13.290696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6130090-79c9-49f7-9a13-ef52166ca281 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:13.292234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6130090-79c9-49f7-9a13-ef52166ca281 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:13.295676 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6130090-79c9-49f7-9a13-ef52166ca281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:13.377155 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-c6130090-79c9-49f7-9a13-ef52166ca281 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:13.379391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-c6130090-79c9-49f7-9a13-ef52166ca281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:13.385783 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 838/1676] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:59:13 2022] POST /identity/v3/projects => generated 355 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:13.385783 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401ff8d-1eff-40bd-8399-9e3910e18ef6 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:13.388672 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-b401ff8d-1eff-40bd-8399-9e3910e18ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:13.561937 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 839/1677] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:13.563737 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6130090-79c9-49f7-9a13-ef52166ca281 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:13.565311 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-c6130090-79c9-49f7-9a13-ef52166ca281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:13.571683 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401ff8d-1eff-40bd-8399-9e3910e18ef6 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:13.587903 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09809ee9-a553-42bc-be0a-815a9c2f48d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:13.592122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09809ee9-a553-42bc-be0a-815a9c2f48d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:13.592122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09809ee9-a553-42bc-be0a-815a9c2f48d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:13.592122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09809ee9-a553-42bc-be0a-815a9c2f48d0 admin admin] PATH_INFO: `/v3/users/c50907a785494658a4a5dfb0d0bfd0e6` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:13.592655 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6130090-79c9-49f7-9a13-ef52166ca281 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:13.594063 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09809ee9-a553-42bc-be0a-815a9c2f48d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c50907a785494658a4a5dfb0d0bfd0e6)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:13.596070 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09809ee9-a553-42bc-be0a-815a9c2f48d0 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:13.608445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe30bf3-6daa-45c6-9ee2-7f2951ff8937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:13.609016 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe30bf3-6daa-45c6-9ee2-7f2951ff8937 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:13.609293 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe30bf3-6daa-45c6-9ee2-7f2951ff8937 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:13.609560 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe30bf3-6daa-45c6-9ee2-7f2951ff8937 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:13.610225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe30bf3-6daa-45c6-9ee2-7f2951ff8937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:13.617379 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe30bf3-6daa-45c6-9ee2-7f2951ff8937 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:13.856023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 840/1678] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:13 2022] POST /identity/v3/users => generated 284 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:13.859068 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71142b1-f070-423d-9657-182508b0183b None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:13.859417 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71142b1-f070-423d-9657-182508b0183b None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:13.859695 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71142b1-f070-423d-9657-182508b0183b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:13.934037 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-f71142b1-f070-423d-9657-182508b0183b None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:13.937842 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-f71142b1-f070-423d-9657-182508b0183b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:13.951677 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 841/1679] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:13.952953 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71142b1-f070-423d-9657-182508b0183b None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:13.968240 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71142b1-f070-423d-9657-182508b0183b None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:13.973689 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87682430-6336-4dc9-8e98-71b01e3bd760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:13.974984 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87682430-6336-4dc9-8e98-71b01e3bd760 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:13.975270 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87682430-6336-4dc9-8e98-71b01e3bd760 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:13.975542 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87682430-6336-4dc9-8e98-71b01e3bd760 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:13.976346 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87682430-6336-4dc9-8e98-71b01e3bd760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:13.978009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87682430-6336-4dc9-8e98-71b01e3bd760 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:13.989873 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 842/1680] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:13.993442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:13.994980 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87682430-6336-4dc9-8e98-71b01e3bd760 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:14.015580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87682430-6336-4dc9-8e98-71b01e3bd760 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:14.022298 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328aad15-96bd-4b8d-9d70-a3c28e0b0cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:14.022927 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328aad15-96bd-4b8d-9d70-a3c28e0b0cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:14.023329 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328aad15-96bd-4b8d-9d70-a3c28e0b0cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:14.023538 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328aad15-96bd-4b8d-9d70-a3c28e0b0cf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:14.024199 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328aad15-96bd-4b8d-9d70-a3c28e0b0cf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:59:14.025197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328aad15-96bd-4b8d-9d70-a3c28e0b0cf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:14.027394 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328aad15-96bd-4b8d-9d70-a3c28e0b0cf0 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:14.055833 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-09809ee9-a553-42bc-be0a-815a9c2f48d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c50907a785494658a4a5dfb0d0bfd0e6'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:14.075058 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 843/1681] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 09:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:59:14.076983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328aad15-96bd-4b8d-9d70-a3c28e0b0cf0 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:14.089535 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-09809ee9-a553-42bc-be0a-815a9c2f48d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c50907a785494658a4a5dfb0d0bfd0e6'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:14.091680 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-09809ee9-a553-42bc-be0a-815a9c2f48d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c50907a785494658a4a5dfb0d0bfd0e6'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:14.102965 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328aad15-96bd-4b8d-9d70-a3c28e0b0cf0 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:14.109121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-09809ee9-a553-42bc-be0a-815a9c2f48d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c50907a785494658a4a5dfb0d0bfd0e6'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:14.115055 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4761f-c7ff-46d1-a1a9-c9799142cfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:14.118001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4761f-c7ff-46d1-a1a9-c9799142cfc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:14.118333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4761f-c7ff-46d1-a1a9-c9799142cfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:14.119578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4761f-c7ff-46d1-a1a9-c9799142cfc1 admin admin] PATH_INFO: `/v3/projects/ca42c2cd095d4fcebc109a4fd22d548d/users/4c6d58c795d34323be47411fb611cd1d/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:14.144399 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4761f-c7ff-46d1-a1a9-c9799142cfc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca42c2cd095d4fcebc109a4fd22d548d, user_id=4c6d58c795d34323be47411fb611cd1d, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:14.150590 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4761f-c7ff-46d1-a1a9-c9799142cfc1 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:14.184263 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-09809ee9-a553-42bc-be0a-815a9c2f48d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c50907a785494658a4a5dfb0d0bfd0e6'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:14.191406 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 839/1682] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:59:13 2022] DELETE /identity/v3/users/c50907a785494658a4a5dfb0d0bfd0e6 => generated 0 bytes in 807 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:14.192571 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09809ee9-a553-42bc-be0a-815a9c2f48d0 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:14.198903 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-09809ee9-a553-42bc-be0a-815a9c2f48d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:14.212490 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 844/1683] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:14 2022] PUT /identity/v3/projects/ca42c2cd095d4fcebc109a4fd22d548d/users/4c6d58c795d34323be47411fb611cd1d/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:14.216907 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4761f-c7ff-46d1-a1a9-c9799142cfc1 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:14.221384 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-9db4761f-c7ff-46d1-a1a9-c9799142cfc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:14.380054 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09809ee9-a553-42bc-be0a-815a9c2f48d0 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:14.514891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4761f-c7ff-46d1-a1a9-c9799142cfc1 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:14.528879 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188b878-c241-4a1e-91fb-2590f095f8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:14.529504 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188b878-c241-4a1e-91fb-2590f095f8bb admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:14.530048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188b878-c241-4a1e-91fb-2590f095f8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:14.530349 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188b878-c241-4a1e-91fb-2590f095f8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:14.531142 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188b878-c241-4a1e-91fb-2590f095f8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:14.534905 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188b878-c241-4a1e-91fb-2590f095f8bb admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:14.550644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235c17e-af68-4b98-8fbf-53cdf098c514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:14.550644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235c17e-af68-4b98-8fbf-53cdf098c514 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:14.550644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235c17e-af68-4b98-8fbf-53cdf098c514 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:14.550644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235c17e-af68-4b98-8fbf-53cdf098c514 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:14.551056 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235c17e-af68-4b98-8fbf-53cdf098c514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:14.553226 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235c17e-af68-4b98-8fbf-53cdf098c514 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:14.559015 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 845/1684] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 09:59:14.562822 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1d19e-bcb2-4144-83bb-73ee08f656b5 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:14.563107 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1d19e-bcb2-4144-83bb-73ee08f656b5 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:14.581552 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1d19e-bcb2-4144-83bb-73ee08f656b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:14.599006 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:14.672207 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-2ac1d19e-bcb2-4144-83bb-73ee08f656b5 None None] MFA Rules not processed for user `20bf487c5b8e490da15060ea798a83ca`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:14.673609 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-2ac1d19e-bcb2-4144-83bb-73ee08f656b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:14.705388 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 840/1685] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:59:14 2022] POST /identity/v3/projects => generated 375 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:14.706956 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235c17e-af68-4b98-8fbf-53cdf098c514 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:14.846889 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235c17e-af68-4b98-8fbf-53cdf098c514 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:14.873659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a8795-b28f-4db0-b547-d1ae67b1c2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:14.884364 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a8795-b28f-4db0-b547-d1ae67b1c2a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:14.885221 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a8795-b28f-4db0-b547-d1ae67b1c2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:14.887693 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a8795-b28f-4db0-b547-d1ae67b1c2a3 admin admin] PATH_INFO: `/v3/projects/ca42c2cd095d4fcebc109a4fd22d548d/users/4c6d58c795d34323be47411fb611cd1d/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:14.890388 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a8795-b28f-4db0-b547-d1ae67b1c2a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca42c2cd095d4fcebc109a4fd22d548d, user_id=4c6d58c795d34323be47411fb611cd1d, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:14.893310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a8795-b28f-4db0-b547-d1ae67b1c2a3 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:14.900509 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 846/1686] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:14.901451 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1d19e-bcb2-4144-83bb-73ee08f656b5 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:14.909414 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 841/1687] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:14 2022] PUT /identity/v3/projects/ca42c2cd095d4fcebc109a4fd22d548d/users/4c6d58c795d34323be47411fb611cd1d/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:14.923477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d626f4-3820-44b9-827f-a65224317f9b None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:14.925514 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d626f4-3820-44b9-827f-a65224317f9b None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:14.930375 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d626f4-3820-44b9-827f-a65224317f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:14.933040 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1d19e-bcb2-4144-83bb-73ee08f656b5 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:14.986392 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-14d626f4-3820-44b9-827f-a65224317f9b None None] MFA Rules not processed for user `4c6d58c795d34323be47411fb611cd1d`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:14.989352 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-14d626f4-3820-44b9-827f-a65224317f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:15.095940 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a559e-ab3e-4192-a2bb-2ddc62c73446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:15.096153 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a559e-ab3e-4192-a2bb-2ddc62c73446 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:15.106803 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a559e-ab3e-4192-a2bb-2ddc62c73446 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:15.106803 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a559e-ab3e-4192-a2bb-2ddc62c73446 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:15.106803 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a559e-ab3e-4192-a2bb-2ddc62c73446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:15.106803 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a559e-ab3e-4192-a2bb-2ddc62c73446 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:15.154847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 842/1688] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:15.157408 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d626f4-3820-44b9-827f-a65224317f9b None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:15.184980 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-14d626f4-3820-44b9-827f-a65224317f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:15.258274 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 847/1689] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:14 2022] POST /identity/v3/users => generated 288 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:15.259123 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a559e-ab3e-4192-a2bb-2ddc62c73446 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:15.267324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-479a559e-ab3e-4192-a2bb-2ddc62c73446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:15.469351 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d626f4-3820-44b9-827f-a65224317f9b None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:15.476971 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344d3a5-e0dc-4be0-b25f-78920172bd5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:15.477638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344d3a5-e0dc-4be0-b25f-78920172bd5e service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:15.477894 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344d3a5-e0dc-4be0-b25f-78920172bd5e service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:15.478194 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344d3a5-e0dc-4be0-b25f-78920172bd5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:15.507498 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a559e-ab3e-4192-a2bb-2ddc62c73446 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:15.527547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97025702-5764-4a57-a441-c75e3aebc198 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:15.528410 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97025702-5764-4a57-a441-c75e3aebc198 service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:15.529532 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97025702-5764-4a57-a441-c75e3aebc198 service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:15.529926 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97025702-5764-4a57-a441-c75e3aebc198 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:15.573975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97025702-5764-4a57-a441-c75e3aebc198 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:15.575617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97025702-5764-4a57-a441-c75e3aebc198 service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:15.617765 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 848/1690] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:15 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:15.620084 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97025702-5764-4a57-a441-c75e3aebc198 service cinder] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:15.644130 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97025702-5764-4a57-a441-c75e3aebc198 service cinder] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:15.667339 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013e953-954a-4e37-9ba8-c798a79f1d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:15.674193 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013e953-954a-4e37-9ba8-c798a79f1d01 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:15.676328 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013e953-954a-4e37-9ba8-c798a79f1d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:15.678046 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344d3a5-e0dc-4be0-b25f-78920172bd5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:15.683216 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013e953-954a-4e37-9ba8-c798a79f1d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:15.683216 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013e953-954a-4e37-9ba8-c798a79f1d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:15.683413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344d3a5-e0dc-4be0-b25f-78920172bd5e service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:15.683533 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013e953-954a-4e37-9ba8-c798a79f1d01 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:15.710384 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:15.718621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 849/1691] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:15.722960 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013e953-954a-4e37-9ba8-c798a79f1d01 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:15.731449 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 843/1692] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:15.756712 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013e953-954a-4e37-9ba8-c798a79f1d01 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:15.780363 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb8fc0-98a1-44d9-9c5e-8ad57a6240a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:15.781272 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb8fc0-98a1-44d9-9c5e-8ad57a6240a1 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:15.786486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb8fc0-98a1-44d9-9c5e-8ad57a6240a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:15.786486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb8fc0-98a1-44d9-9c5e-8ad57a6240a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:15.786486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb8fc0-98a1-44d9-9c5e-8ad57a6240a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:15.786486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb8fc0-98a1-44d9-9c5e-8ad57a6240a1 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:15.817595 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 850/1693] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:15.820997 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344d3a5-e0dc-4be0-b25f-78920172bd5e service nova] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:15.851470 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344d3a5-e0dc-4be0-b25f-78920172bd5e service nova] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:15.879948 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021305b-c40f-4374-b15b-b29fe15abcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:15.881065 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021305b-c40f-4374-b15b-b29fe15abcf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:15.881327 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021305b-c40f-4374-b15b-b29fe15abcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:15.881602 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021305b-c40f-4374-b15b-b29fe15abcf7 admin admin] PATH_INFO: `/v3/projects/46ca9bf784d544a299896a3df196c504/users/766f4726a1324e13ba4736fba9f519d2/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:15.933669 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021305b-c40f-4374-b15b-b29fe15abcf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ca9bf784d544a299896a3df196c504, user_id=766f4726a1324e13ba4736fba9f519d2, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:15.940323 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021305b-c40f-4374-b15b-b29fe15abcf7 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:15.941408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb8fc0-98a1-44d9-9c5e-8ad57a6240a1 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:15.956641 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb8fc0-98a1-44d9-9c5e-8ad57a6240a1 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:15.971022 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90369bd-57fd-4c50-a29e-804f5e9f58fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:15.983273 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90369bd-57fd-4c50-a29e-804f5e9f58fd service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:15.983930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90369bd-57fd-4c50-a29e-804f5e9f58fd service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:15.984431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90369bd-57fd-4c50-a29e-804f5e9f58fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:15.996838 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-b90369bd-57fd-4c50-a29e-804f5e9f58fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:16.056994 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 844/1694] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:15 2022] PUT /identity/v3/projects/46ca9bf784d544a299896a3df196c504/users/766f4726a1324e13ba4736fba9f519d2/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:16.067273 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74422c77-b2d7-402d-a30a-09cef194e115 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:16.067559 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74422c77-b2d7-402d-a30a-09cef194e115 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:16.067833 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74422c77-b2d7-402d-a30a-09cef194e115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:16.121755 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-74422c77-b2d7-402d-a30a-09cef194e115 None None] MFA Rules not processed for user `766f4726a1324e13ba4736fba9f519d2`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:16.132490 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-74422c77-b2d7-402d-a30a-09cef194e115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:16.180095 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90369bd-57fd-4c50-a29e-804f5e9f58fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:16.182001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90369bd-57fd-4c50-a29e-804f5e9f58fd service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:16.217901 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 851/1695] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 09:59:16.265923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 845/1696] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:16.279803 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90369bd-57fd-4c50-a29e-804f5e9f58fd service cinder] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:16.297453 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90369bd-57fd-4c50-a29e-804f5e9f58fd service cinder] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:16.329796 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74422c77-b2d7-402d-a30a-09cef194e115 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:16.331286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-74422c77-b2d7-402d-a30a-09cef194e115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:16.446024 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74422c77-b2d7-402d-a30a-09cef194e115 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:16.452876 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f95e5-1a52-48f3-80b4-0614c82e4dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:16.453985 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f95e5-1a52-48f3-80b4-0614c82e4dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:16.454592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f95e5-1a52-48f3-80b4-0614c82e4dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:16.455083 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f95e5-1a52-48f3-80b4-0614c82e4dcc admin admin] PATH_INFO: `/v3/projects/b666e2552cfe4df2973c64135002fa02` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:16.456573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f95e5-1a52-48f3-80b4-0614c82e4dcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b666e2552cfe4df2973c64135002fa02)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:16.459127 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f95e5-1a52-48f3-80b4-0614c82e4dcc admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:16.473564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5cba9-ad7c-4d62-9895-a20d542e5515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:16.476505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5cba9-ad7c-4d62-9895-a20d542e5515 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:16.478914 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5cba9-ad7c-4d62-9895-a20d542e5515 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:16.479256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5cba9-ad7c-4d62-9895-a20d542e5515 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:16.479925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5cba9-ad7c-4d62-9895-a20d542e5515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:16.487774 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5cba9-ad7c-4d62-9895-a20d542e5515 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:16.681684 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:16.683303 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 852/1697] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:59:16 2022] POST /identity/v3/projects => generated 377 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:16.684350 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5cba9-ad7c-4d62-9895-a20d542e5515 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:16.743084 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-2d5f95e5-1a52-48f3-80b4-0614c82e4dcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b666e2552cfe4df2973c64135002fa02', 'request_id': 'req-2d5f95e5-1a52-48f3-80b4-0614c82e4dcc'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:16.761395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-2d5f95e5-1a52-48f3-80b4-0614c82e4dcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b666e2552cfe4df2973c64135002fa02', 'request_id': 'req-2d5f95e5-1a52-48f3-80b4-0614c82e4dcc'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:16.818754 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-2d5f95e5-1a52-48f3-80b4-0614c82e4dcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b666e2552cfe4df2973c64135002fa02', 'request_id': 'req-2d5f95e5-1a52-48f3-80b4-0614c82e4dcc'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:16.933160 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-2d5f95e5-1a52-48f3-80b4-0614c82e4dcc admin admin] The token cache is being invalidate because project b666e2552cfe4df2973c64135002fa02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 09:59:16.933525 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-2d5f95e5-1a52-48f3-80b4-0614c82e4dcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:16.934536 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-2d5f95e5-1a52-48f3-80b4-0614c82e4dcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:16.945500 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5cba9-ad7c-4d62-9895-a20d542e5515 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:16.947696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 846/1698] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:59:16 2022] DELETE /identity/v3/projects/b666e2552cfe4df2973c64135002fa02 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:16.948368 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3abf81-fdf2-430a-85d2-cd2d7a397d92 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:16.948654 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3abf81-fdf2-430a-85d2-cd2d7a397d92 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:16.948925 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3abf81-fdf2-430a-85d2-cd2d7a397d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:17.011051 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-2d3abf81-fdf2-430a-85d2-cd2d7a397d92 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:17.011051 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-2d3abf81-fdf2-430a-85d2-cd2d7a397d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:17.022866 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199271f1-6514-4dd4-aa05-70f08ff7ffff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:17.027342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199271f1-6514-4dd4-aa05-70f08ff7ffff admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:17.029658 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199271f1-6514-4dd4-aa05-70f08ff7ffff admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:17.031410 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 847/1699] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:17.040199 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199271f1-6514-4dd4-aa05-70f08ff7ffff admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:17.041917 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9b5a6-e39c-4f46-b201-5143530dd3fd None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:17.043764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9b5a6-e39c-4f46-b201-5143530dd3fd None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:17.043764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9b5a6-e39c-4f46-b201-5143530dd3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:17.048803 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199271f1-6514-4dd4-aa05-70f08ff7ffff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:17.056321 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199271f1-6514-4dd4-aa05-70f08ff7ffff admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:17.135761 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-7dc9b5a6-e39c-4f46-b201-5143530dd3fd None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:17.139721 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-7dc9b5a6-e39c-4f46-b201-5143530dd3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:17.184050 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 848/1700] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:17.195163 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9b5a6-e39c-4f46-b201-5143530dd3fd None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:17.210649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 853/1701] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:16 2022] POST /identity/v3/users => generated 295 bytes in 526 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:17.214863 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9b5a6-e39c-4f46-b201-5143530dd3fd None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:17.226874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199271f1-6514-4dd4-aa05-70f08ff7ffff admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:17.229441 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd69b4-01eb-44a8-81a0-3ca7cc0a624d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:17.229892 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-199271f1-6514-4dd4-aa05-70f08ff7ffff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:17.230920 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd69b4-01eb-44a8-81a0-3ca7cc0a624d admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:17.231638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd69b4-01eb-44a8-81a0-3ca7cc0a624d admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:17.232207 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd69b4-01eb-44a8-81a0-3ca7cc0a624d admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:17.233206 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd69b4-01eb-44a8-81a0-3ca7cc0a624d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:59:17.233814 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd69b4-01eb-44a8-81a0-3ca7cc0a624d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:17.235822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd69b4-01eb-44a8-81a0-3ca7cc0a624d admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:17.252597 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 849/1702] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 09:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:59:17.255016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11826349-2ce3-4fde-bc77-aa8ad891673c None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:17.256609 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11826349-2ce3-4fde-bc77-aa8ad891673c None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:17.257077 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11826349-2ce3-4fde-bc77-aa8ad891673c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:17.294374 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199271f1-6514-4dd4-aa05-70f08ff7ffff admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:17.321067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd37c8b-4153-4bfa-b598-036c266c144f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:17.322552 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd37c8b-4153-4bfa-b598-036c266c144f admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:17.324299 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd37c8b-4153-4bfa-b598-036c266c144f admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:17.324609 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd37c8b-4153-4bfa-b598-036c266c144f admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:17.330290 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd37c8b-4153-4bfa-b598-036c266c144f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:17.336084 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd37c8b-4153-4bfa-b598-036c266c144f admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:17.375451 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-11826349-2ce3-4fde-bc77-aa8ad891673c None None] MFA Rules not processed for user `d6ea1e39eb2b47b5b29d63ed8a2d7990`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:17.377651 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-11826349-2ce3-4fde-bc77-aa8ad891673c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:17.402767 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 854/1703] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:17.403891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd37c8b-4153-4bfa-b598-036c266c144f admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:17.421612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:17.440312 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd37c8b-4153-4bfa-b598-036c266c144f admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:17.467952 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852797a-4d31-42d7-9adf-9b28feccee1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:17.468623 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852797a-4d31-42d7-9adf-9b28feccee1e admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:17.468856 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852797a-4d31-42d7-9adf-9b28feccee1e admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:17.469122 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852797a-4d31-42d7-9adf-9b28feccee1e admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:17.472362 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852797a-4d31-42d7-9adf-9b28feccee1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:17.478553 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852797a-4d31-42d7-9adf-9b28feccee1e admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:17.491902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:17.598923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 850/1704] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:17.599618 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11826349-2ce3-4fde-bc77-aa8ad891673c None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:17.629827 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11826349-2ce3-4fde-bc77-aa8ad891673c None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:17.646910 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b074a-8832-4412-b84f-0ac0b3b9f1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:17.648599 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b074a-8832-4412-b84f-0ac0b3b9f1af admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:17.650144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b074a-8832-4412-b84f-0ac0b3b9f1af admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:17.651597 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b074a-8832-4412-b84f-0ac0b3b9f1af admin admin] PATH_INFO: `/v3/projects/7797709d35734120ac56373fff16786a/users/33cf7288edd2469bbad2adf2cd2398f1/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:17.663204 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 855/1705] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:59:17 2022] POST /identity/v3/projects => generated 385 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:17.665151 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab5ab4-f4e2-4f3b-b129-3ac0493b1fa3 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:17.665619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab5ab4-f4e2-4f3b-b129-3ac0493b1fa3 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:17.666471 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab5ab4-f4e2-4f3b-b129-3ac0493b1fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:17.723011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-86ab5ab4-f4e2-4f3b-b129-3ac0493b1fa3 None None] MFA Rules not processed for user `d6ea1e39eb2b47b5b29d63ed8a2d7990`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:17.724357 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b074a-8832-4412-b84f-0ac0b3b9f1af admin admin] RBAC: Authorizing `identity:create_grant(project_id=7797709d35734120ac56373fff16786a, user_id=33cf7288edd2469bbad2adf2cd2398f1, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:17.729058 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-86ab5ab4-f4e2-4f3b-b129-3ac0493b1fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:17.730011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b074a-8832-4412-b84f-0ac0b3b9f1af admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:17.843997 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 851/1706] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:17 2022] PUT /identity/v3/projects/7797709d35734120ac56373fff16786a/users/33cf7288edd2469bbad2adf2cd2398f1/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:17.846972 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b074a-8832-4412-b84f-0ac0b3b9f1af admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:17.900111 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 856/1707] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:17.904765 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b72465-1ffa-46a4-8dd3-1d9e7320e72d None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:17.905388 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b72465-1ffa-46a4-8dd3-1d9e7320e72d None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:17.905878 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b72465-1ffa-46a4-8dd3-1d9e7320e72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:17.990618 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-19b72465-1ffa-46a4-8dd3-1d9e7320e72d None None] MFA Rules not processed for user `06ed3b08376e460087fafc4fccfdd2a9`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:17.993207 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-19b72465-1ffa-46a4-8dd3-1d9e7320e72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:18.010209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b074a-8832-4412-b84f-0ac0b3b9f1af admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:18.030027 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751ef0e-9234-4d73-8c5e-6ed2aa11680a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:18.030560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751ef0e-9234-4d73-8c5e-6ed2aa11680a admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:18.031365 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751ef0e-9234-4d73-8c5e-6ed2aa11680a admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:18.031365 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751ef0e-9234-4d73-8c5e-6ed2aa11680a admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:18.031736 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751ef0e-9234-4d73-8c5e-6ed2aa11680a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:18.033835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751ef0e-9234-4d73-8c5e-6ed2aa11680a admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:18.146230 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 852/1708] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:17 2022] POST /identity/v3/users => generated 293 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:18.146230 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751ef0e-9234-4d73-8c5e-6ed2aa11680a admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:18.146820 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 857/1709] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:18.148766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b72465-1ffa-46a4-8dd3-1d9e7320e72d None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:18.151345 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-19b72465-1ffa-46a4-8dd3-1d9e7320e72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:18.190289 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751ef0e-9234-4d73-8c5e-6ed2aa11680a admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:18.206845 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0b4f0-edbe-4b3b-b6c8-25a919911dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:18.207711 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0b4f0-edbe-4b3b-b6c8-25a919911dbd admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:18.208144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0b4f0-edbe-4b3b-b6c8-25a919911dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:18.209284 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0b4f0-edbe-4b3b-b6c8-25a919911dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:18.214731 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0b4f0-edbe-4b3b-b6c8-25a919911dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:18.216049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0b4f0-edbe-4b3b-b6c8-25a919911dbd admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:18.247287 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:18.257617 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 853/1710] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:18.260983 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0b4f0-edbe-4b3b-b6c8-25a919911dbd admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:18.289260 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b72465-1ffa-46a4-8dd3-1d9e7320e72d None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:18.300761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8c03d-03c5-4321-ba64-2cd436300bcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:18.302129 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8c03d-03c5-4321-ba64-2cd436300bcb service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:18.302289 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0b4f0-edbe-4b3b-b6c8-25a919911dbd admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:18.303009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8c03d-03c5-4321-ba64-2cd436300bcb service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:18.303280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8c03d-03c5-4321-ba64-2cd436300bcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:18.321857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b94fd-86a7-48eb-b03f-867ee39a7f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:18.322519 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b94fd-86a7-48eb-b03f-867ee39a7f48 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:18.322796 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b94fd-86a7-48eb-b03f-867ee39a7f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:18.328256 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b94fd-86a7-48eb-b03f-867ee39a7f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:18.330533 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b94fd-86a7-48eb-b03f-867ee39a7f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:18.339062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b94fd-86a7-48eb-b03f-867ee39a7f48 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:18.383420 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 854/1711] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:18.387269 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b94fd-86a7-48eb-b03f-867ee39a7f48 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:18.393512 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-088b94fd-86a7-48eb-b03f-867ee39a7f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:18.430362 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b94fd-86a7-48eb-b03f-867ee39a7f48 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:18.447351 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f43cc-28a8-4a54-9b2e-d9c4d893cd85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:18.448257 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f43cc-28a8-4a54-9b2e-d9c4d893cd85 service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:18.448658 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f43cc-28a8-4a54-9b2e-d9c4d893cd85 service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:18.449024 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f43cc-28a8-4a54-9b2e-d9c4d893cd85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:18.465823 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f43cc-28a8-4a54-9b2e-d9c4d893cd85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:18.467670 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f43cc-28a8-4a54-9b2e-d9c4d893cd85 service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:18.492392 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 855/1712] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:18.493553 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f43cc-28a8-4a54-9b2e-d9c4d893cd85 service nova] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:18.542502 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8c03d-03c5-4321-ba64-2cd436300bcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:18.544383 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8c03d-03c5-4321-ba64-2cd436300bcb service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:18.546591 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:18.551603 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f43cc-28a8-4a54-9b2e-d9c4d893cd85 service nova] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:18.565278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f216988-ae0b-4dc7-899e-8f921f41e3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:18.566969 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f216988-ae0b-4dc7-899e-8f921f41e3f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:18.566969 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f216988-ae0b-4dc7-899e-8f921f41e3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:18.567341 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f216988-ae0b-4dc7-899e-8f921f41e3f9 admin admin] PATH_INFO: `/v3/projects/7797709d35734120ac56373fff16786a/users/33cf7288edd2469bbad2adf2cd2398f1/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:18.573271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f216988-ae0b-4dc7-899e-8f921f41e3f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7797709d35734120ac56373fff16786a, user_id=33cf7288edd2469bbad2adf2cd2398f1, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:18.576512 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f216988-ae0b-4dc7-899e-8f921f41e3f9 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:18.601903 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 858/1713] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:18 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:18.602417 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8c03d-03c5-4321-ba64-2cd436300bcb service nova] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:18.614388 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 856/1714] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:18 2022] PUT /identity/v3/projects/7797709d35734120ac56373fff16786a/users/33cf7288edd2469bbad2adf2cd2398f1/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:18.625459 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68551fb-84b9-4e2f-b4cb-06a552e38334 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:18.625648 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68551fb-84b9-4e2f-b4cb-06a552e38334 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:18.625931 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68551fb-84b9-4e2f-b4cb-06a552e38334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:18.659714 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8c03d-03c5-4321-ba64-2cd436300bcb service nova] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:18.804895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-a68551fb-84b9-4e2f-b4cb-06a552e38334 None None] MFA Rules not processed for user `33cf7288edd2469bbad2adf2cd2398f1`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:18.805359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-a68551fb-84b9-4e2f-b4cb-06a552e38334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:18.936572 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3eee1-43fc-4971-b8aa-539a871733a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:18.938130 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3eee1-43fc-4971-b8aa-539a871733a2 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:18.938515 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3eee1-43fc-4971-b8aa-539a871733a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:18.939689 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3eee1-43fc-4971-b8aa-539a871733a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:18.940576 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a3eee1-43fc-4971-b8aa-539a871733a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:18.948444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a3eee1-43fc-4971-b8aa-539a871733a2 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:18.964102 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 859/1715] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:18.965985 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf058939-75f5-4e27-8442-7b913be153ee None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:18.966480 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf058939-75f5-4e27-8442-7b913be153ee None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:18.967202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf058939-75f5-4e27-8442-7b913be153ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:19.018510 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-bf058939-75f5-4e27-8442-7b913be153ee None None] MFA Rules not processed for user `55c67b8ae8fb42f5b45e58d38e985507`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:19.019954 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-bf058939-75f5-4e27-8442-7b913be153ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:19.065960 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 857/1716] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:19.071878 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68551fb-84b9-4e2f-b4cb-06a552e38334 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:19.094634 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68551fb-84b9-4e2f-b4cb-06a552e38334 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:19.100528 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a8e6c-6b86-4ae1-84f4-a7e6718c4132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:19.101269 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a8e6c-6b86-4ae1-84f4-a7e6718c4132 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:19.101757 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a8e6c-6b86-4ae1-84f4-a7e6718c4132 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:19.102297 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a8e6c-6b86-4ae1-84f4-a7e6718c4132 admin admin] PATH_INFO: `/v3/projects/cd5e099f3a6541a294a1f4b0af4b4dc0/users/0c30fe25a2be4c62854160df1066be6b/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:19.121969 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a8e6c-6b86-4ae1-84f4-a7e6718c4132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd5e099f3a6541a294a1f4b0af4b4dc0, user_id=0c30fe25a2be4c62854160df1066be6b, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:19.137695 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a8e6c-6b86-4ae1-84f4-a7e6718c4132 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:19.180808 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 860/1717] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:19.180808 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf058939-75f5-4e27-8442-7b913be153ee None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:19.180808 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-bf058939-75f5-4e27-8442-7b913be153ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:19.229717 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:19.236262 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 858/1718] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:19 2022] PUT /identity/v3/projects/cd5e099f3a6541a294a1f4b0af4b4dc0/users/0c30fe25a2be4c62854160df1066be6b/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:19.244369 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8e333-33cd-4dc6-8c85-a4fb14f3b18c None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:19.244961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8e333-33cd-4dc6-8c85-a4fb14f3b18c None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:19.245551 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8e333-33cd-4dc6-8c85-a4fb14f3b18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:19.275776 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf058939-75f5-4e27-8442-7b913be153ee None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:19.334246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-39d8e333-33cd-4dc6-8c85-a4fb14f3b18c None None] MFA Rules not processed for user `55c67b8ae8fb42f5b45e58d38e985507`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:19.338173 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-39d8e333-33cd-4dc6-8c85-a4fb14f3b18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:19.376389 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfeba2d-fe54-420e-8ecb-2e59dca2556c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:19.377056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfeba2d-fe54-420e-8ecb-2e59dca2556c service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:19.377330 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfeba2d-fe54-420e-8ecb-2e59dca2556c service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:19.377595 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfeba2d-fe54-420e-8ecb-2e59dca2556c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:19.385115 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-cbfeba2d-fe54-420e-8ecb-2e59dca2556c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:19.539416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 859/1719] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:19.548419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b279a-45b8-4412-8aba-29e4be1cd7e1 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:19.548699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b279a-45b8-4412-8aba-29e4be1cd7e1 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:19.550794 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b279a-45b8-4412-8aba-29e4be1cd7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:19.577722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfeba2d-fe54-420e-8ecb-2e59dca2556c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:19.579879 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfeba2d-fe54-420e-8ecb-2e59dca2556c service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:19.622331 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 861/1720] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:19.623310 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfeba2d-fe54-420e-8ecb-2e59dca2556c service cinder] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:19.662660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-ca0b279a-45b8-4412-8aba-29e4be1cd7e1 None None] MFA Rules not processed for user `0c30fe25a2be4c62854160df1066be6b`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:19.664137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-ca0b279a-45b8-4412-8aba-29e4be1cd7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:19.727499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:19.732936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfeba2d-fe54-420e-8ecb-2e59dca2556c service cinder] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:19.740345 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d2df3-5b45-4184-b47e-1cf46095d9a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:19.741049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d2df3-5b45-4184-b47e-1cf46095d9a1 service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:19.741424 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d2df3-5b45-4184-b47e-1cf46095d9a1 service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:19.741773 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d2df3-5b45-4184-b47e-1cf46095d9a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:19.770601 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d2df3-5b45-4184-b47e-1cf46095d9a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:19.773497 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d2df3-5b45-4184-b47e-1cf46095d9a1 service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:19.795511 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 862/1721] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:19.796822 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf70c1f-3da9-4b22-8654-ef2c108d8d30 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:19.797114 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf70c1f-3da9-4b22-8654-ef2c108d8d30 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:19.798855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf70c1f-3da9-4b22-8654-ef2c108d8d30 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:19.809621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 863/1722] 10.222.0.13 () {54 vars in 912 bytes} [Thu Aug 11 09:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:59:19.809621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefea2d-991d-40d3-b760-92e8f94435fe None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:19.809621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefea2d-991d-40d3-b760-92e8f94435fe None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:19.809621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefea2d-991d-40d3-b760-92e8f94435fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:19.835204 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:19.879402 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 860/1723] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:19.903410 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b279a-45b8-4412-8aba-29e4be1cd7e1 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:19.938592 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-adefea2d-991d-40d3-b760-92e8f94435fe None None] MFA Rules not processed for user `4ac6ca32b5144c59b2bb5086fbd53ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:19.940413 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-adefea2d-991d-40d3-b760-92e8f94435fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:20.090751 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 864/1724] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Aug 11 09:59:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 09:59:20.138392 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b279a-45b8-4412-8aba-29e4be1cd7e1 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:20.144697 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f53c67-a19f-4018-aed8-9f1072dededc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:20.146627 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f53c67-a19f-4018-aed8-9f1072dededc admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:20.147146 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f53c67-a19f-4018-aed8-9f1072dededc admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:20.147571 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f53c67-a19f-4018-aed8-9f1072dededc admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:20.149021 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f53c67-a19f-4018-aed8-9f1072dededc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:20.151391 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f53c67-a19f-4018-aed8-9f1072dededc admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:20.189096 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefea2d-991d-40d3-b760-92e8f94435fe None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:20.193613 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-adefea2d-991d-40d3-b760-92e8f94435fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:20.216772 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefea2d-991d-40d3-b760-92e8f94435fe None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:20.224097 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fe42d-3be0-4c09-b112-e22740184979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:20.224729 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fe42d-3be0-4c09-b112-e22740184979 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:20.225078 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fe42d-3be0-4c09-b112-e22740184979 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:20.225353 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fe42d-3be0-4c09-b112-e22740184979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:20.233476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fe42d-3be0-4c09-b112-e22740184979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:20.234947 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fe42d-3be0-4c09-b112-e22740184979 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:20.247235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 865/1725] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 09:59:20.310208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 861/1726] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:59:19 2022] POST /identity/v3/projects => generated 383 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:20.314182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fe42d-3be0-4c09-b112-e22740184979 service neutron] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:20.333917 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fe42d-3be0-4c09-b112-e22740184979 service neutron] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:20.513398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e3fc0-22b6-4167-ac41-a7c0f7f91365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:20.513815 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e3fc0-22b6-4167-ac41-a7c0f7f91365 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:20.514138 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e3fc0-22b6-4167-ac41-a7c0f7f91365 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:20.516015 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e3fc0-22b6-4167-ac41-a7c0f7f91365 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:20.516015 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e3fc0-22b6-4167-ac41-a7c0f7f91365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:20.517081 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e3fc0-22b6-4167-ac41-a7c0f7f91365 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:20.607846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767799c-f36e-41e7-931d-59b6e2c621d8 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:20.607846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767799c-f36e-41e7-931d-59b6e2c621d8 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:20.607846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767799c-f36e-41e7-931d-59b6e2c621d8 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:20.608551 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 862/1727] 10.222.0.13 () {54 vars in 912 bytes} [Thu Aug 11 09:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:59:20.633908 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 866/1728] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:20 2022] POST /identity/v3/users => generated 298 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:20.638441 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767799c-f36e-41e7-931d-59b6e2c621d8 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:20.650054 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9140dc7-04b0-42ca-9001-5ecc7c768f7a None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:20.651728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9140dc7-04b0-42ca-9001-5ecc7c768f7a None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:20.652045 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9140dc7-04b0-42ca-9001-5ecc7c768f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:20.673358 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767799c-f36e-41e7-931d-59b6e2c621d8 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:20.691483 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f9219-e333-4674-aeaf-0339d26385ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:20.694270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f9219-e333-4674-aeaf-0339d26385ca admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:20.694492 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f9219-e333-4674-aeaf-0339d26385ca admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:20.694768 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f9219-e333-4674-aeaf-0339d26385ca admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:20.700523 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f9219-e333-4674-aeaf-0339d26385ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:20.704162 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f9219-e333-4674-aeaf-0339d26385ca admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:20.728917 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-d9140dc7-04b0-42ca-9001-5ecc7c768f7a None None] MFA Rules not processed for user `4ac6ca32b5144c59b2bb5086fbd53ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:20.735714 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-d9140dc7-04b0-42ca-9001-5ecc7c768f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:20.749442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 863/1729] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:20.752172 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f9219-e333-4674-aeaf-0339d26385ca admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:20.770742 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f9219-e333-4674-aeaf-0339d26385ca admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:20.785882 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e877a9f-6a99-46df-a707-9c862060040a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:20.785882 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e877a9f-6a99-46df-a707-9c862060040a admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:20.785882 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e877a9f-6a99-46df-a707-9c862060040a admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:20.785882 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e877a9f-6a99-46df-a707-9c862060040a admin admin] PATH_INFO: `/v3/projects/9262ff4f35ee4c99862ba69c8b1cc666/users/083fcc721a064a9bbd308b039bd98423/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:20.797742 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e877a9f-6a99-46df-a707-9c862060040a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9262ff4f35ee4c99862ba69c8b1cc666, user_id=083fcc721a064a9bbd308b039bd98423, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:20.801533 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e877a9f-6a99-46df-a707-9c862060040a admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:20.808246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:20.859395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 867/1730] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Aug 11 09:59:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:20.879576 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9140dc7-04b0-42ca-9001-5ecc7c768f7a None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:20.899803 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9140dc7-04b0-42ca-9001-5ecc7c768f7a None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:20.917905 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 864/1731] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:20 2022] PUT /identity/v3/projects/9262ff4f35ee4c99862ba69c8b1cc666/users/083fcc721a064a9bbd308b039bd98423/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:20.923276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e877a9f-6a99-46df-a707-9c862060040a admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:20.995435 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee90b5e-74e8-40d5-8b41-aa888d6421f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:20.999257 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee90b5e-74e8-40d5-8b41-aa888d6421f7 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:20.999257 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee90b5e-74e8-40d5-8b41-aa888d6421f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:20.999257 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee90b5e-74e8-40d5-8b41-aa888d6421f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:21.016183 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee90b5e-74e8-40d5-8b41-aa888d6421f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:21.018416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee90b5e-74e8-40d5-8b41-aa888d6421f7 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:21.039729 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 868/1732] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 09:59:21.104513 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e877a9f-6a99-46df-a707-9c862060040a admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:21.125271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6188cc2-f176-4aae-a21b-929b44be703f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:21.125955 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6188cc2-f176-4aae-a21b-929b44be703f admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:21.126267 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6188cc2-f176-4aae-a21b-929b44be703f admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:21.126888 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6188cc2-f176-4aae-a21b-929b44be703f admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:21.127691 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6188cc2-f176-4aae-a21b-929b44be703f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:21.129465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6188cc2-f176-4aae-a21b-929b44be703f admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:21.164261 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 865/1733] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:21.168452 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee90b5e-74e8-40d5-8b41-aa888d6421f7 service neutron] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:21.204124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee90b5e-74e8-40d5-8b41-aa888d6421f7 service neutron] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:21.231098 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6149219-f206-411d-9a10-32807585ad21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:21.231098 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6149219-f206-411d-9a10-32807585ad21 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:21.231098 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6149219-f206-411d-9a10-32807585ad21 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:21.231098 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6149219-f206-411d-9a10-32807585ad21 admin admin] PATH_INFO: `/v3/projects/9262ff4f35ee4c99862ba69c8b1cc666/users/083fcc721a064a9bbd308b039bd98423/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:21.233324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6149219-f206-411d-9a10-32807585ad21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9262ff4f35ee4c99862ba69c8b1cc666, user_id=083fcc721a064a9bbd308b039bd98423, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:21.237954 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6149219-f206-411d-9a10-32807585ad21 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:21.304045 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 869/1734] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:21 2022] PUT /identity/v3/projects/9262ff4f35ee4c99862ba69c8b1cc666/users/083fcc721a064a9bbd308b039bd98423/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 09:59:21.315854 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d03e35-59db-4703-bdb6-c96c9bf401a1 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:21.316364 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d03e35-59db-4703-bdb6-c96c9bf401a1 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:21.316805 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d03e35-59db-4703-bdb6-c96c9bf401a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:21.377812 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6b5a3-25dc-4211-bab0-a5cd605ad8cc None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:21.378224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6b5a3-25dc-4211-bab0-a5cd605ad8cc None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:21.378406 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6b5a3-25dc-4211-bab0-a5cd605ad8cc None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:21.379802 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 870/1735] 10.222.0.13 () {54 vars in 961 bytes} [Thu Aug 11 09:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 09:59:21.387316 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd0314-4186-4f0d-89bd-fba20535001a None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:21.387675 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd0314-4186-4f0d-89bd-fba20535001a None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:21.387951 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd0314-4186-4f0d-89bd-fba20535001a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:21.433074 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-26dd0314-4186-4f0d-89bd-fba20535001a None None] MFA Rules not processed for user `0061ce46df224f4491599ed10548b2ae`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:21.436500 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-26dd0314-4186-4f0d-89bd-fba20535001a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:21.454150 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-71d03e35-59db-4703-bdb6-c96c9bf401a1 None None] MFA Rules not processed for user `083fcc721a064a9bbd308b039bd98423`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:21.455655 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-71d03e35-59db-4703-bdb6-c96c9bf401a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:21.598991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 871/1736] 10.222.0.13 () {58 vars in 1058 bytes} [Thu Aug 11 09:59:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 11 09:59:21.608839 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd0314-4186-4f0d-89bd-fba20535001a None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:21.622249 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd0314-4186-4f0d-89bd-fba20535001a None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:21.629820 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5492f0a-803f-4873-acfa-c76e25dbd3fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0061ce46df224f4491599ed10548b2ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:21.630649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5492f0a-803f-4873-acfa-c76e25dbd3fa service placement] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:21.630996 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5492f0a-803f-4873-acfa-c76e25dbd3fa service placement] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:21.631344 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5492f0a-803f-4873-acfa-c76e25dbd3fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:21.635139 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-e5492f0a-803f-4873-acfa-c76e25dbd3fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:21.655833 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 866/1737] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:21.673307 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d03e35-59db-4703-bdb6-c96c9bf401a1 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:21.677194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5492f0a-803f-4873-acfa-c76e25dbd3fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:21.678731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5492f0a-803f-4873-acfa-c76e25dbd3fa service placement] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:21.694873 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 872/1738] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:21.720975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededd891-0720-46d9-9be2-ece213fdda4a None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:21.724874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededd891-0720-46d9-9be2-ece213fdda4a None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:21.724874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededd891-0720-46d9-9be2-ece213fdda4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:21.727810 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:21.753191 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-ededd891-0720-46d9-9be2-ece213fdda4a None None] MFA Rules not processed for user `d6ea1e39eb2b47b5b29d63ed8a2d7990`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:21.753191 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ededd891-0720-46d9-9be2-ece213fdda4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:21.792844 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d03e35-59db-4703-bdb6-c96c9bf401a1 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:21.802993 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04799e-f2e5-40b5-ac8f-ed101df9b581 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:21.804491 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04799e-f2e5-40b5-ac8f-ed101df9b581 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:21.804491 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04799e-f2e5-40b5-ac8f-ed101df9b581 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:21.805198 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04799e-f2e5-40b5-ac8f-ed101df9b581 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:21.829210 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04799e-f2e5-40b5-ac8f-ed101df9b581 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:21.831485 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04799e-f2e5-40b5-ac8f-ed101df9b581 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:21.855946 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 867/1739] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 09:59:21.863686 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 873/1740] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:21.866265 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:21.988631 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04799e-f2e5-40b5-ac8f-ed101df9b581 service cinder] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:22.163632 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04799e-f2e5-40b5-ac8f-ed101df9b581 service cinder] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:22.169542 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc77748-1fac-4c5b-a0a2-dafab23daa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:22.170635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc77748-1fac-4c5b-a0a2-dafab23daa48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:22.170979 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc77748-1fac-4c5b-a0a2-dafab23daa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:22.171250 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc77748-1fac-4c5b-a0a2-dafab23daa48 admin admin] PATH_INFO: `/v3/users/0c30fe25a2be4c62854160df1066be6b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:22.172813 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc77748-1fac-4c5b-a0a2-dafab23daa48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c30fe25a2be4c62854160df1066be6b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:22.175283 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc77748-1fac-4c5b-a0a2-dafab23daa48 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:22.334539 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6daced-70ee-4433-a146-77c039b38900 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:22.335104 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6daced-70ee-4433-a146-77c039b38900 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:22.335104 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6daced-70ee-4433-a146-77c039b38900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:22.367564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-0f6daced-70ee-4433-a146-77c039b38900 None None] MFA Rules not processed for user `20bf487c5b8e490da15060ea798a83ca`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:22.371675 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-0f6daced-70ee-4433-a146-77c039b38900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:22.451030 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7fc77748-1fac-4c5b-a0a2-dafab23daa48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c30fe25a2be4c62854160df1066be6b'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:22.485971 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7fc77748-1fac-4c5b-a0a2-dafab23daa48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c30fe25a2be4c62854160df1066be6b'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:22.496462 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7fc77748-1fac-4c5b-a0a2-dafab23daa48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c30fe25a2be4c62854160df1066be6b'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:22.511834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7fc77748-1fac-4c5b-a0a2-dafab23daa48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c30fe25a2be4c62854160df1066be6b'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:22.525294 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 874/1741] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:22.526190 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6daced-70ee-4433-a146-77c039b38900 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:22.531184 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-0f6daced-70ee-4433-a146-77c039b38900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:22.556532 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6daced-70ee-4433-a146-77c039b38900 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:22.569798 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6a00d-6ad6-4d4e-8204-0787840e4cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:22.570552 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6a00d-6ad6-4d4e-8204-0787840e4cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:22.570935 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6a00d-6ad6-4d4e-8204-0787840e4cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:22.571151 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6a00d-6ad6-4d4e-8204-0787840e4cb7 admin admin] PATH_INFO: `/v3/users/600f52e8e90e4751be4067cfa7d3a827` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:22.573640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6a00d-6ad6-4d4e-8204-0787840e4cb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=600f52e8e90e4751be4067cfa7d3a827)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:22.579168 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6a00d-6ad6-4d4e-8204-0787840e4cb7 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:22.632373 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7fc77748-1fac-4c5b-a0a2-dafab23daa48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c30fe25a2be4c62854160df1066be6b'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:22.683568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 868/1742] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:59:21 2022] DELETE /identity/v3/users/0c30fe25a2be4c62854160df1066be6b => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:22.683568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f969e-79c5-4385-baa3-a3801ae7e421 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:22.683568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f969e-79c5-4385-baa3-a3801ae7e421 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:22.683568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f969e-79c5-4385-baa3-a3801ae7e421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:22.733504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-874f969e-79c5-4385-baa3-a3801ae7e421 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:22.744857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-874f969e-79c5-4385-baa3-a3801ae7e421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:22.930447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 869/1743] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:22.930919 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-cad6a00d-6ad6-4d4e-8204-0787840e4cb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '600f52e8e90e4751be4067cfa7d3a827'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:22.948062 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-cad6a00d-6ad6-4d4e-8204-0787840e4cb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '600f52e8e90e4751be4067cfa7d3a827'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:22.951229 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-cad6a00d-6ad6-4d4e-8204-0787840e4cb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '600f52e8e90e4751be4067cfa7d3a827'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:22.953977 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-cad6a00d-6ad6-4d4e-8204-0787840e4cb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '600f52e8e90e4751be4067cfa7d3a827'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:22.965084 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-cad6a00d-6ad6-4d4e-8204-0787840e4cb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '600f52e8e90e4751be4067cfa7d3a827'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:23.045125 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f969e-79c5-4385-baa3-a3801ae7e421 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:23.047087 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-874f969e-79c5-4385-baa3-a3801ae7e421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:23.056344 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 875/1744] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:59:22 2022] DELETE /identity/v3/users/600f52e8e90e4751be4067cfa7d3a827 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:23.060852 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482152b-ad51-4f51-9fb8-aed02f1d065b None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:23.061398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482152b-ad51-4f51-9fb8-aed02f1d065b None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:23.061858 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482152b-ad51-4f51-9fb8-aed02f1d065b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:23.091093 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-8482152b-ad51-4f51-9fb8-aed02f1d065b None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:23.092865 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-8482152b-ad51-4f51-9fb8-aed02f1d065b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:23.275708 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f969e-79c5-4385-baa3-a3801ae7e421 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:23.328509 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 876/1745] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 09:59:23.358751 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482152b-ad51-4f51-9fb8-aed02f1d065b None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:23.360416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-8482152b-ad51-4f51-9fb8-aed02f1d065b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:23.564687 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ca508-1fe0-4515-977f-6ea53e46a589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:23.565388 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ca508-1fe0-4515-977f-6ea53e46a589 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:23.565617 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ca508-1fe0-4515-977f-6ea53e46a589 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:23.565895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ca508-1fe0-4515-977f-6ea53e46a589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:23.577585 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-b60ca508-1fe0-4515-977f-6ea53e46a589 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:23.583005 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482152b-ad51-4f51-9fb8-aed02f1d065b None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:23.604324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9ab57-310a-4d90-be24-8e31a5f8a4d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:23.604324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9ab57-310a-4d90-be24-8e31a5f8a4d1 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:23.604324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9ab57-310a-4d90-be24-8e31a5f8a4d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:23.604324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9ab57-310a-4d90-be24-8e31a5f8a4d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:23.640688 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ca508-1fe0-4515-977f-6ea53e46a589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:23.642318 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ca508-1fe0-4515-977f-6ea53e46a589 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:23.649967 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9ab57-310a-4d90-be24-8e31a5f8a4d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:23.654157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9ab57-310a-4d90-be24-8e31a5f8a4d1 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:23.677650 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 870/1746] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 09:59:23.695579 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 877/1747] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:24.371554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:24.708808 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744848f-4040-4499-bdc5-9074a0c4ad4c None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:24.709306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744848f-4040-4499-bdc5-9074a0c4ad4c None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:24.709386 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744848f-4040-4499-bdc5-9074a0c4ad4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:24.773213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-a744848f-4040-4499-bdc5-9074a0c4ad4c None None] MFA Rules not processed for user `06ed3b08376e460087fafc4fccfdd2a9`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:24.779149 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-a744848f-4040-4499-bdc5-9074a0c4ad4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:24.954119 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 871/1748] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:25.260793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9ab57-310a-4d90-be24-8e31a5f8a4d1 service neutron] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:25.262522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-dcb9ab57-310a-4d90-be24-8e31a5f8a4d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:25.295729 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:25.300735 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9ab57-310a-4d90-be24-8e31a5f8a4d1 service neutron] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:25.318128 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03142790-873d-4764-ab78-c305969a6975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:25.318775 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03142790-873d-4764-ab78-c305969a6975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:25.319276 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03142790-873d-4764-ab78-c305969a6975 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:25.319735 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03142790-873d-4764-ab78-c305969a6975 admin admin] PATH_INFO: `/v3/projects/efc3ba9309d14fe2ae3ea70cd04ccb27` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:25.324121 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03142790-873d-4764-ab78-c305969a6975 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efc3ba9309d14fe2ae3ea70cd04ccb27)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:25.326535 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03142790-873d-4764-ab78-c305969a6975 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:25.335460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744848f-4040-4499-bdc5-9074a0c4ad4c None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:25.337942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-a744848f-4040-4499-bdc5-9074a0c4ad4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:25.378831 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744848f-4040-4499-bdc5-9074a0c4ad4c None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:25.393468 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89936926-acd1-4bcc-b650-cea4b355437e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:25.393984 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89936926-acd1-4bcc-b650-cea4b355437e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:25.394291 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89936926-acd1-4bcc-b650-cea4b355437e admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:25.412477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89936926-acd1-4bcc-b650-cea4b355437e admin admin] PATH_INFO: `/v3/projects/cd5e099f3a6541a294a1f4b0af4b4dc0` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:25.414976 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89936926-acd1-4bcc-b650-cea4b355437e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd5e099f3a6541a294a1f4b0af4b4dc0)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:25.420111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89936926-acd1-4bcc-b650-cea4b355437e admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:25.620356 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-03142790-873d-4764-ab78-c305969a6975 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efc3ba9309d14fe2ae3ea70cd04ccb27', 'request_id': 'req-03142790-873d-4764-ab78-c305969a6975'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:25.643919 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-03142790-873d-4764-ab78-c305969a6975 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efc3ba9309d14fe2ae3ea70cd04ccb27', 'request_id': 'req-03142790-873d-4764-ab78-c305969a6975'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:25.717041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-89936926-acd1-4bcc-b650-cea4b355437e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd5e099f3a6541a294a1f4b0af4b4dc0', 'request_id': 'req-89936926-acd1-4bcc-b650-cea4b355437e'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:25.731725 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-89936926-acd1-4bcc-b650-cea4b355437e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd5e099f3a6541a294a1f4b0af4b4dc0', 'request_id': 'req-89936926-acd1-4bcc-b650-cea4b355437e'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:25.747222 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-89936926-acd1-4bcc-b650-cea4b355437e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd5e099f3a6541a294a1f4b0af4b4dc0', 'request_id': 'req-89936926-acd1-4bcc-b650-cea4b355437e'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:25.800183 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-03142790-873d-4764-ab78-c305969a6975 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efc3ba9309d14fe2ae3ea70cd04ccb27', 'request_id': 'req-03142790-873d-4764-ab78-c305969a6975'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:25.820936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-03142790-873d-4764-ab78-c305969a6975 admin admin] The token cache is being invalidate because project efc3ba9309d14fe2ae3ea70cd04ccb27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 09:59:25.821220 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-03142790-873d-4764-ab78-c305969a6975 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:25.822427 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-03142790-873d-4764-ab78-c305969a6975 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:25.824215 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 878/1749] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:59:25 2022] DELETE /identity/v3/projects/efc3ba9309d14fe2ae3ea70cd04ccb27 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:25.825291 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03142790-873d-4764-ab78-c305969a6975 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:25.826905 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-03142790-873d-4764-ab78-c305969a6975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:25.935889 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-89936926-acd1-4bcc-b650-cea4b355437e admin admin] The token cache is being invalidate because project cd5e099f3a6541a294a1f4b0af4b4dc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 09:59:25.936430 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-89936926-acd1-4bcc-b650-cea4b355437e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:25.940381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-89936926-acd1-4bcc-b650-cea4b355437e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:25.940936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 872/1750] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:59:25 2022] DELETE /identity/v3/projects/cd5e099f3a6541a294a1f4b0af4b4dc0 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 09:59:25.945857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea83d45-ea60-4546-b0ed-765d3ff5f34a None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:25.947223 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03142790-873d-4764-ab78-c305969a6975 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:25.947693 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea83d45-ea60-4546-b0ed-765d3ff5f34a None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:25.950393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea83d45-ea60-4546-b0ed-765d3ff5f34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:25.997194 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-cea83d45-ea60-4546-b0ed-765d3ff5f34a None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:26.001290 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-cea83d45-ea60-4546-b0ed-765d3ff5f34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:26.009855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2035325-1350-47fd-bf0a-13d39e5c717a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:26.010515 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2035325-1350-47fd-bf0a-13d39e5c717a service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:26.010939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2035325-1350-47fd-bf0a-13d39e5c717a service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:26.011214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2035325-1350-47fd-bf0a-13d39e5c717a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:26.013053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-d2035325-1350-47fd-bf0a-13d39e5c717a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:26.147044 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2035325-1350-47fd-bf0a-13d39e5c717a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:26.148585 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2035325-1350-47fd-bf0a-13d39e5c717a service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:26.161917 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 879/1751] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:26.163036 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2035325-1350-47fd-bf0a-13d39e5c717a service cinder] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:26.164648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-d2035325-1350-47fd-bf0a-13d39e5c717a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:26.222186 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 873/1752] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:26.230960 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ac48f-6c43-4700-8a10-806a873c886a None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:26.233335 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ac48f-6c43-4700-8a10-806a873c886a None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:26.233612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ac48f-6c43-4700-8a10-806a873c886a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:26.274454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2035325-1350-47fd-bf0a-13d39e5c717a service cinder] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:26.297417 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427abf5d-a228-4fa1-bb2c-b5699e0be41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:26.298884 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427abf5d-a228-4fa1-bb2c-b5699e0be41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:26.299169 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427abf5d-a228-4fa1-bb2c-b5699e0be41a admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:26.299447 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427abf5d-a228-4fa1-bb2c-b5699e0be41a admin admin] PATH_INFO: `/v3/users/083fcc721a064a9bbd308b039bd98423` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:26.299658 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-fc0ac48f-6c43-4700-8a10-806a873c886a None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:26.300979 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427abf5d-a228-4fa1-bb2c-b5699e0be41a admin admin] RBAC: Authorizing `identity:delete_user(user_id=083fcc721a064a9bbd308b039bd98423)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:26.301235 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-fc0ac48f-6c43-4700-8a10-806a873c886a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:26.303455 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427abf5d-a228-4fa1-bb2c-b5699e0be41a admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:26.321449 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 874/1753] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:26.326374 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ac48f-6c43-4700-8a10-806a873c886a None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:26.341094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ac48f-6c43-4700-8a10-806a873c886a None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:26.350567 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0e661-2603-4a35-8cf3-8bf4cef59d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:26.351417 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0e661-2603-4a35-8cf3-8bf4cef59d51 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:26.351697 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0e661-2603-4a35-8cf3-8bf4cef59d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:26.352025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0e661-2603-4a35-8cf3-8bf4cef59d51 admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:26.352927 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0e661-2603-4a35-8cf3-8bf4cef59d51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:59:26.353229 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0e661-2603-4a35-8cf3-8bf4cef59d51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:26.354876 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0e661-2603-4a35-8cf3-8bf4cef59d51 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:26.374222 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 875/1754] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 09:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:59:26.377657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0e661-2603-4a35-8cf3-8bf4cef59d51 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:26.391946 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0e661-2603-4a35-8cf3-8bf4cef59d51 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:26.402390 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b10d66-dcc7-4e3c-bedc-e5c108730076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:26.403578 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b10d66-dcc7-4e3c-bedc-e5c108730076 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:26.404105 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b10d66-dcc7-4e3c-bedc-e5c108730076 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:26.404569 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b10d66-dcc7-4e3c-bedc-e5c108730076 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:26.405537 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b10d66-dcc7-4e3c-bedc-e5c108730076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:26.412071 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b10d66-dcc7-4e3c-bedc-e5c108730076 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:26.534118 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 876/1755] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:59:26 2022] POST /identity/v3/projects => generated 369 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:26.534118 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b10d66-dcc7-4e3c-bedc-e5c108730076 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:26.648581 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-427abf5d-a228-4fa1-bb2c-b5699e0be41a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '083fcc721a064a9bbd308b039bd98423'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:26.670220 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-427abf5d-a228-4fa1-bb2c-b5699e0be41a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '083fcc721a064a9bbd308b039bd98423'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:26.671198 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-427abf5d-a228-4fa1-bb2c-b5699e0be41a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '083fcc721a064a9bbd308b039bd98423'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:26.671851 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-427abf5d-a228-4fa1-bb2c-b5699e0be41a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '083fcc721a064a9bbd308b039bd98423'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:26.680836 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-427abf5d-a228-4fa1-bb2c-b5699e0be41a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '083fcc721a064a9bbd308b039bd98423'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:26.688073 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b10d66-dcc7-4e3c-bedc-e5c108730076 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:26.695443 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae5868-670d-498f-b99f-284ec808e2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:26.696278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae5868-670d-498f-b99f-284ec808e2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:26.696920 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae5868-670d-498f-b99f-284ec808e2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:26.697395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae5868-670d-498f-b99f-284ec808e2e8 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:26.698793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae5868-670d-498f-b99f-284ec808e2e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:26.701732 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae5868-670d-498f-b99f-284ec808e2e8 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:26.811354 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 880/1756] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:59:26 2022] DELETE /identity/v3/users/083fcc721a064a9bbd308b039bd98423 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:26.836973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:26.841447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 877/1757] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:26 2022] POST /identity/v3/users => generated 285 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:26.847249 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427abf5d-a228-4fa1-bb2c-b5699e0be41a admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:26.848870 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-427abf5d-a228-4fa1-bb2c-b5699e0be41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:27.023991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427abf5d-a228-4fa1-bb2c-b5699e0be41a admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:27.045672 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afa2b7-aca2-4b17-baa5-c5c5aa9ea501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:27.045672 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afa2b7-aca2-4b17-baa5-c5c5aa9ea501 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:27.045672 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afa2b7-aca2-4b17-baa5-c5c5aa9ea501 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:27.045672 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afa2b7-aca2-4b17-baa5-c5c5aa9ea501 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:27.045947 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afa2b7-aca2-4b17-baa5-c5c5aa9ea501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:27.045947 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afa2b7-aca2-4b17-baa5-c5c5aa9ea501 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:27.057774 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae5868-670d-498f-b99f-284ec808e2e8 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:27.057974 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 881/1758] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:27.068877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae5868-670d-498f-b99f-284ec808e2e8 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:27.074217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f49c6-bb53-4deb-922d-926b0856e8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:27.075119 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f49c6-bb53-4deb-922d-926b0856e8fd admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:27.075781 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f49c6-bb53-4deb-922d-926b0856e8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:27.076258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f49c6-bb53-4deb-922d-926b0856e8fd admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:27.077126 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f49c6-bb53-4deb-922d-926b0856e8fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:27.085594 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f49c6-bb53-4deb-922d-926b0856e8fd admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:27.095603 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 878/1759] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 09:59:27.095808 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afa2b7-aca2-4b17-baa5-c5c5aa9ea501 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:27.123324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afa2b7-aca2-4b17-baa5-c5c5aa9ea501 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:27.137035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31762c1-2f84-428f-b296-11ccbbfc233e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:27.137817 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31762c1-2f84-428f-b296-11ccbbfc233e admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:27.138007 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31762c1-2f84-428f-b296-11ccbbfc233e admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:27.138329 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31762c1-2f84-428f-b296-11ccbbfc233e admin admin] PATH_INFO: `/v3/projects/48a5f47282254982875f94fde68d4c9b/users/655ebaf0cb284ec899aa01f69988e573/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:27.206219 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31762c1-2f84-428f-b296-11ccbbfc233e admin admin] RBAC: Authorizing `identity:create_grant(project_id=48a5f47282254982875f94fde68d4c9b, user_id=655ebaf0cb284ec899aa01f69988e573, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:27.209341 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31762c1-2f84-428f-b296-11ccbbfc233e admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:27.365251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 882/1760] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:27 2022] PUT /identity/v3/projects/48a5f47282254982875f94fde68d4c9b/users/655ebaf0cb284ec899aa01f69988e573/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 09:59:27.378184 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8497d-3d55-4a2a-973e-e407133018a9 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:27.378792 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8497d-3d55-4a2a-973e-e407133018a9 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:27.379728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8497d-3d55-4a2a-973e-e407133018a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:27.428296 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-88c8497d-3d55-4a2a-973e-e407133018a9 None None] MFA Rules not processed for user `655ebaf0cb284ec899aa01f69988e573`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:27.433772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-88c8497d-3d55-4a2a-973e-e407133018a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:27.681611 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 879/1761] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:27.687447 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31762c1-2f84-428f-b296-11ccbbfc233e admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:27.981253 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31762c1-2f84-428f-b296-11ccbbfc233e admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:28.002234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0b3a0-7585-4288-87cd-d469dba763dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:28.002544 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0b3a0-7585-4288-87cd-d469dba763dd admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:28.003042 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0b3a0-7585-4288-87cd-d469dba763dd admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:28.003545 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0b3a0-7585-4288-87cd-d469dba763dd admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:28.005394 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0b3a0-7585-4288-87cd-d469dba763dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:28.022449 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0b3a0-7585-4288-87cd-d469dba763dd admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:28.073795 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8497d-3d55-4a2a-973e-e407133018a9 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:28.084412 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-88c8497d-3d55-4a2a-973e-e407133018a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:28.141644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8497d-3d55-4a2a-973e-e407133018a9 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:28.150446 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991b064-87db-4bd5-80a4-8599e1817750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:28.151150 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991b064-87db-4bd5-80a4-8599e1817750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:28.151433 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991b064-87db-4bd5-80a4-8599e1817750 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:28.151690 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991b064-87db-4bd5-80a4-8599e1817750 admin admin] PATH_INFO: `/v3/projects/9262ff4f35ee4c99862ba69c8b1cc666` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:28.152922 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991b064-87db-4bd5-80a4-8599e1817750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9262ff4f35ee4c99862ba69c8b1cc666)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:28.155077 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991b064-87db-4bd5-80a4-8599e1817750 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:28.221663 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:28.224720 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 883/1762] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:59:27 2022] POST /identity/v3/projects => generated 367 bytes in 536 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:28.228236 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0b3a0-7585-4288-87cd-d469dba763dd admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:28.381725 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-0991b064-87db-4bd5-80a4-8599e1817750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9262ff4f35ee4c99862ba69c8b1cc666', 'request_id': 'req-0991b064-87db-4bd5-80a4-8599e1817750'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:28.422300 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-0991b064-87db-4bd5-80a4-8599e1817750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9262ff4f35ee4c99862ba69c8b1cc666', 'request_id': 'req-0991b064-87db-4bd5-80a4-8599e1817750'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:28.452177 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-0991b064-87db-4bd5-80a4-8599e1817750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9262ff4f35ee4c99862ba69c8b1cc666', 'request_id': 'req-0991b064-87db-4bd5-80a4-8599e1817750'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:28.475140 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0b3a0-7585-4288-87cd-d469dba763dd admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:28.573719 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-0991b064-87db-4bd5-80a4-8599e1817750 admin admin] The token cache is being invalidate because project 9262ff4f35ee4c99862ba69c8b1cc666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 09:59:28.574553 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-0991b064-87db-4bd5-80a4-8599e1817750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:28.575739 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-0991b064-87db-4bd5-80a4-8599e1817750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:28.580251 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 880/1763] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:59:28 2022] DELETE /identity/v3/projects/9262ff4f35ee4c99862ba69c8b1cc666 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:28.582749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc44a21-28e1-4338-8db5-44064bd8d187 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:28.589038 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc44a21-28e1-4338-8db5-44064bd8d187 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:28.589319 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc44a21-28e1-4338-8db5-44064bd8d187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:28.602828 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba0ec9-5958-4b9c-aeb9-7fecb00db10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:28.602828 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba0ec9-5958-4b9c-aeb9-7fecb00db10e admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:28.602828 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba0ec9-5958-4b9c-aeb9-7fecb00db10e admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:28.603110 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba0ec9-5958-4b9c-aeb9-7fecb00db10e admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:28.603681 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba0ec9-5958-4b9c-aeb9-7fecb00db10e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:28.605817 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba0ec9-5958-4b9c-aeb9-7fecb00db10e admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:28.776470 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 884/1764] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:28 2022] POST /identity/v3/users => generated 290 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:28.784897 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3c045-50d7-4128-850c-3965c9978852 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:28.785186 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3c045-50d7-4128-850c-3965c9978852 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:28.785461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3c045-50d7-4128-850c-3965c9978852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:28.801234 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-edc44a21-28e1-4338-8db5-44064bd8d187 None None] MFA Rules not processed for user `d392c30328a3491bb186bd7b55f4d99c`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:28.803084 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-edc44a21-28e1-4338-8db5-44064bd8d187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:28.879096 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-63c3c045-50d7-4128-850c-3965c9978852 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:28.885829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-63c3c045-50d7-4128-850c-3965c9978852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:28.913343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 885/1765] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:28.928864 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3c045-50d7-4128-850c-3965c9978852 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:28.931058 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-63c3c045-50d7-4128-850c-3965c9978852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:28.959456 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3c045-50d7-4128-850c-3965c9978852 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:28.984977 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92d753-a001-4ee4-9c49-a09cacaa8253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:28.984977 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92d753-a001-4ee4-9c49-a09cacaa8253 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:28.984977 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92d753-a001-4ee4-9c49-a09cacaa8253 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:28.984977 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92d753-a001-4ee4-9c49-a09cacaa8253 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:28.985353 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92d753-a001-4ee4-9c49-a09cacaa8253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:28.985353 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92d753-a001-4ee4-9c49-a09cacaa8253 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:28.999897 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 881/1766] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Aug 11 09:59:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:29.001922 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a382e0-fba2-420a-be1f-c60ce4c8335d None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:29.002457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a382e0-fba2-420a-be1f-c60ce4c8335d None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:29.002961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a382e0-fba2-420a-be1f-c60ce4c8335d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:29.026502 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 886/1767] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:29.030533 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92d753-a001-4ee4-9c49-a09cacaa8253 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:29.056504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-11a382e0-fba2-420a-be1f-c60ce4c8335d None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:29.058238 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-11a382e0-fba2-420a-be1f-c60ce4c8335d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:29.060742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92d753-a001-4ee4-9c49-a09cacaa8253 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:29.074776 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831a5b3-152e-4662-b1b9-41cf4bf42f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:29.076897 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831a5b3-152e-4662-b1b9-41cf4bf42f55 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:29.076897 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831a5b3-152e-4662-b1b9-41cf4bf42f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:29.076897 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831a5b3-152e-4662-b1b9-41cf4bf42f55 admin admin] PATH_INFO: `/v3/projects/a157c8f10f0b4fa9b275e6411907fa76/users/2ae4fc2b4d054fe580598e77584a2701/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:29.084461 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 882/1768] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:29.085416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a382e0-fba2-420a-be1f-c60ce4c8335d None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:29.102574 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a382e0-fba2-420a-be1f-c60ce4c8335d None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:29.111001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831a5b3-152e-4662-b1b9-41cf4bf42f55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a157c8f10f0b4fa9b275e6411907fa76, user_id=2ae4fc2b4d054fe580598e77584a2701, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:29.114511 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831a5b3-152e-4662-b1b9-41cf4bf42f55 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:29.132117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5e30e-9ed0-4d38-a223-f3488752b3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:29.132741 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5e30e-9ed0-4d38-a223-f3488752b3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:29.133017 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5e30e-9ed0-4d38-a223-f3488752b3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:29.133284 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5e30e-9ed0-4d38-a223-f3488752b3d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:29.133939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5e30e-9ed0-4d38-a223-f3488752b3d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:59:29.134273 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5e30e-9ed0-4d38-a223-f3488752b3d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:29.172912 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5e30e-9ed0-4d38-a223-f3488752b3d0 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:29.206693 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 883/1769] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 09:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:59:29.223060 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5e30e-9ed0-4d38-a223-f3488752b3d0 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:29.238349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5e30e-9ed0-4d38-a223-f3488752b3d0 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:29.258880 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7672fce-98d6-4cca-9c54-277b4761b938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:29.259521 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7672fce-98d6-4cca-9c54-277b4761b938 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:29.259849 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7672fce-98d6-4cca-9c54-277b4761b938 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:29.260061 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7672fce-98d6-4cca-9c54-277b4761b938 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:29.260712 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7672fce-98d6-4cca-9c54-277b4761b938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:29.262657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7672fce-98d6-4cca-9c54-277b4761b938 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:29.306845 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 887/1770] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:29 2022] PUT /identity/v3/projects/a157c8f10f0b4fa9b275e6411907fa76/users/2ae4fc2b4d054fe580598e77584a2701/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:29.311031 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831a5b3-152e-4662-b1b9-41cf4bf42f55 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:29.456533 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831a5b3-152e-4662-b1b9-41cf4bf42f55 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:29.471438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20dfd90-3433-4704-8cfb-e3510480f96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:29.472172 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dfd90-3433-4704-8cfb-e3510480f96e admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:29.472725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dfd90-3433-4704-8cfb-e3510480f96e admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:29.473001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dfd90-3433-4704-8cfb-e3510480f96e admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:29.473696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20dfd90-3433-4704-8cfb-e3510480f96e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:29.475382 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20dfd90-3433-4704-8cfb-e3510480f96e admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:29.493842 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 888/1771] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:29.495072 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20dfd90-3433-4704-8cfb-e3510480f96e admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:29.499032 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-a20dfd90-3433-4704-8cfb-e3510480f96e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:29.569348 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 884/1772] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:59:29 2022] POST /identity/v3/projects => generated 391 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:29.573940 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7672fce-98d6-4cca-9c54-277b4761b938 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:29.749369 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20dfd90-3433-4704-8cfb-e3510480f96e admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:29.783334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7672fce-98d6-4cca-9c54-277b4761b938 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:29.795034 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ba741-a23f-49fa-930d-c0cbeaf051cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:29.797816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ba741-a23f-49fa-930d-c0cbeaf051cf admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:29.798255 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ba741-a23f-49fa-930d-c0cbeaf051cf admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:29.798632 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ba741-a23f-49fa-930d-c0cbeaf051cf admin admin] PATH_INFO: `/v3/projects/a157c8f10f0b4fa9b275e6411907fa76/users/2ae4fc2b4d054fe580598e77584a2701/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:29.805279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ba741-a23f-49fa-930d-c0cbeaf051cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a157c8f10f0b4fa9b275e6411907fa76, user_id=2ae4fc2b4d054fe580598e77584a2701, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:29.811454 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ba741-a23f-49fa-930d-c0cbeaf051cf admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:29.858588 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 885/1773] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:29 2022] PUT /identity/v3/projects/a157c8f10f0b4fa9b275e6411907fa76/users/2ae4fc2b4d054fe580598e77584a2701/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:29.859824 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ba741-a23f-49fa-930d-c0cbeaf051cf admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:29.869369 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:29.920233 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ff2e3-2911-46c7-98ea-80d7e1466de9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e3b1c5aec94673b391210ae51d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:29.920923 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ff2e3-2911-46c7-98ea-80d7e1466de9 service swift] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:29.921207 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ff2e3-2911-46c7-98ea-80d7e1466de9 service swift] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:29.922525 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ff2e3-2911-46c7-98ea-80d7e1466de9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:29.939340 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:30.043919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ba741-a23f-49fa-930d-c0cbeaf051cf admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:30.058729 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be144d-a75e-47d8-b1c1-2f7917cb02ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:30.059743 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be144d-a75e-47d8-b1c1-2f7917cb02ac admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:30.060908 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be144d-a75e-47d8-b1c1-2f7917cb02ac admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:30.061369 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be144d-a75e-47d8-b1c1-2f7917cb02ac admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:30.062642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be144d-a75e-47d8-b1c1-2f7917cb02ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:30.065183 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be144d-a75e-47d8-b1c1-2f7917cb02ac admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:30.077029 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ff2e3-2911-46c7-98ea-80d7e1466de9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:30.080312 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ff2e3-2911-46c7-98ea-80d7e1466de9 service swift] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:30.104083 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 889/1774] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Aug 11 09:59:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 09:59:30.105686 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a795eb-281a-4c50-97a8-baacd80c4afa None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:30.113491 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a795eb-281a-4c50-97a8-baacd80c4afa None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:30.113491 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a795eb-281a-4c50-97a8-baacd80c4afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:30.176329 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-06a795eb-281a-4c50-97a8-baacd80c4afa None None] MFA Rules not processed for user `2ae4fc2b4d054fe580598e77584a2701`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:30.179004 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-06a795eb-281a-4c50-97a8-baacd80c4afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:30.190789 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 886/1775] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:29 2022] POST /identity/v3/users => generated 296 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:30.191967 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be144d-a75e-47d8-b1c1-2f7917cb02ac admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:30.235339 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be144d-a75e-47d8-b1c1-2f7917cb02ac admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:30.272222 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905c654-f11f-46df-b243-3ed0d446973a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:30.274634 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905c654-f11f-46df-b243-3ed0d446973a admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:30.276371 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905c654-f11f-46df-b243-3ed0d446973a admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:30.278302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905c654-f11f-46df-b243-3ed0d446973a admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:30.279140 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905c654-f11f-46df-b243-3ed0d446973a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:30.284827 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905c654-f11f-46df-b243-3ed0d446973a admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:30.330884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 887/1776] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:30.331925 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905c654-f11f-46df-b243-3ed0d446973a admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:30.373212 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905c654-f11f-46df-b243-3ed0d446973a admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:30.385726 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74448e3b-bb2d-48e3-b846-f389f1b1be27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:30.386416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74448e3b-bb2d-48e3-b846-f389f1b1be27 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:30.387975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74448e3b-bb2d-48e3-b846-f389f1b1be27 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:30.388265 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74448e3b-bb2d-48e3-b846-f389f1b1be27 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:30.390163 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74448e3b-bb2d-48e3-b846-f389f1b1be27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:30.394143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 890/1777] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:30.395204 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74448e3b-bb2d-48e3-b846-f389f1b1be27 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:30.424109 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 888/1778] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:30.428433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a795eb-281a-4c50-97a8-baacd80c4afa None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:30.481919 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a795eb-281a-4c50-97a8-baacd80c4afa None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:30.497508 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135920ed-0e6c-4f9b-b3b7-d36c3cee6480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:30.498610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135920ed-0e6c-4f9b-b3b7-d36c3cee6480 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:30.499045 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135920ed-0e6c-4f9b-b3b7-d36c3cee6480 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:30.499522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135920ed-0e6c-4f9b-b3b7-d36c3cee6480 admin admin] PATH_INFO: `/v3/projects/183f4da309014f9e94667cb2cec37bcb/users/b6f3f180aa4748fb98b2aba1ba845ae5/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:30.531565 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74448e3b-bb2d-48e3-b846-f389f1b1be27 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:30.543013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-74448e3b-bb2d-48e3-b846-f389f1b1be27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:30.543155 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135920ed-0e6c-4f9b-b3b7-d36c3cee6480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=183f4da309014f9e94667cb2cec37bcb, user_id=b6f3f180aa4748fb98b2aba1ba845ae5, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:30.543155 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135920ed-0e6c-4f9b-b3b7-d36c3cee6480 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:30.724313 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74448e3b-bb2d-48e3-b846-f389f1b1be27 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:30.733377 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace60df2-e211-4571-8705-0a68df055106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:30.735211 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace60df2-e211-4571-8705-0a68df055106 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:30.735211 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace60df2-e211-4571-8705-0a68df055106 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:30.735211 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace60df2-e211-4571-8705-0a68df055106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:30.760953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace60df2-e211-4571-8705-0a68df055106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:30.766143 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace60df2-e211-4571-8705-0a68df055106 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:30.795423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 891/1779] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:30 2022] PUT /identity/v3/projects/183f4da309014f9e94667cb2cec37bcb/users/b6f3f180aa4748fb98b2aba1ba845ae5/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:30.813738 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 889/1780] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:30 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 09:59:30.813847 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8574b-0cc3-485b-b5bb-9bf3f327dfd7 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:30.813847 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8574b-0cc3-485b-b5bb-9bf3f327dfd7 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:30.813847 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8574b-0cc3-485b-b5bb-9bf3f327dfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:30.862241 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-92c8574b-0cc3-485b-b5bb-9bf3f327dfd7 None None] MFA Rules not processed for user `b6f3f180aa4748fb98b2aba1ba845ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:30.863754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-92c8574b-0cc3-485b-b5bb-9bf3f327dfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:31.028163 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48445fa-2893-463b-a23c-f6da30ece7d3 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:31.028451 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48445fa-2893-463b-a23c-f6da30ece7d3 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:31.028730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48445fa-2893-463b-a23c-f6da30ece7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:31.070610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 892/1781] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:31.073772 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8574b-0cc3-485b-b5bb-9bf3f327dfd7 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:31.102177 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-a48445fa-2893-463b-a23c-f6da30ece7d3 None None] MFA Rules not processed for user `4ac6ca32b5144c59b2bb5086fbd53ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:31.106294 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-a48445fa-2893-463b-a23c-f6da30ece7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:31.211020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 890/1782] 10.222.0.42 () {58 vars in 1015 bytes} [Thu Aug 11 09:59:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 09:59:31.212178 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48445fa-2893-463b-a23c-f6da30ece7d3 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:31.265737 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8574b-0cc3-485b-b5bb-9bf3f327dfd7 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:31.273402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a5419-20d1-4250-bed3-417a0800e9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:31.274045 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a5419-20d1-4250-bed3-417a0800e9ea admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:31.274447 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a5419-20d1-4250-bed3-417a0800e9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:31.275004 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a5419-20d1-4250-bed3-417a0800e9ea admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:31.275822 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a5419-20d1-4250-bed3-417a0800e9ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:31.277822 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a5419-20d1-4250-bed3-417a0800e9ea admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:31.378639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48445fa-2893-463b-a23c-f6da30ece7d3 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:31.385738 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 893/1783] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:59:31 2022] POST /identity/v3/projects => generated 391 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:31.387150 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a5419-20d1-4250-bed3-417a0800e9ea admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:31.389501 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80195404-9bd0-4d59-b439-4f4cfba15143 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:31.392680 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80195404-9bd0-4d59-b439-4f4cfba15143 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:31.392918 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80195404-9bd0-4d59-b439-4f4cfba15143 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:31.393009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80195404-9bd0-4d59-b439-4f4cfba15143 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:31.394424 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-a19a5419-20d1-4250-bed3-417a0800e9ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:31.397809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-80195404-9bd0-4d59-b439-4f4cfba15143 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:31.623830 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80195404-9bd0-4d59-b439-4f4cfba15143 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:31.627089 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a5419-20d1-4250-bed3-417a0800e9ea admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:31.648376 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80195404-9bd0-4d59-b439-4f4cfba15143 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:31.662116 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793c6a1-ab0b-471c-8add-4ad6166aa958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:31.662264 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793c6a1-ab0b-471c-8add-4ad6166aa958 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:31.662512 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793c6a1-ab0b-471c-8add-4ad6166aa958 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:31.662788 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793c6a1-ab0b-471c-8add-4ad6166aa958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:31.669645 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 891/1784] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:31.670494 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80195404-9bd0-4d59-b439-4f4cfba15143 service cinder] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:31.675085 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793c6a1-ab0b-471c-8add-4ad6166aa958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:31.676590 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793c6a1-ab0b-471c-8add-4ad6166aa958 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:31.689217 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 894/1785] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:31.698671 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80195404-9bd0-4d59-b439-4f4cfba15143 service cinder] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:31.830636 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae8c3f-11a9-40a8-b58f-b4a2ac274f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:31.831536 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae8c3f-11a9-40a8-b58f-b4a2ac274f2c admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:31.831953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae8c3f-11a9-40a8-b58f-b4a2ac274f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:31.832360 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae8c3f-11a9-40a8-b58f-b4a2ac274f2c admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:31.834002 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae8c3f-11a9-40a8-b58f-b4a2ac274f2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:31.837058 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae8c3f-11a9-40a8-b58f-b4a2ac274f2c admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:31.964152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 892/1786] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:31 2022] POST /identity/v3/users => generated 302 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:31.965438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793c6a1-ab0b-471c-8add-4ad6166aa958 service neutron] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:31.973159 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:32.037582 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793c6a1-ab0b-471c-8add-4ad6166aa958 service neutron] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:32.050453 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425418a6-eac1-4383-8f02-47b789da31dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:32.052684 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425418a6-eac1-4383-8f02-47b789da31dd admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:32.053063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425418a6-eac1-4383-8f02-47b789da31dd admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:32.054325 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425418a6-eac1-4383-8f02-47b789da31dd admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:32.056172 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425418a6-eac1-4383-8f02-47b789da31dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:32.064778 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425418a6-eac1-4383-8f02-47b789da31dd admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:32.109876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 895/1787] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:32.118654 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae8c3f-11a9-40a8-b58f-b4a2ac274f2c admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:32.129285 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae8c3f-11a9-40a8-b58f-b4a2ac274f2c admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:32.143553 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:32.147565 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4115ee-76ae-441f-a2cd-69d18a00e925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:32.148586 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4115ee-76ae-441f-a2cd-69d18a00e925 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:32.158915 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4115ee-76ae-441f-a2cd-69d18a00e925 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:32.159434 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4115ee-76ae-441f-a2cd-69d18a00e925 admin admin] PATH_INFO: `/v3/projects/596160d76a77466aadafbb0cb8b52d2d/users/83740b30d5fe4c779ca555b12a920c94/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:32.180581 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4115ee-76ae-441f-a2cd-69d18a00e925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=596160d76a77466aadafbb0cb8b52d2d, user_id=83740b30d5fe4c779ca555b12a920c94, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:32.184457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4115ee-76ae-441f-a2cd-69d18a00e925 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:32.329617 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 893/1788] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:32 2022] PUT /identity/v3/projects/596160d76a77466aadafbb0cb8b52d2d/users/83740b30d5fe4c779ca555b12a920c94/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:32.334289 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425418a6-eac1-4383-8f02-47b789da31dd admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:32.364292 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425418a6-eac1-4383-8f02-47b789da31dd admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:32.505515 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ae31c-07c2-4a96-85c3-2143acdae38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:32.507230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ae31c-07c2-4a96-85c3-2143acdae38a admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:32.507626 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ae31c-07c2-4a96-85c3-2143acdae38a admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:32.507999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ae31c-07c2-4a96-85c3-2143acdae38a admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:32.508830 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ae31c-07c2-4a96-85c3-2143acdae38a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:32.520123 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ae31c-07c2-4a96-85c3-2143acdae38a admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:32.537149 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 896/1789] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:32.539606 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4115ee-76ae-441f-a2cd-69d18a00e925 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:32.554327 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4115ee-76ae-441f-a2cd-69d18a00e925 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:32.559539 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1618488-54fd-4992-b023-0555cbb2bf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:32.560207 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1618488-54fd-4992-b023-0555cbb2bf05 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:32.560477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1618488-54fd-4992-b023-0555cbb2bf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:32.560766 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1618488-54fd-4992-b023-0555cbb2bf05 admin admin] PATH_INFO: `/v3/projects/596160d76a77466aadafbb0cb8b52d2d/users/83740b30d5fe4c779ca555b12a920c94/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:32.568085 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1618488-54fd-4992-b023-0555cbb2bf05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=596160d76a77466aadafbb0cb8b52d2d, user_id=83740b30d5fe4c779ca555b12a920c94, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:32.570870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1618488-54fd-4992-b023-0555cbb2bf05 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:32.632485 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 894/1790] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:32 2022] PUT /identity/v3/projects/596160d76a77466aadafbb0cb8b52d2d/users/83740b30d5fe4c779ca555b12a920c94/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:32.634225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089abbb-7138-4fbe-ad11-ab43708515be None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:32.634225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089abbb-7138-4fbe-ad11-ab43708515be None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:32.634225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089abbb-7138-4fbe-ad11-ab43708515be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:32.705228 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-f089abbb-7138-4fbe-ad11-ab43708515be None None] MFA Rules not processed for user `83740b30d5fe4c779ca555b12a920c94`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:32.706742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-f089abbb-7138-4fbe-ad11-ab43708515be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:32.925084 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 897/1791] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:32 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:32.956781 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1618488-54fd-4992-b023-0555cbb2bf05 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:32.961572 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-d1618488-54fd-4992-b023-0555cbb2bf05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:33.206425 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1618488-54fd-4992-b023-0555cbb2bf05 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:33.206425 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090ee7d-9ce4-422e-abf8-df268f2e70dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:33.206425 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090ee7d-9ce4-422e-abf8-df268f2e70dd service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:33.206425 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090ee7d-9ce4-422e-abf8-df268f2e70dd service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:33.208760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090ee7d-9ce4-422e-abf8-df268f2e70dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:33.208760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090ee7d-9ce4-422e-abf8-df268f2e70dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:33.208760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090ee7d-9ce4-422e-abf8-df268f2e70dd service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:33.208760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 895/1792] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:32 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:33.326144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089abbb-7138-4fbe-ad11-ab43708515be None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:33.363078 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089abbb-7138-4fbe-ad11-ab43708515be None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:33.369052 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59f744-104a-4513-be68-304785e13eff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:33.374214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59f744-104a-4513-be68-304785e13eff service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:33.374214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59f744-104a-4513-be68-304785e13eff service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:33.374214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59f744-104a-4513-be68-304785e13eff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:33.651101 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59f744-104a-4513-be68-304785e13eff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:33.664116 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59f744-104a-4513-be68-304785e13eff service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:33.763695 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 898/1793] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:34.325486 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba88474-a5e5-419e-a1ed-000c2863eb48 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:34.326212 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba88474-a5e5-419e-a1ed-000c2863eb48 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:34.326212 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba88474-a5e5-419e-a1ed-000c2863eb48 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:34.328095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 896/1794] 10.222.0.13 () {54 vars in 921 bytes} [Thu Aug 11 09:59:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:59:34.331099 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:34.362488 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b42d9-3579-45ad-a5f6-504d57ea4045 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:34.363094 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b42d9-3579-45ad-a5f6-504d57ea4045 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:34.363094 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b42d9-3579-45ad-a5f6-504d57ea4045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:34.450408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-fe2b42d9-3579-45ad-a5f6-504d57ea4045 None None] MFA Rules not processed for user `4c1dc8e0d9454ad98894ed1e8d31f931`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:34.458264 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-fe2b42d9-3579-45ad-a5f6-504d57ea4045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:34.785145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 899/1795] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Aug 11 09:59:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:34.880700 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:35.219015 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba88474-a5e5-419e-a1ed-000c2863eb48 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:35.219015 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-5ba88474-a5e5-419e-a1ed-000c2863eb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:35.247768 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba88474-a5e5-419e-a1ed-000c2863eb48 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:35.267975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fd12a-47e6-48e0-8a8d-ba32cbc5c579 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:35.269040 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fd12a-47e6-48e0-8a8d-ba32cbc5c579 service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:35.269485 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fd12a-47e6-48e0-8a8d-ba32cbc5c579 service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:35.269942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fd12a-47e6-48e0-8a8d-ba32cbc5c579 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:35.292112 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8fd12a-47e6-48e0-8a8d-ba32cbc5c579 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:35.297542 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8fd12a-47e6-48e0-8a8d-ba32cbc5c579 service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:35.337679 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 897/1796] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:37.954274 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:38.106920 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fe2b0-6634-4632-b2f0-ea77621f693d None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:38.107206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fe2b0-6634-4632-b2f0-ea77621f693d None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:38.108093 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fe2b0-6634-4632-b2f0-ea77621f693d None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:38.114924 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 900/1797] 10.222.0.13 () {54 vars in 921 bytes} [Thu Aug 11 09:59:38 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:59:38.132899 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc6089-20af-4595-84fa-c1c3ab6f6737 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:38.133836 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc6089-20af-4595-84fa-c1c3ab6f6737 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:38.134330 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc6089-20af-4595-84fa-c1c3ab6f6737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:38.178214 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-bafc6089-20af-4595-84fa-c1c3ab6f6737 None None] MFA Rules not processed for user `4c1dc8e0d9454ad98894ed1e8d31f931`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:38.181915 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-bafc6089-20af-4595-84fa-c1c3ab6f6737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:38.211780 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 898/1798] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Aug 11 09:59:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:38.841434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fe2b0-6634-4632-b2f0-ea77621f693d None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:38.843528 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-a39fe2b0-6634-4632-b2f0-ea77621f693d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:38.910985 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fe2b0-6634-4632-b2f0-ea77621f693d None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:38.935014 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20083e79-1089-4d30-8a78-7778cff890ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:38.936563 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20083e79-1089-4d30-8a78-7778cff890ff service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:38.937898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20083e79-1089-4d30-8a78-7778cff890ff service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:38.939302 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20083e79-1089-4d30-8a78-7778cff890ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:38.965052 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20083e79-1089-4d30-8a78-7778cff890ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:38.968514 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20083e79-1089-4d30-8a78-7778cff890ff service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:39.033753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 901/1799] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:39.985480 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:40.796555 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:42.884170 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc6089-20af-4595-84fa-c1c3ab6f6737 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:42.893452 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20083e79-1089-4d30-8a78-7778cff890ff service nova] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:42.948457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc6089-20af-4595-84fa-c1c3ab6f6737 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:42.953205 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37134e4e-a5d0-4756-8c0d-cfa385efc6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:42.953857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37134e4e-a5d0-4756-8c0d-cfa385efc6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:42.954162 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37134e4e-a5d0-4756-8c0d-cfa385efc6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:42.954436 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37134e4e-a5d0-4756-8c0d-cfa385efc6b7 admin admin] PATH_INFO: `/v3/users/b6f3f180aa4748fb98b2aba1ba845ae5` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:42.955562 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37134e4e-a5d0-4756-8c0d-cfa385efc6b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f3f180aa4748fb98b2aba1ba845ae5)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:42.955687 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20083e79-1089-4d30-8a78-7778cff890ff service nova] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:42.957513 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37134e4e-a5d0-4756-8c0d-cfa385efc6b7 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:42.960699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ea254-b388-4f46-897a-07a42eccbdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:42.961352 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ea254-b388-4f46-897a-07a42eccbdfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:42.961611 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ea254-b388-4f46-897a-07a42eccbdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:42.961876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ea254-b388-4f46-897a-07a42eccbdfd admin admin] PATH_INFO: `/v3/users/655ebaf0cb284ec899aa01f69988e573` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:42.963058 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ea254-b388-4f46-897a-07a42eccbdfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=655ebaf0cb284ec899aa01f69988e573)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:42.964961 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ea254-b388-4f46-897a-07a42eccbdfd admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:43.221848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-37134e4e-a5d0-4756-8c0d-cfa385efc6b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f3f180aa4748fb98b2aba1ba845ae5'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:43.237540 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-37134e4e-a5d0-4756-8c0d-cfa385efc6b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f3f180aa4748fb98b2aba1ba845ae5'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:43.238986 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-37134e4e-a5d0-4756-8c0d-cfa385efc6b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f3f180aa4748fb98b2aba1ba845ae5'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:43.251457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-37134e4e-a5d0-4756-8c0d-cfa385efc6b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f3f180aa4748fb98b2aba1ba845ae5'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:43.260145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-244ea254-b388-4f46-897a-07a42eccbdfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '655ebaf0cb284ec899aa01f69988e573'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:43.274837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-244ea254-b388-4f46-897a-07a42eccbdfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '655ebaf0cb284ec899aa01f69988e573'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:43.279375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-244ea254-b388-4f46-897a-07a42eccbdfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '655ebaf0cb284ec899aa01f69988e573'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:43.280155 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-244ea254-b388-4f46-897a-07a42eccbdfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '655ebaf0cb284ec899aa01f69988e573'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:43.288002 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-244ea254-b388-4f46-897a-07a42eccbdfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '655ebaf0cb284ec899aa01f69988e573'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:43.319024 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-37134e4e-a5d0-4756-8c0d-cfa385efc6b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f3f180aa4748fb98b2aba1ba845ae5'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:43.325309 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 899/1800] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:59:42 2022] DELETE /identity/v3/users/b6f3f180aa4748fb98b2aba1ba845ae5 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:43.330005 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0b14c-1a17-41b2-93b4-6b51c39611de None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:43.330353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0b14c-1a17-41b2-93b4-6b51c39611de None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:43.330631 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0b14c-1a17-41b2-93b4-6b51c39611de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:43.349774 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-06c0b14c-1a17-41b2-93b4-6b51c39611de None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:43.352000 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-06c0b14c-1a17-41b2-93b4-6b51c39611de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:43.419475 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 900/1801] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 09:59:43.431490 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 902/1802] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:59:42 2022] DELETE /identity/v3/users/655ebaf0cb284ec899aa01f69988e573 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 09:59:43.439640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0c6a2-ac15-491a-ad2a-229d3619745d None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:43.439640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0c6a2-ac15-491a-ad2a-229d3619745d None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:43.439640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0c6a2-ac15-491a-ad2a-229d3619745d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:43.440030 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ea254-b388-4f46-897a-07a42eccbdfd admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:43.442120 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-244ea254-b388-4f46-897a-07a42eccbdfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:43.460243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-09c0c6a2-ac15-491a-ad2a-229d3619745d None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:43.461059 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-09c0c6a2-ac15-491a-ad2a-229d3619745d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:43.508646 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ea254-b388-4f46-897a-07a42eccbdfd admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:43.512513 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc963f4-26d6-4a36-bd36-5d71ac8bbf18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:43.513345 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc963f4-26d6-4a36-bd36-5d71ac8bbf18 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:43.513693 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc963f4-26d6-4a36-bd36-5d71ac8bbf18 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:43.514191 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc963f4-26d6-4a36-bd36-5d71ac8bbf18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:43.531173 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 901/1803] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 09:59:43.539310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0c6a2-ac15-491a-ad2a-229d3619745d None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:43.540805 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-09c0c6a2-ac15-491a-ad2a-229d3619745d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:43.557807 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0c6a2-ac15-491a-ad2a-229d3619745d None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:43.561878 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67213ab1-3dae-4309-902b-3595b979f47d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:43.562714 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67213ab1-3dae-4309-902b-3595b979f47d service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:43.562987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67213ab1-3dae-4309-902b-3595b979f47d service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:43.563255 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67213ab1-3dae-4309-902b-3595b979f47d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:43.573634 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67213ab1-3dae-4309-902b-3595b979f47d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:43.575348 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67213ab1-3dae-4309-902b-3595b979f47d service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:43.586003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc963f4-26d6-4a36-bd36-5d71ac8bbf18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:43.587518 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 902/1804] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 09:59:43.587745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc963f4-26d6-4a36-bd36-5d71ac8bbf18 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:43.600163 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 903/1805] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:44.072594 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67213ab1-3dae-4309-902b-3595b979f47d service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:44.081190 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-67213ab1-3dae-4309-902b-3595b979f47d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:44.087227 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67213ab1-3dae-4309-902b-3595b979f47d service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:44.091888 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b76b8-9158-4f40-bc78-05769ae2adb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:44.092510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b76b8-9158-4f40-bc78-05769ae2adb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:44.093346 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b76b8-9158-4f40-bc78-05769ae2adb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:44.093346 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b76b8-9158-4f40-bc78-05769ae2adb2 admin admin] PATH_INFO: `/v3/projects/48a5f47282254982875f94fde68d4c9b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:44.094183 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b76b8-9158-4f40-bc78-05769ae2adb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48a5f47282254982875f94fde68d4c9b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:44.096119 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b76b8-9158-4f40-bc78-05769ae2adb2 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:44.115578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc963f4-26d6-4a36-bd36-5d71ac8bbf18 service neutron] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:44.115578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-4dc963f4-26d6-4a36-bd36-5d71ac8bbf18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:44.126717 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc963f4-26d6-4a36-bd36-5d71ac8bbf18 service neutron] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:44.132125 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b84f07-161a-4aca-bfb3-cc50ea6c815e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:44.132842 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b84f07-161a-4aca-bfb3-cc50ea6c815e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:44.133192 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b84f07-161a-4aca-bfb3-cc50ea6c815e admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:44.134465 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b84f07-161a-4aca-bfb3-cc50ea6c815e admin admin] PATH_INFO: `/v3/projects/183f4da309014f9e94667cb2cec37bcb` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:44.135877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b84f07-161a-4aca-bfb3-cc50ea6c815e admin admin] RBAC: Authorizing `identity:delete_project(project_id=183f4da309014f9e94667cb2cec37bcb)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:44.137804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b84f07-161a-4aca-bfb3-cc50ea6c815e admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:44.263698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-09b84f07-161a-4aca-bfb3-cc50ea6c815e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '183f4da309014f9e94667cb2cec37bcb', 'request_id': 'req-09b84f07-161a-4aca-bfb3-cc50ea6c815e'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:44.264112 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7c1b76b8-9158-4f40-bc78-05769ae2adb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48a5f47282254982875f94fde68d4c9b', 'request_id': 'req-7c1b76b8-9158-4f40-bc78-05769ae2adb2'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:44.269596 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7c1b76b8-9158-4f40-bc78-05769ae2adb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48a5f47282254982875f94fde68d4c9b', 'request_id': 'req-7c1b76b8-9158-4f40-bc78-05769ae2adb2'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:44.269790 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-09b84f07-161a-4aca-bfb3-cc50ea6c815e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '183f4da309014f9e94667cb2cec37bcb', 'request_id': 'req-09b84f07-161a-4aca-bfb3-cc50ea6c815e'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:44.275862 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7c1b76b8-9158-4f40-bc78-05769ae2adb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48a5f47282254982875f94fde68d4c9b', 'request_id': 'req-7c1b76b8-9158-4f40-bc78-05769ae2adb2'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:44.349655 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:44.351351 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-09b84f07-161a-4aca-bfb3-cc50ea6c815e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '183f4da309014f9e94667cb2cec37bcb', 'request_id': 'req-09b84f07-161a-4aca-bfb3-cc50ea6c815e'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:44.370955 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-09b84f07-161a-4aca-bfb3-cc50ea6c815e admin admin] The token cache is being invalidate because project 183f4da309014f9e94667cb2cec37bcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 09:59:44.370955 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-09b84f07-161a-4aca-bfb3-cc50ea6c815e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:44.370955 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-09b84f07-161a-4aca-bfb3-cc50ea6c815e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:44.370955 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 904/1806] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:59:44 2022] DELETE /identity/v3/projects/183f4da309014f9e94667cb2cec37bcb => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:44.373078 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b84f07-161a-4aca-bfb3-cc50ea6c815e admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:44.374566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-09b84f07-161a-4aca-bfb3-cc50ea6c815e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:44.444054 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b84f07-161a-4aca-bfb3-cc50ea6c815e admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:44.498767 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7c1b76b8-9158-4f40-bc78-05769ae2adb2 admin admin] The token cache is being invalidate because project 48a5f47282254982875f94fde68d4c9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 09:59:44.498767 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7c1b76b8-9158-4f40-bc78-05769ae2adb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:44.498767 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7c1b76b8-9158-4f40-bc78-05769ae2adb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:44.498767 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 903/1807] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:59:44 2022] DELETE /identity/v3/projects/48a5f47282254982875f94fde68d4c9b => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:44.501451 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b76b8-9158-4f40-bc78-05769ae2adb2 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:44.503089 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-7c1b76b8-9158-4f40-bc78-05769ae2adb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:44.516521 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9386554-1a88-4e32-8fc6-68b8f7edfc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:44.517167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9386554-1a88-4e32-8fc6-68b8f7edfc5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:44.518472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9386554-1a88-4e32-8fc6-68b8f7edfc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:44.518978 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9386554-1a88-4e32-8fc6-68b8f7edfc5f admin admin] PATH_INFO: `/v3/users/83740b30d5fe4c779ca555b12a920c94` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:44.520433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9386554-1a88-4e32-8fc6-68b8f7edfc5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=83740b30d5fe4c779ca555b12a920c94)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:44.522622 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9386554-1a88-4e32-8fc6-68b8f7edfc5f admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:44.583053 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b76b8-9158-4f40-bc78-05769ae2adb2 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:44.587842 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c6039-fb6a-47da-91b2-02df1adc6c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:44.588832 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c6039-fb6a-47da-91b2-02df1adc6c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:44.588832 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c6039-fb6a-47da-91b2-02df1adc6c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:44.589085 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c6039-fb6a-47da-91b2-02df1adc6c01 admin admin] PATH_INFO: `/v3/users/2ae4fc2b4d054fe580598e77584a2701` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:44.590238 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c6039-fb6a-47da-91b2-02df1adc6c01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ae4fc2b4d054fe580598e77584a2701)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:44.592255 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c6039-fb6a-47da-91b2-02df1adc6c01 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:44.694856 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:44.765439 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-b9386554-1a88-4e32-8fc6-68b8f7edfc5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83740b30d5fe4c779ca555b12a920c94'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:44.778434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-b9386554-1a88-4e32-8fc6-68b8f7edfc5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83740b30d5fe4c779ca555b12a920c94'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:44.779200 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-b9386554-1a88-4e32-8fc6-68b8f7edfc5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83740b30d5fe4c779ca555b12a920c94'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:44.779979 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-b9386554-1a88-4e32-8fc6-68b8f7edfc5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83740b30d5fe4c779ca555b12a920c94'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:44.787770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-b9386554-1a88-4e32-8fc6-68b8f7edfc5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83740b30d5fe4c779ca555b12a920c94'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:44.795018 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-bb7c6039-fb6a-47da-91b2-02df1adc6c01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ae4fc2b4d054fe580598e77584a2701'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:44.807303 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-bb7c6039-fb6a-47da-91b2-02df1adc6c01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ae4fc2b4d054fe580598e77584a2701'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:44.808888 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-bb7c6039-fb6a-47da-91b2-02df1adc6c01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ae4fc2b4d054fe580598e77584a2701'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:44.816077 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-bb7c6039-fb6a-47da-91b2-02df1adc6c01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ae4fc2b4d054fe580598e77584a2701'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:44.882700 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 905/1808] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:59:44 2022] DELETE /identity/v3/users/83740b30d5fe4c779ca555b12a920c94 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 09:59:44.887871 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9386554-1a88-4e32-8fc6-68b8f7edfc5f admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:44.887871 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-b9386554-1a88-4e32-8fc6-68b8f7edfc5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:44.949891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9386554-1a88-4e32-8fc6-68b8f7edfc5f admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:44.954575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f27e49-236a-4e4e-8930-59201d69a072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:44.955203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f27e49-236a-4e4e-8930-59201d69a072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:44.955486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f27e49-236a-4e4e-8930-59201d69a072 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:44.955754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f27e49-236a-4e4e-8930-59201d69a072 admin admin] PATH_INFO: `/v3/users/71828f07c7ae42cdb0e38a54cb17d06f` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:44.957419 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f27e49-236a-4e4e-8930-59201d69a072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71828f07c7ae42cdb0e38a54cb17d06f)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:44.959467 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f27e49-236a-4e4e-8930-59201d69a072 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:45.038812 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-bb7c6039-fb6a-47da-91b2-02df1adc6c01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ae4fc2b4d054fe580598e77584a2701'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:45.045663 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 904/1809] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:59:44 2022] DELETE /identity/v3/users/2ae4fc2b4d054fe580598e77584a2701 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:45.219045 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-54f27e49-236a-4e4e-8930-59201d69a072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71828f07c7ae42cdb0e38a54cb17d06f'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:45.237284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-54f27e49-236a-4e4e-8930-59201d69a072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71828f07c7ae42cdb0e38a54cb17d06f'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:45.238053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-54f27e49-236a-4e4e-8930-59201d69a072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71828f07c7ae42cdb0e38a54cb17d06f'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:45.239239 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-54f27e49-236a-4e4e-8930-59201d69a072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71828f07c7ae42cdb0e38a54cb17d06f'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:45.247560 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-54f27e49-236a-4e4e-8930-59201d69a072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71828f07c7ae42cdb0e38a54cb17d06f'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:45.324481 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 906/1810] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:59:44 2022] DELETE /identity/v3/users/71828f07c7ae42cdb0e38a54cb17d06f => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:45.328966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a3b35-5cc4-42de-b1f9-d85ae414cdfb None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:45.329440 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a3b35-5cc4-42de-b1f9-d85ae414cdfb None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:45.329531 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a3b35-5cc4-42de-b1f9-d85ae414cdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:45.348865 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-018a3b35-5cc4-42de-b1f9-d85ae414cdfb None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:45.350113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-018a3b35-5cc4-42de-b1f9-d85ae414cdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:45.396668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f27e49-236a-4e4e-8930-59201d69a072 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:45.399183 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-54f27e49-236a-4e4e-8930-59201d69a072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:45.446360 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 905/1811] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:45.462890 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a3b35-5cc4-42de-b1f9-d85ae414cdfb None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:45.464969 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-018a3b35-5cc4-42de-b1f9-d85ae414cdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:45.476654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f27e49-236a-4e4e-8930-59201d69a072 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:45.483459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40694a33-20ba-43d8-b204-d3c428acebcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:45.484380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40694a33-20ba-43d8-b204-d3c428acebcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:45.484824 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40694a33-20ba-43d8-b204-d3c428acebcc admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:45.485261 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40694a33-20ba-43d8-b204-d3c428acebcc admin admin] PATH_INFO: `/v3/projects/596160d76a77466aadafbb0cb8b52d2d` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:45.486598 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40694a33-20ba-43d8-b204-d3c428acebcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=596160d76a77466aadafbb0cb8b52d2d)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:45.490196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40694a33-20ba-43d8-b204-d3c428acebcc admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:45.535272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a3b35-5cc4-42de-b1f9-d85ae414cdfb None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:45.539095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30b59a-5e9d-4bdd-9496-fa7276b22e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:45.541769 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30b59a-5e9d-4bdd-9496-fa7276b22e90 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:45.541769 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30b59a-5e9d-4bdd-9496-fa7276b22e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:45.541769 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30b59a-5e9d-4bdd-9496-fa7276b22e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:45.555585 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30b59a-5e9d-4bdd-9496-fa7276b22e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:45.557035 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30b59a-5e9d-4bdd-9496-fa7276b22e90 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:45.569028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 906/1812] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 09:59:45.599987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30b59a-5e9d-4bdd-9496-fa7276b22e90 service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:45.604239 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-3b30b59a-5e9d-4bdd-9496-fa7276b22e90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:45.620095 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-40694a33-20ba-43d8-b204-d3c428acebcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '596160d76a77466aadafbb0cb8b52d2d', 'request_id': 'req-40694a33-20ba-43d8-b204-d3c428acebcc'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:45.631607 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-40694a33-20ba-43d8-b204-d3c428acebcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '596160d76a77466aadafbb0cb8b52d2d', 'request_id': 'req-40694a33-20ba-43d8-b204-d3c428acebcc'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:45.632642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30b59a-5e9d-4bdd-9496-fa7276b22e90 service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:45.734031 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-40694a33-20ba-43d8-b204-d3c428acebcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '596160d76a77466aadafbb0cb8b52d2d', 'request_id': 'req-40694a33-20ba-43d8-b204-d3c428acebcc'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:45.735206 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8355b9-d2fa-4fe8-8554-d620a0215ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:45.740526 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8355b9-d2fa-4fe8-8554-d620a0215ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:45.740526 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8355b9-d2fa-4fe8-8554-d620a0215ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:45.740526 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8355b9-d2fa-4fe8-8554-d620a0215ca0 admin admin] PATH_INFO: `/v3/projects/a157c8f10f0b4fa9b275e6411907fa76` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:45.740526 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8355b9-d2fa-4fe8-8554-d620a0215ca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a157c8f10f0b4fa9b275e6411907fa76)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:45.740526 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8355b9-d2fa-4fe8-8554-d620a0215ca0 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:45.747993 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-40694a33-20ba-43d8-b204-d3c428acebcc admin admin] The token cache is being invalidate because project 596160d76a77466aadafbb0cb8b52d2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 09:59:45.748292 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-40694a33-20ba-43d8-b204-d3c428acebcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:45.749028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-40694a33-20ba-43d8-b204-d3c428acebcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:45.750923 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 907/1813] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:59:45 2022] DELETE /identity/v3/projects/596160d76a77466aadafbb0cb8b52d2d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:45.756831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b381eff-6558-4e2b-bc33-309085d0574e None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:45.757313 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b381eff-6558-4e2b-bc33-309085d0574e None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:45.757778 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b381eff-6558-4e2b-bc33-309085d0574e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:45.780433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-7b381eff-6558-4e2b-bc33-309085d0574e None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:45.781700 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-7b381eff-6558-4e2b-bc33-309085d0574e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:45.790130 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 908/1814] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 09:59:45.799324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb909799-c645-41df-a9e9-ecd59d2963d2 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:45.799644 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb909799-c645-41df-a9e9-ecd59d2963d2 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:45.799915 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb909799-c645-41df-a9e9-ecd59d2963d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:45.821248 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-bb909799-c645-41df-a9e9-ecd59d2963d2 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:45.822486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-bb909799-c645-41df-a9e9-ecd59d2963d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:45.831129 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 909/1815] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 09:59:45.834878 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb909799-c645-41df-a9e9-ecd59d2963d2 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:45.844382 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb909799-c645-41df-a9e9-ecd59d2963d2 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:45.849221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefca6ae-59d2-4c96-b18b-0e6dd5aa3a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:45.849900 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefca6ae-59d2-4c96-b18b-0e6dd5aa3a4c admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:45.850267 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefca6ae-59d2-4c96-b18b-0e6dd5aa3a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:45.850544 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefca6ae-59d2-4c96-b18b-0e6dd5aa3a4c admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:45.851197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefca6ae-59d2-4c96-b18b-0e6dd5aa3a4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:59:45.851502 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefca6ae-59d2-4c96-b18b-0e6dd5aa3a4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:45.853691 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefca6ae-59d2-4c96-b18b-0e6dd5aa3a4c admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:45.864596 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7e8355b9-d2fa-4fe8-8554-d620a0215ca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a157c8f10f0b4fa9b275e6411907fa76', 'request_id': 'req-7e8355b9-d2fa-4fe8-8554-d620a0215ca0'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:45.870400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7e8355b9-d2fa-4fe8-8554-d620a0215ca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a157c8f10f0b4fa9b275e6411907fa76', 'request_id': 'req-7e8355b9-d2fa-4fe8-8554-d620a0215ca0'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:45.877568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7e8355b9-d2fa-4fe8-8554-d620a0215ca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a157c8f10f0b4fa9b275e6411907fa76', 'request_id': 'req-7e8355b9-d2fa-4fe8-8554-d620a0215ca0'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:45.891729 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 910/1816] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 09:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:59:45.899170 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefca6ae-59d2-4c96-b18b-0e6dd5aa3a4c admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:45.920158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefca6ae-59d2-4c96-b18b-0e6dd5aa3a4c admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:45.974036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7e8355b9-d2fa-4fe8-8554-d620a0215ca0 admin admin] The token cache is being invalidate because project a157c8f10f0b4fa9b275e6411907fa76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 09:59:45.974473 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7e8355b9-d2fa-4fe8-8554-d620a0215ca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:45.975066 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7e8355b9-d2fa-4fe8-8554-d620a0215ca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:45.977137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 907/1817] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:59:45 2022] DELETE /identity/v3/projects/a157c8f10f0b4fa9b275e6411907fa76 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:45.981735 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590a08b-53d6-454f-aeb1-4bbda45096cc None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:45.982023 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590a08b-53d6-454f-aeb1-4bbda45096cc None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:45.982323 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590a08b-53d6-454f-aeb1-4bbda45096cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:45.984545 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f871b-8574-4303-9a7d-5d35582ac3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:45.985646 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f871b-8574-4303-9a7d-5d35582ac3c2 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:45.985878 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f871b-8574-4303-9a7d-5d35582ac3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:45.986175 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f871b-8574-4303-9a7d-5d35582ac3c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:45.987069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f871b-8574-4303-9a7d-5d35582ac3c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:45.989748 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f871b-8574-4303-9a7d-5d35582ac3c2 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:46.004339 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-0590a08b-53d6-454f-aeb1-4bbda45096cc None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:46.006026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-0590a08b-53d6-454f-aeb1-4bbda45096cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:46.014626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 908/1818] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:46.024388 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba603c3-3464-4d40-9d98-88c4658418e0 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:46.024656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba603c3-3464-4d40-9d98-88c4658418e0 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:46.024933 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba603c3-3464-4d40-9d98-88c4658418e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:46.047651 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-eba603c3-3464-4d40-9d98-88c4658418e0 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:46.048858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-eba603c3-3464-4d40-9d98-88c4658418e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:46.061454 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 909/1819] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:46.062409 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba603c3-3464-4d40-9d98-88c4658418e0 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:46.072874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba603c3-3464-4d40-9d98-88c4658418e0 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:46.079349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30ea64-51d5-40e7-a48e-cc9beaf39af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:46.080088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30ea64-51d5-40e7-a48e-cc9beaf39af6 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:46.080457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30ea64-51d5-40e7-a48e-cc9beaf39af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:46.080797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30ea64-51d5-40e7-a48e-cc9beaf39af6 admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:46.081519 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30ea64-51d5-40e7-a48e-cc9beaf39af6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:59:46.081921 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30ea64-51d5-40e7-a48e-cc9beaf39af6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:46.083675 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30ea64-51d5-40e7-a48e-cc9beaf39af6 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:46.101052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 910/1820] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 09:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:59:46.102227 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30ea64-51d5-40e7-a48e-cc9beaf39af6 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:46.108064 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 911/1821] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:59:45 2022] POST /identity/v3/projects => generated 399 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:46.112218 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f871b-8574-4303-9a7d-5d35582ac3c2 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:46.117123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30ea64-51d5-40e7-a48e-cc9beaf39af6 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:46.117238 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-c61f871b-8574-4303-9a7d-5d35582ac3c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:46.185788 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f40b5-7166-47c8-ad1e-8f81d329f177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:46.186579 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f40b5-7166-47c8-ad1e-8f81d329f177 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:46.186859 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f40b5-7166-47c8-ad1e-8f81d329f177 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:46.187150 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f40b5-7166-47c8-ad1e-8f81d329f177 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:46.187745 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f40b5-7166-47c8-ad1e-8f81d329f177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:46.189648 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f40b5-7166-47c8-ad1e-8f81d329f177 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:46.199058 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f871b-8574-4303-9a7d-5d35582ac3c2 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:46.217057 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e13f0-8dbc-4ca2-a3c8-960537524dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:46.217700 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e13f0-8dbc-4ca2-a3c8-960537524dcb admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:46.218178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e13f0-8dbc-4ca2-a3c8-960537524dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:46.218456 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e13f0-8dbc-4ca2-a3c8-960537524dcb admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:46.219583 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e13f0-8dbc-4ca2-a3c8-960537524dcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:46.221979 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e13f0-8dbc-4ca2-a3c8-960537524dcb admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:46.314849 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 912/1822] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:46 2022] POST /identity/v3/users => generated 300 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:46.319579 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e13f0-8dbc-4ca2-a3c8-960537524dcb admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:46.319682 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 911/1823] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:59:46 2022] POST /identity/v3/projects => generated 377 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:46.319773 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-7d9e13f0-8dbc-4ca2-a3c8-960537524dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:46.322668 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f40b5-7166-47c8-ad1e-8f81d329f177 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:46.331144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e13f0-8dbc-4ca2-a3c8-960537524dcb admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:46.414999 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f40b5-7166-47c8-ad1e-8f81d329f177 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:46.420533 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c53b94-7f75-400c-b351-b557ec515c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:46.421307 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c53b94-7f75-400c-b351-b557ec515c77 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:46.421588 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c53b94-7f75-400c-b351-b557ec515c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:46.421855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c53b94-7f75-400c-b351-b557ec515c77 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:46.422392 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e3c1f-d1ee-4da3-b1f0-e6df0a61cd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:46.422535 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c53b94-7f75-400c-b351-b557ec515c77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:46.423193 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e3c1f-d1ee-4da3-b1f0-e6df0a61cd9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:46.423476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e3c1f-d1ee-4da3-b1f0-e6df0a61cd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:46.423754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e3c1f-d1ee-4da3-b1f0-e6df0a61cd9b admin admin] PATH_INFO: `/v3/projects/6c02066a20cc429cb12d9210ab00a266` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:46.425035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e3c1f-d1ee-4da3-b1f0-e6df0a61cd9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c02066a20cc429cb12d9210ab00a266)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:46.425361 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c53b94-7f75-400c-b351-b557ec515c77 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:46.427037 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e3c1f-d1ee-4da3-b1f0-e6df0a61cd9b admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:46.553281 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 912/1824] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:46 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:46.553281 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c53b94-7f75-400c-b351-b557ec515c77 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:46.563014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c53b94-7f75-400c-b351-b557ec515c77 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:46.566758 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-3b3e3c1f-d1ee-4da3-b1f0-e6df0a61cd9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c02066a20cc429cb12d9210ab00a266', 'request_id': 'req-3b3e3c1f-d1ee-4da3-b1f0-e6df0a61cd9b'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:46.572346 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-3b3e3c1f-d1ee-4da3-b1f0-e6df0a61cd9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c02066a20cc429cb12d9210ab00a266', 'request_id': 'req-3b3e3c1f-d1ee-4da3-b1f0-e6df0a61cd9b'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:46.617842 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c5f35-a4a3-458e-8371-86479bd9f3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:46.618470 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c5f35-a4a3-458e-8371-86479bd9f3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:46.618741 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c5f35-a4a3-458e-8371-86479bd9f3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:46.619008 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c5f35-a4a3-458e-8371-86479bd9f3c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:46.619638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c5f35-a4a3-458e-8371-86479bd9f3c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:46.621224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c5f35-a4a3-458e-8371-86479bd9f3c1 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:46.630798 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 913/1825] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:46.631666 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c5f35-a4a3-458e-8371-86479bd9f3c1 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:46.641067 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c5f35-a4a3-458e-8371-86479bd9f3c1 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:46.646279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf17488-4ef7-4547-935d-4a28114d67f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:46.646858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf17488-4ef7-4547-935d-4a28114d67f6 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:46.647129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf17488-4ef7-4547-935d-4a28114d67f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:46.647396 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf17488-4ef7-4547-935d-4a28114d67f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:46.648014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf17488-4ef7-4547-935d-4a28114d67f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:46.649570 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf17488-4ef7-4547-935d-4a28114d67f6 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:46.655382 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-3b3e3c1f-d1ee-4da3-b1f0-e6df0a61cd9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c02066a20cc429cb12d9210ab00a266', 'request_id': 'req-3b3e3c1f-d1ee-4da3-b1f0-e6df0a61cd9b'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:46.661074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 914/1826] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:46.662022 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf17488-4ef7-4547-935d-4a28114d67f6 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:46.672497 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf17488-4ef7-4547-935d-4a28114d67f6 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:46.673286 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-3b3e3c1f-d1ee-4da3-b1f0-e6df0a61cd9b admin admin] The token cache is being invalidate because project 6c02066a20cc429cb12d9210ab00a266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 09:59:46.673645 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-3b3e3c1f-d1ee-4da3-b1f0-e6df0a61cd9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:46.674586 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-3b3e3c1f-d1ee-4da3-b1f0-e6df0a61cd9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:46.676385 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 913/1827] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:59:46 2022] DELETE /identity/v3/projects/6c02066a20cc429cb12d9210ab00a266 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:46.677073 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e3c1f-d1ee-4da3-b1f0-e6df0a61cd9b admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:46.678705 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:46.679565 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d28a0-b8ae-48d4-aa79-e9d950230e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:46.680175 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d28a0-b8ae-48d4-aa79-e9d950230e28 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:46.680339 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-3b3e3c1f-d1ee-4da3-b1f0-e6df0a61cd9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:46.682991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d28a0-b8ae-48d4-aa79-e9d950230e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:46.682991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d28a0-b8ae-48d4-aa79-e9d950230e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:46.682991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d28a0-b8ae-48d4-aa79-e9d950230e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:46.683614 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d28a0-b8ae-48d4-aa79-e9d950230e28 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:46.696616 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 915/1828] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:46.697318 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d28a0-b8ae-48d4-aa79-e9d950230e28 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:46.701728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-292d28a0-b8ae-48d4-aa79-e9d950230e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:46.704663 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e3c1f-d1ee-4da3-b1f0-e6df0a61cd9b admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:46.713599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8ee21-6cc8-44bf-921f-693373e50570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:46.714248 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8ee21-6cc8-44bf-921f-693373e50570 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:46.714527 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8ee21-6cc8-44bf-921f-693373e50570 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:46.714795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8ee21-6cc8-44bf-921f-693373e50570 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:46.715437 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8ee21-6cc8-44bf-921f-693373e50570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:46.717088 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8ee21-6cc8-44bf-921f-693373e50570 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:46.721720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d28a0-b8ae-48d4-aa79-e9d950230e28 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:46.728529 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 914/1829] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:46.728961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef942343-4093-4841-9bf6-af4d87040116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:46.729374 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8ee21-6cc8-44bf-921f-693373e50570 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:46.729941 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef942343-4093-4841-9bf6-af4d87040116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:46.730628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef942343-4093-4841-9bf6-af4d87040116 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:46.731038 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef942343-4093-4841-9bf6-af4d87040116 admin admin] PATH_INFO: `/v3/users/4c6d58c795d34323be47411fb611cd1d` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:46.739647 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ffe8ee21-6cc8-44bf-921f-693373e50570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:46.739774 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef942343-4093-4841-9bf6-af4d87040116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c6d58c795d34323be47411fb611cd1d)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:46.739774 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef942343-4093-4841-9bf6-af4d87040116 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:46.747693 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8ee21-6cc8-44bf-921f-693373e50570 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:46.753087 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a017370-272a-4ce5-b2db-c4f80b4546b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:46.754336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a017370-272a-4ce5-b2db-c4f80b4546b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:46.754619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a017370-272a-4ce5-b2db-c4f80b4546b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:46.754894 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a017370-272a-4ce5-b2db-c4f80b4546b7 admin admin] PATH_INFO: `/v3/projects/d60a33a437954e3ab60348b2b1b46d63/users/fa4224b36f234948b7f188a1373050f3/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:46.773195 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a017370-272a-4ce5-b2db-c4f80b4546b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60a33a437954e3ab60348b2b1b46d63, user_id=fa4224b36f234948b7f188a1373050f3, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:46.776214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a017370-272a-4ce5-b2db-c4f80b4546b7 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:46.853649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 915/1830] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:46 2022] PUT /identity/v3/projects/d60a33a437954e3ab60348b2b1b46d63/users/fa4224b36f234948b7f188a1373050f3/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:46.854536 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a017370-272a-4ce5-b2db-c4f80b4546b7 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:46.943544 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ef942343-4093-4841-9bf6-af4d87040116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c6d58c795d34323be47411fb611cd1d'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:46.944126 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a017370-272a-4ce5-b2db-c4f80b4546b7 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:46.949645 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18101cbc-7e79-41b0-a358-5f9bdecb3f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:46.950735 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18101cbc-7e79-41b0-a358-5f9bdecb3f7d admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:46.951908 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18101cbc-7e79-41b0-a358-5f9bdecb3f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:46.951908 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18101cbc-7e79-41b0-a358-5f9bdecb3f7d admin admin] PATH_INFO: `/v3/projects/bc3e2edd75eb4ef7a86746efc9202e7f/users/c90ab752f276431087371fb720201709/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:46.964364 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ef942343-4093-4841-9bf6-af4d87040116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c6d58c795d34323be47411fb611cd1d'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:46.965583 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ef942343-4093-4841-9bf6-af4d87040116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c6d58c795d34323be47411fb611cd1d'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:46.968906 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18101cbc-7e79-41b0-a358-5f9bdecb3f7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc3e2edd75eb4ef7a86746efc9202e7f, user_id=c90ab752f276431087371fb720201709, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:46.972154 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18101cbc-7e79-41b0-a358-5f9bdecb3f7d admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:46.976124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ef942343-4093-4841-9bf6-af4d87040116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c6d58c795d34323be47411fb611cd1d'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:47.082368 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 916/1831] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:46 2022] PUT /identity/v3/projects/bc3e2edd75eb4ef7a86746efc9202e7f/users/c90ab752f276431087371fb720201709/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:47.083673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f01b1-60d5-4e34-96fe-59acb71538bc None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:47.083958 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f01b1-60d5-4e34-96fe-59acb71538bc None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:47.084230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f01b1-60d5-4e34-96fe-59acb71538bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:47.087986 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ef942343-4093-4841-9bf6-af4d87040116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c6d58c795d34323be47411fb611cd1d'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:47.091184 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:47.096876 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 916/1832] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:59:46 2022] DELETE /identity/v3/users/4c6d58c795d34323be47411fb611cd1d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:47.098195 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d79f9f-a66e-46eb-bdbb-4fbd6d67863a None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:47.098471 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d79f9f-a66e-46eb-bdbb-4fbd6d67863a None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:47.098864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d79f9f-a66e-46eb-bdbb-4fbd6d67863a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:47.131340 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-f8d79f9f-a66e-46eb-bdbb-4fbd6d67863a None None] MFA Rules not processed for user `c90ab752f276431087371fb720201709`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:47.132746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-f8d79f9f-a66e-46eb-bdbb-4fbd6d67863a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:47.144711 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-ea4f01b1-60d5-4e34-96fe-59acb71538bc None None] MFA Rules not processed for user `fa4224b36f234948b7f188a1373050f3`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:47.146722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ea4f01b1-60d5-4e34-96fe-59acb71538bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:47.202072 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 917/1833] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:47.206541 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d79f9f-a66e-46eb-bdbb-4fbd6d67863a None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:47.207908 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-f8d79f9f-a66e-46eb-bdbb-4fbd6d67863a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:47.216523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 917/1834] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:47 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:47.220973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f01b1-60d5-4e34-96fe-59acb71538bc None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:47.222652 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ea4f01b1-60d5-4e34-96fe-59acb71538bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:47.288785 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d79f9f-a66e-46eb-bdbb-4fbd6d67863a None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:47.294540 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3a0f5-7635-41b9-95b5-99a448df21fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:47.295182 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3a0f5-7635-41b9-95b5-99a448df21fb admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:47.295466 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3a0f5-7635-41b9-95b5-99a448df21fb admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:47.295740 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3a0f5-7635-41b9-95b5-99a448df21fb admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:47.296418 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3a0f5-7635-41b9-95b5-99a448df21fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:47.298552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3a0f5-7635-41b9-95b5-99a448df21fb admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:47.331050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f01b1-60d5-4e34-96fe-59acb71538bc None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:47.341097 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8870f-fe42-45bd-9909-a171ffdd68a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:47.341932 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8870f-fe42-45bd-9909-a171ffdd68a1 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:47.342439 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8870f-fe42-45bd-9909-a171ffdd68a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:47.342742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8870f-fe42-45bd-9909-a171ffdd68a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:47.347385 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8870f-fe42-45bd-9909-a171ffdd68a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:47.347385 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8870f-fe42-45bd-9909-a171ffdd68a1 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:47.423878 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 918/1835] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:59:47 2022] POST /identity/v3/projects => generated 379 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 09:59:47.425059 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3a0f5-7635-41b9-95b5-99a448df21fb admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:47.451261 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 918/1836] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:59:47 2022] POST /identity/v3/projects => generated 401 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:47.454815 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8870f-fe42-45bd-9909-a171ffdd68a1 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:47.541039 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3a0f5-7635-41b9-95b5-99a448df21fb admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:47.587079 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8870f-fe42-45bd-9909-a171ffdd68a1 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:47.592471 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec74d6-c90f-4e12-8c48-2d53346d1f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:47.593751 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec74d6-c90f-4e12-8c48-2d53346d1f42 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:47.593751 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec74d6-c90f-4e12-8c48-2d53346d1f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:47.593751 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec74d6-c90f-4e12-8c48-2d53346d1f42 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:47.594112 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec74d6-c90f-4e12-8c48-2d53346d1f42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:47.596134 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec74d6-c90f-4e12-8c48-2d53346d1f42 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:47.646804 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64293d7-472d-413e-992f-9274eccd2c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:47.647578 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64293d7-472d-413e-992f-9274eccd2c90 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:47.647950 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64293d7-472d-413e-992f-9274eccd2c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:47.648339 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64293d7-472d-413e-992f-9274eccd2c90 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:47.649151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64293d7-472d-413e-992f-9274eccd2c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:47.651294 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64293d7-472d-413e-992f-9274eccd2c90 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:47.704908 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 919/1837] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:47 2022] POST /identity/v3/users => generated 307 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 09:59:47.705790 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec74d6-c90f-4e12-8c48-2d53346d1f42 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:47.708587 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-70ec74d6-c90f-4e12-8c48-2d53346d1f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:47.720767 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec74d6-c90f-4e12-8c48-2d53346d1f42 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:47.726043 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4391fb-7a80-4773-a02d-2476e6c5b849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:47.726711 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4391fb-7a80-4773-a02d-2476e6c5b849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:47.726989 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4391fb-7a80-4773-a02d-2476e6c5b849 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:47.727263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4391fb-7a80-4773-a02d-2476e6c5b849 admin admin] PATH_INFO: `/v3/projects/ca42c2cd095d4fcebc109a4fd22d548d` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:47.728386 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4391fb-7a80-4773-a02d-2476e6c5b849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca42c2cd095d4fcebc109a4fd22d548d)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:47.730371 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4391fb-7a80-4773-a02d-2476e6c5b849 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:47.745595 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 919/1838] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:47 2022] POST /identity/v3/users => generated 296 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:47.745595 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64293d7-472d-413e-992f-9274eccd2c90 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:47.756315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64293d7-472d-413e-992f-9274eccd2c90 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:47.761176 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f1ff4-fe9c-4f05-929d-8cf145df2999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:47.761851 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f1ff4-fe9c-4f05-929d-8cf145df2999 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:47.762465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f1ff4-fe9c-4f05-929d-8cf145df2999 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:47.762465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f1ff4-fe9c-4f05-929d-8cf145df2999 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:47.763126 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f1ff4-fe9c-4f05-929d-8cf145df2999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:47.764843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f1ff4-fe9c-4f05-929d-8cf145df2999 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:47.780428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 920/1839] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:47.780428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f1ff4-fe9c-4f05-929d-8cf145df2999 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:47.788933 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f1ff4-fe9c-4f05-929d-8cf145df2999 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:47.794161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d47357-e031-4cfe-a254-7825dde38eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:47.794698 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d47357-e031-4cfe-a254-7825dde38eeb admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:47.794976 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d47357-e031-4cfe-a254-7825dde38eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:47.795245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d47357-e031-4cfe-a254-7825dde38eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:47.795881 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d47357-e031-4cfe-a254-7825dde38eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:47.797466 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d47357-e031-4cfe-a254-7825dde38eeb admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:47.808273 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 921/1840] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:47.809071 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d47357-e031-4cfe-a254-7825dde38eeb admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:47.818556 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d47357-e031-4cfe-a254-7825dde38eeb admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:47.823248 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047f2da-6dfe-4ccd-8bba-4629c7ed08d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:47.823896 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047f2da-6dfe-4ccd-8bba-4629c7ed08d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:47.824176 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047f2da-6dfe-4ccd-8bba-4629c7ed08d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:47.825070 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047f2da-6dfe-4ccd-8bba-4629c7ed08d6 admin admin] PATH_INFO: `/v3/projects/63ebaa1622994c5d899eb016544a7273/users/d4b1b4cfdcae46388365cb081c9273e8/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:47.850955 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047f2da-6dfe-4ccd-8bba-4629c7ed08d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ebaa1622994c5d899eb016544a7273, user_id=d4b1b4cfdcae46388365cb081c9273e8, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:47.853800 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047f2da-6dfe-4ccd-8bba-4629c7ed08d6 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:47.990708 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 922/1841] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:47 2022] PUT /identity/v3/projects/63ebaa1622994c5d899eb016544a7273/users/d4b1b4cfdcae46388365cb081c9273e8/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:47.994978 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047f2da-6dfe-4ccd-8bba-4629c7ed08d6 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:48.002386 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-8e4391fb-7a80-4773-a02d-2476e6c5b849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca42c2cd095d4fcebc109a4fd22d548d', 'request_id': 'req-8e4391fb-7a80-4773-a02d-2476e6c5b849'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:48.029474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-8e4391fb-7a80-4773-a02d-2476e6c5b849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca42c2cd095d4fcebc109a4fd22d548d', 'request_id': 'req-8e4391fb-7a80-4773-a02d-2476e6c5b849'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:48.049801 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:48.068851 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047f2da-6dfe-4ccd-8bba-4629c7ed08d6 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:48.107136 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-8e4391fb-7a80-4773-a02d-2476e6c5b849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca42c2cd095d4fcebc109a4fd22d548d', 'request_id': 'req-8e4391fb-7a80-4773-a02d-2476e6c5b849'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:48.122022 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-8e4391fb-7a80-4773-a02d-2476e6c5b849 admin admin] The token cache is being invalidate because project ca42c2cd095d4fcebc109a4fd22d548d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 09:59:48.122327 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-8e4391fb-7a80-4773-a02d-2476e6c5b849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:48.123224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-8e4391fb-7a80-4773-a02d-2476e6c5b849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:48.124772 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 920/1842] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:59:47 2022] DELETE /identity/v3/projects/ca42c2cd095d4fcebc109a4fd22d548d => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:48.126530 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4391fb-7a80-4773-a02d-2476e6c5b849 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:48.132475 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1b12a-dbc9-454e-bbb1-4aa7f4c6a74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:48.133224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1b12a-dbc9-454e-bbb1-4aa7f4c6a74f admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:48.136975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1b12a-dbc9-454e-bbb1-4aa7f4c6a74f admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:48.136975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1b12a-dbc9-454e-bbb1-4aa7f4c6a74f admin admin] PATH_INFO: `/v3/projects/1107cffb673843e898f6116e5ffae2fb/users/a3df887e05b449c9a4589c36d9425aff/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:48.137178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-8e4391fb-7a80-4773-a02d-2476e6c5b849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:48.151871 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4391fb-7a80-4773-a02d-2476e6c5b849 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:48.154341 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1b12a-dbc9-454e-bbb1-4aa7f4c6a74f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1107cffb673843e898f6116e5ffae2fb, user_id=a3df887e05b449c9a4589c36d9425aff, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:48.154931 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c91a1-3e1f-47a5-a3c5-959e1cbe1bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:48.155712 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c91a1-3e1f-47a5-a3c5-959e1cbe1bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:48.156079 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c91a1-3e1f-47a5-a3c5-959e1cbe1bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:48.156492 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c91a1-3e1f-47a5-a3c5-959e1cbe1bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:48.157163 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1b12a-dbc9-454e-bbb1-4aa7f4c6a74f admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:48.157273 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c91a1-3e1f-47a5-a3c5-959e1cbe1bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:48.159196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c91a1-3e1f-47a5-a3c5-959e1cbe1bb3 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:48.171824 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 921/1843] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:48.173288 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c68218-e571-49f6-b90a-3251c3b76667 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:48.173772 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c68218-e571-49f6-b90a-3251c3b76667 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:48.174053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c68218-e571-49f6-b90a-3251c3b76667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:48.197774 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-c5c68218-e571-49f6-b90a-3251c3b76667 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:48.199176 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-c5c68218-e571-49f6-b90a-3251c3b76667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:48.209233 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 922/1844] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:48.210063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c68218-e571-49f6-b90a-3251c3b76667 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:48.220574 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c68218-e571-49f6-b90a-3251c3b76667 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:48.225606 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bdef1-0c80-4ad9-866f-ec9ec7167141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:48.226224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bdef1-0c80-4ad9-866f-ec9ec7167141 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:48.226224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bdef1-0c80-4ad9-866f-ec9ec7167141 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:48.226644 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bdef1-0c80-4ad9-866f-ec9ec7167141 admin admin] PATH_INFO: `/v3/projects/63ebaa1622994c5d899eb016544a7273/users/d4b1b4cfdcae46388365cb081c9273e8/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:48.229235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4bdef1-0c80-4ad9-866f-ec9ec7167141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ebaa1622994c5d899eb016544a7273, user_id=d4b1b4cfdcae46388365cb081c9273e8, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:48.231921 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4bdef1-0c80-4ad9-866f-ec9ec7167141 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:48.243542 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 923/1845] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:48 2022] PUT /identity/v3/projects/63ebaa1622994c5d899eb016544a7273/users/d4b1b4cfdcae46388365cb081c9273e8/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:48.253160 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141aa215-6284-4999-8aac-af5bb20e1464 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:48.254302 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141aa215-6284-4999-8aac-af5bb20e1464 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:48.254709 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141aa215-6284-4999-8aac-af5bb20e1464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:48.263473 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 923/1846] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:47 2022] PUT /identity/v3/projects/1107cffb673843e898f6116e5ffae2fb/users/a3df887e05b449c9a4589c36d9425aff/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:48.264840 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c279d-e313-4031-9b48-ffd001fd29a0 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:48.265156 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c279d-e313-4031-9b48-ffd001fd29a0 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:48.265438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c279d-e313-4031-9b48-ffd001fd29a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:48.286702 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-141aa215-6284-4999-8aac-af5bb20e1464 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:48.288899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-141aa215-6284-4999-8aac-af5bb20e1464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:48.297759 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-f86c279d-e313-4031-9b48-ffd001fd29a0 None None] MFA Rules not processed for user `d4b1b4cfdcae46388365cb081c9273e8`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:48.299716 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-f86c279d-e313-4031-9b48-ffd001fd29a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:48.376444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 924/1847] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:48.377590 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141aa215-6284-4999-8aac-af5bb20e1464 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:48.380313 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-141aa215-6284-4999-8aac-af5bb20e1464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:48.392961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 924/1848] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:48 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:48.392961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c279d-e313-4031-9b48-ffd001fd29a0 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:48.398586 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141aa215-6284-4999-8aac-af5bb20e1464 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:48.401850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c279d-e313-4031-9b48-ffd001fd29a0 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:48.406524 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec6d77-a20b-4000-86a5-68e2615878d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:48.407131 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec6d77-a20b-4000-86a5-68e2615878d2 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:48.407404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec6d77-a20b-4000-86a5-68e2615878d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:48.407576 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac07f56-c657-4475-86bc-31909cff46eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:48.407699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec6d77-a20b-4000-86a5-68e2615878d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:48.408310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec6d77-a20b-4000-86a5-68e2615878d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:59:48.408596 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec6d77-a20b-4000-86a5-68e2615878d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:48.408781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac07f56-c657-4475-86bc-31909cff46eb admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:48.409194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac07f56-c657-4475-86bc-31909cff46eb admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:48.409613 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac07f56-c657-4475-86bc-31909cff46eb admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:48.410318 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec6d77-a20b-4000-86a5-68e2615878d2 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:48.410687 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac07f56-c657-4475-86bc-31909cff46eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:48.412592 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac07f56-c657-4475-86bc-31909cff46eb admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:48.423850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 925/1849] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 09:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:59:48.428825 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec6d77-a20b-4000-86a5-68e2615878d2 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:48.428825 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-66ec6d77-a20b-4000-86a5-68e2615878d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:48.430982 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 925/1850] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:48.432023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac07f56-c657-4475-86bc-31909cff46eb admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:48.443829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac07f56-c657-4475-86bc-31909cff46eb admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:48.448969 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6fc23-a547-4b24-ac15-789c3132dfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:48.449576 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6fc23-a547-4b24-ac15-789c3132dfd0 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:48.449855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6fc23-a547-4b24-ac15-789c3132dfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:48.450152 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6fc23-a547-4b24-ac15-789c3132dfd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:48.451071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6fc23-a547-4b24-ac15-789c3132dfd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:48.453344 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6fc23-a547-4b24-ac15-789c3132dfd0 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:48.496992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec6d77-a20b-4000-86a5-68e2615878d2 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:48.500826 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe09e4-b659-41e7-85fa-e262944a8ac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:48.501499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe09e4-b659-41e7-85fa-e262944a8ac5 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:48.501836 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe09e4-b659-41e7-85fa-e262944a8ac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:48.502314 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe09e4-b659-41e7-85fa-e262944a8ac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:48.512246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe09e4-b659-41e7-85fa-e262944a8ac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:48.513762 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe09e4-b659-41e7-85fa-e262944a8ac5 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:48.524195 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 926/1851] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:48 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:48.525089 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe09e4-b659-41e7-85fa-e262944a8ac5 service cinder] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:48.538427 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe09e4-b659-41e7-85fa-e262944a8ac5 service cinder] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:48.546466 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf1cf1-550d-473f-bf04-982c7bdf3846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:48.549358 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf1cf1-550d-473f-bf04-982c7bdf3846 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:48.549987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf1cf1-550d-473f-bf04-982c7bdf3846 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:48.551157 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf1cf1-550d-473f-bf04-982c7bdf3846 admin admin] PATH_INFO: `/v3/projects/1107cffb673843e898f6116e5ffae2fb/users/a3df887e05b449c9a4589c36d9425aff/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:48.551722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 926/1852] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:59:48 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:48.552625 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6fc23-a547-4b24-ac15-789c3132dfd0 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:48.556621 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf1cf1-550d-473f-bf04-982c7bdf3846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1107cffb673843e898f6116e5ffae2fb, user_id=a3df887e05b449c9a4589c36d9425aff, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:48.561006 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf1cf1-550d-473f-bf04-982c7bdf3846 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:48.575937 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 927/1853] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:48 2022] PUT /identity/v3/projects/1107cffb673843e898f6116e5ffae2fb/users/a3df887e05b449c9a4589c36d9425aff/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:48.587626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5123528-c188-4285-b4a1-3d35223a01c9 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:48.588637 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5123528-c188-4285-b4a1-3d35223a01c9 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:48.589165 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5123528-c188-4285-b4a1-3d35223a01c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:48.623806 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:48.627503 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-c5123528-c188-4285-b4a1-3d35223a01c9 None None] MFA Rules not processed for user `a3df887e05b449c9a4589c36d9425aff`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:48.629501 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-c5123528-c188-4285-b4a1-3d35223a01c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:48.643190 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6fc23-a547-4b24-ac15-789c3132dfd0 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:48.717927 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 928/1854] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 09:59:48.727806 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b8209-2c05-42de-8401-8cdae97e47fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:48.728516 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b8209-2c05-42de-8401-8cdae97e47fe admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:48.729111 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b8209-2c05-42de-8401-8cdae97e47fe admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:48.729233 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b8209-2c05-42de-8401-8cdae97e47fe admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:48.729915 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b8209-2c05-42de-8401-8cdae97e47fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:48.730858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5123528-c188-4285-b4a1-3d35223a01c9 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:48.732127 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b8209-2c05-42de-8401-8cdae97e47fe admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:48.801511 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5123528-c188-4285-b4a1-3d35223a01c9 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:48.805271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322245f3-855f-4904-9487-5bdc95584d63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:48.805881 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322245f3-855f-4904-9487-5bdc95584d63 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:48.806184 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322245f3-855f-4904-9487-5bdc95584d63 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:48.806450 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322245f3-855f-4904-9487-5bdc95584d63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:48.808253 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-322245f3-855f-4904-9487-5bdc95584d63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:48.837090 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 927/1855] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:48 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:48.838510 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b8209-2c05-42de-8401-8cdae97e47fe admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:48.841433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ce0b8209-2c05-42de-8401-8cdae97e47fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:48.855092 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b8209-2c05-42de-8401-8cdae97e47fe admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:48.860326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d9eaf-d61c-4ade-8e1a-3df0e417289b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:48.861614 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d9eaf-d61c-4ade-8e1a-3df0e417289b service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:48.868581 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d9eaf-d61c-4ade-8e1a-3df0e417289b service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:48.868581 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d9eaf-d61c-4ade-8e1a-3df0e417289b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:48.868581 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-952d9eaf-d61c-4ade-8e1a-3df0e417289b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:48.879822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322245f3-855f-4904-9487-5bdc95584d63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:48.881771 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322245f3-855f-4904-9487-5bdc95584d63 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:48.895348 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 929/1856] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:48.896186 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322245f3-855f-4904-9487-5bdc95584d63 service cinder] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:48.911928 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322245f3-855f-4904-9487-5bdc95584d63 service cinder] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:48.918422 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc8ee0-141d-42ef-83ea-2148819589e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:48.920301 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc8ee0-141d-42ef-83ea-2148819589e6 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:48.920301 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc8ee0-141d-42ef-83ea-2148819589e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:48.920301 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc8ee0-141d-42ef-83ea-2148819589e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:48.921314 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc8ee0-141d-42ef-83ea-2148819589e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:48.924308 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc8ee0-141d-42ef-83ea-2148819589e6 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:48.938469 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d9eaf-d61c-4ade-8e1a-3df0e417289b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:48.941829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d9eaf-d61c-4ade-8e1a-3df0e417289b service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:48.955134 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 928/1857] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:48 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:48.964536 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d9eaf-d61c-4ade-8e1a-3df0e417289b service cinder] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:48.979677 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 930/1858] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:48.980111 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d9eaf-d61c-4ade-8e1a-3df0e417289b service cinder] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:48.986361 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc339f3e-3e9c-40b8-8a5c-8b615d33dea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:48.986976 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc339f3e-3e9c-40b8-8a5c-8b615d33dea6 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:48.987250 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc339f3e-3e9c-40b8-8a5c-8b615d33dea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:48.987626 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc339f3e-3e9c-40b8-8a5c-8b615d33dea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:48.989017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc339f3e-3e9c-40b8-8a5c-8b615d33dea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:48.992291 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc339f3e-3e9c-40b8-8a5c-8b615d33dea6 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:49.006071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 929/1859] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:49.007288 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc8ee0-141d-42ef-83ea-2148819589e6 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:49.019552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc8ee0-141d-42ef-83ea-2148819589e6 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:49.024960 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8665363-d421-4ea0-8a2f-e3b223849c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:49.025625 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8665363-d421-4ea0-8a2f-e3b223849c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:49.025904 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8665363-d421-4ea0-8a2f-e3b223849c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:49.026276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8665363-d421-4ea0-8a2f-e3b223849c20 admin admin] PATH_INFO: `/v3/projects/58b61cde0e4b4b38a2be66db4218a29e/users/fab7bb818220424dbfc28b4ea2480f52/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:49.046340 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8665363-d421-4ea0-8a2f-e3b223849c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b61cde0e4b4b38a2be66db4218a29e, user_id=fab7bb818220424dbfc28b4ea2480f52, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:49.051421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8665363-d421-4ea0-8a2f-e3b223849c20 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:49.140292 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 931/1860] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:49 2022] PUT /identity/v3/projects/58b61cde0e4b4b38a2be66db4218a29e/users/fab7bb818220424dbfc28b4ea2480f52/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:49.146703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa25f99-930a-4e72-a62c-e058e581df69 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:49.146983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa25f99-930a-4e72-a62c-e058e581df69 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:49.147352 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa25f99-930a-4e72-a62c-e058e581df69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:49.195412 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-2aa25f99-930a-4e72-a62c-e058e581df69 None None] MFA Rules not processed for user `fab7bb818220424dbfc28b4ea2480f52`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:49.196756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-2aa25f99-930a-4e72-a62c-e058e581df69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:49.261002 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 930/1861] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:49.265252 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8665363-d421-4ea0-8a2f-e3b223849c20 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:49.333989 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8665363-d421-4ea0-8a2f-e3b223849c20 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:49.339359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6436bb1-1367-4e29-aa71-1e87356e2d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:49.340085 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6436bb1-1367-4e29-aa71-1e87356e2d82 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:49.340428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6436bb1-1367-4e29-aa71-1e87356e2d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:49.340765 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6436bb1-1367-4e29-aa71-1e87356e2d82 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:49.341547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6436bb1-1367-4e29-aa71-1e87356e2d82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:49.344802 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6436bb1-1367-4e29-aa71-1e87356e2d82 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:49.463775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 932/1862] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:59:49 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 09:59:49.464905 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa25f99-930a-4e72-a62c-e058e581df69 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:49.487194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa25f99-930a-4e72-a62c-e058e581df69 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:49.548305 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b8908-754c-49f3-a890-5366f01e670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:49.548958 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b8908-754c-49f3-a890-5366f01e670c admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:49.549238 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b8908-754c-49f3-a890-5366f01e670c admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:49.549507 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b8908-754c-49f3-a890-5366f01e670c admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:49.550188 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b8908-754c-49f3-a890-5366f01e670c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:49.552237 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b8908-754c-49f3-a890-5366f01e670c admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:49.613349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6436bb1-1367-4e29-aa71-1e87356e2d82 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:49.615468 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-b6436bb1-1367-4e29-aa71-1e87356e2d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:49.628161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6436bb1-1367-4e29-aa71-1e87356e2d82 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:49.644752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a5caf-fb4f-4972-9711-4d5ebdb42b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:49.644752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a5caf-fb4f-4972-9711-4d5ebdb42b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:49.644752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a5caf-fb4f-4972-9711-4d5ebdb42b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:49.644752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a5caf-fb4f-4972-9711-4d5ebdb42b53 admin admin] PATH_INFO: `/v3/users/766f4726a1324e13ba4736fba9f519d2` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:49.646067 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a5caf-fb4f-4972-9711-4d5ebdb42b53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=766f4726a1324e13ba4736fba9f519d2)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:49.648107 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a5caf-fb4f-4972-9711-4d5ebdb42b53 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:49.671873 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 931/1863] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:49 2022] POST /identity/v3/users => generated 299 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:49.676280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b8908-754c-49f3-a890-5366f01e670c admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:49.688449 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b8908-754c-49f3-a890-5366f01e670c admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:49.694242 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a457856-6a80-4ae3-bb0c-b021396b83a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:49.694744 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a457856-6a80-4ae3-bb0c-b021396b83a1 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:49.695024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a457856-6a80-4ae3-bb0c-b021396b83a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:49.697720 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a457856-6a80-4ae3-bb0c-b021396b83a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:49.697720 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a457856-6a80-4ae3-bb0c-b021396b83a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:49.698391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a457856-6a80-4ae3-bb0c-b021396b83a1 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:49.716552 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 932/1864] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:49.723123 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a457856-6a80-4ae3-bb0c-b021396b83a1 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:49.740893 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a457856-6a80-4ae3-bb0c-b021396b83a1 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:49.750514 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8ae41-ffe8-422a-a67f-779f264c026b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:49.759314 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8ae41-ffe8-422a-a67f-779f264c026b admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:49.759314 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8ae41-ffe8-422a-a67f-779f264c026b admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:49.759314 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8ae41-ffe8-422a-a67f-779f264c026b admin admin] PATH_INFO: `/v3/projects/a5e8b626faa541c3bda8f04ae6403607/users/9906d905d8b04bb69ef5f9ac8c8c28c3/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:49.784914 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8ae41-ffe8-422a-a67f-779f264c026b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e8b626faa541c3bda8f04ae6403607, user_id=9906d905d8b04bb69ef5f9ac8c8c28c3, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:49.787882 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8ae41-ffe8-422a-a67f-779f264c026b admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:49.865824 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 933/1865] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:49 2022] PUT /identity/v3/projects/a5e8b626faa541c3bda8f04ae6403607/users/9906d905d8b04bb69ef5f9ac8c8c28c3/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:49.867109 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8ae41-ffe8-422a-a67f-779f264c026b admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:49.933703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8ae41-ffe8-422a-a67f-779f264c026b admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:49.939218 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca2b42-ab38-4909-b5a5-ce9d1fe48c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:49.939914 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca2b42-ab38-4909-b5a5-ce9d1fe48c94 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:49.940194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca2b42-ab38-4909-b5a5-ce9d1fe48c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:49.940462 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca2b42-ab38-4909-b5a5-ce9d1fe48c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:49.941634 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca2b42-ab38-4909-b5a5-ce9d1fe48c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:49.943602 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca2b42-ab38-4909-b5a5-ce9d1fe48c94 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:49.954384 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 934/1866] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:49.955680 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe34e88-e73f-4cd8-abf4-6eb8b8636226 None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:49.956026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe34e88-e73f-4cd8-abf4-6eb8b8636226 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:49.956306 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe34e88-e73f-4cd8-abf4-6eb8b8636226 None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:49.958362 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 935/1867] 10.222.0.13 () {54 vars in 921 bytes} [Thu Aug 11 09:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 09:59:49.959050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe34e88-e73f-4cd8-abf4-6eb8b8636226 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:49.973094 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe34e88-e73f-4cd8-abf4-6eb8b8636226 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:49.977855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6003ad7-9427-42bf-a02c-fddc154f7543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:49.978569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6003ad7-9427-42bf-a02c-fddc154f7543 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:49.978848 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6003ad7-9427-42bf-a02c-fddc154f7543 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:49.979124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6003ad7-9427-42bf-a02c-fddc154f7543 admin admin] PATH_INFO: `/v3/projects/a5e8b626faa541c3bda8f04ae6403607/users/9906d905d8b04bb69ef5f9ac8c8c28c3/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:49.982532 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6003ad7-9427-42bf-a02c-fddc154f7543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e8b626faa541c3bda8f04ae6403607, user_id=9906d905d8b04bb69ef5f9ac8c8c28c3, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:49.985184 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6003ad7-9427-42bf-a02c-fddc154f7543 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:50.000564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 936/1868] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:49 2022] PUT /identity/v3/projects/a5e8b626faa541c3bda8f04ae6403607/users/9906d905d8b04bb69ef5f9ac8c8c28c3/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:50.000564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbab280-7951-4ef6-ad70-2ea5918f379a None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:50.000564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbab280-7951-4ef6-ad70-2ea5918f379a None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:50.000564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbab280-7951-4ef6-ad70-2ea5918f379a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:50.017202 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-df5a5caf-fb4f-4972-9711-4d5ebdb42b53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '766f4726a1324e13ba4736fba9f519d2'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:50.032608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-ddbab280-7951-4ef6-ad70-2ea5918f379a None None] MFA Rules not processed for user `4c1dc8e0d9454ad98894ed1e8d31f931`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:50.033877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ddbab280-7951-4ef6-ad70-2ea5918f379a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:50.035024 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:INSERT=4,keystone:SELECT=91,keystone:DELETE=5 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:50.047124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-df5a5caf-fb4f-4972-9711-4d5ebdb42b53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '766f4726a1324e13ba4736fba9f519d2'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:50.048165 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-df5a5caf-fb4f-4972-9711-4d5ebdb42b53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '766f4726a1324e13ba4736fba9f519d2'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:50.058648 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-df5a5caf-fb4f-4972-9711-4d5ebdb42b53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '766f4726a1324e13ba4736fba9f519d2'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:50.118640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 937/1869] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Aug 11 09:59:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:50.120673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c0d82-758a-43f7-90a6-d42d3ef37f01 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:50.120673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c0d82-758a-43f7-90a6-d42d3ef37f01 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:50.120673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c0d82-758a-43f7-90a6-d42d3ef37f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:50.157500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-df5a5caf-fb4f-4972-9711-4d5ebdb42b53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '766f4726a1324e13ba4736fba9f519d2'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:50.159562 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-307c0d82-758a-43f7-90a6-d42d3ef37f01 None None] MFA Rules not processed for user `9906d905d8b04bb69ef5f9ac8c8c28c3`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:50.160954 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-307c0d82-758a-43f7-90a6-d42d3ef37f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:50.174212 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 933/1870] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:59:49 2022] DELETE /identity/v3/users/766f4726a1324e13ba4736fba9f519d2 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 09:59:50.180617 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e7b42-ccec-418d-9413-4ea2795c44c4 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:50.187285 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e7b42-ccec-418d-9413-4ea2795c44c4 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:50.187285 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e7b42-ccec-418d-9413-4ea2795c44c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:50.208154 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:50.208583 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-8c3e7b42-ccec-418d-9413-4ea2795c44c4 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:50.210594 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-8c3e7b42-ccec-418d-9413-4ea2795c44c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:50.295451 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 938/1871] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:50.296601 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c0d82-758a-43f7-90a6-d42d3ef37f01 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:50.300025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-307c0d82-758a-43f7-90a6-d42d3ef37f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:50.320556 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 934/1872] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:50.320556 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e7b42-ccec-418d-9413-4ea2795c44c4 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:50.320556 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-8c3e7b42-ccec-418d-9413-4ea2795c44c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:50.322692 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c0d82-758a-43f7-90a6-d42d3ef37f01 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:50.399311 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e7b42-ccec-418d-9413-4ea2795c44c4 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:50.404197 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73191b-344a-47bc-8d88-c6efdc827525 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:50.404613 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b842ed2-c563-4edc-a457-c7d938bc1b12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:50.404971 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73191b-344a-47bc-8d88-c6efdc827525 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:50.405406 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73191b-344a-47bc-8d88-c6efdc827525 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:50.405751 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73191b-344a-47bc-8d88-c6efdc827525 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:50.405937 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b842ed2-c563-4edc-a457-c7d938bc1b12 service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:50.406380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b842ed2-c563-4edc-a457-c7d938bc1b12 service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:50.406799 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b842ed2-c563-4edc-a457-c7d938bc1b12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:50.409038 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-7b842ed2-c563-4edc-a457-c7d938bc1b12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:50.428394 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b842ed2-c563-4edc-a457-c7d938bc1b12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:50.428617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b842ed2-c563-4edc-a457-c7d938bc1b12 service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:50.440898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 939/1873] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:50.441971 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b842ed2-c563-4edc-a457-c7d938bc1b12 service nova] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:50.443411 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-7b842ed2-c563-4edc-a457-c7d938bc1b12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:50.491646 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73191b-344a-47bc-8d88-c6efdc827525 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:50.493224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73191b-344a-47bc-8d88-c6efdc827525 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:50.507510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 935/1874] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:50.509323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b842ed2-c563-4edc-a457-c7d938bc1b12 service nova] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:50.513179 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30c46e-2faa-4dd4-b8c0-a4b1fb3882bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:50.513825 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30c46e-2faa-4dd4-b8c0-a4b1fb3882bb service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:50.514196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30c46e-2faa-4dd4-b8c0-a4b1fb3882bb service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:50.514561 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30c46e-2faa-4dd4-b8c0-a4b1fb3882bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:50.527249 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30c46e-2faa-4dd4-b8c0-a4b1fb3882bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:50.528750 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30c46e-2faa-4dd4-b8c0-a4b1fb3882bb service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:50.546210 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73191b-344a-47bc-8d88-c6efdc827525 service cinder] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:50.547747 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-3b73191b-344a-47bc-8d88-c6efdc827525 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:50.568436 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 940/1875] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:50.571006 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73191b-344a-47bc-8d88-c6efdc827525 service cinder] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:50.583953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532b5de-024e-487d-a538-f6de59902e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:50.584683 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532b5de-024e-487d-a538-f6de59902e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:50.585853 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532b5de-024e-487d-a538-f6de59902e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:50.586139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532b5de-024e-487d-a538-f6de59902e83 admin admin] PATH_INFO: `/v3/users/fab7bb818220424dbfc28b4ea2480f52` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:50.587858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532b5de-024e-487d-a538-f6de59902e83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fab7bb818220424dbfc28b4ea2480f52)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:50.589813 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532b5de-024e-487d-a538-f6de59902e83 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:50.737009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30c46e-2faa-4dd4-b8c0-a4b1fb3882bb service neutron] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:50.756397 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30c46e-2faa-4dd4-b8c0-a4b1fb3882bb service neutron] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:50.762858 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783b5b4-1f39-4c60-ab1e-e3575e771de0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:50.763136 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783b5b4-1f39-4c60-ab1e-e3575e771de0 service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:50.763565 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783b5b4-1f39-4c60-ab1e-e3575e771de0 service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:50.763843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783b5b4-1f39-4c60-ab1e-e3575e771de0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:50.766628 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-9783b5b4-1f39-4c60-ab1e-e3575e771de0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:50.833566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c532b5de-024e-487d-a538-f6de59902e83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fab7bb818220424dbfc28b4ea2480f52'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:50.849598 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c532b5de-024e-487d-a538-f6de59902e83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fab7bb818220424dbfc28b4ea2480f52'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:50.850454 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c532b5de-024e-487d-a538-f6de59902e83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fab7bb818220424dbfc28b4ea2480f52'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:50.858650 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c532b5de-024e-487d-a538-f6de59902e83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fab7bb818220424dbfc28b4ea2480f52'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:50.866984 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783b5b4-1f39-4c60-ab1e-e3575e771de0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:50.868643 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783b5b4-1f39-4c60-ab1e-e3575e771de0 service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:50.884936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 941/1876] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 09:59:50.962043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c532b5de-024e-487d-a538-f6de59902e83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fab7bb818220424dbfc28b4ea2480f52'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:50.983671 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 936/1877] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:59:50 2022] DELETE /identity/v3/users/fab7bb818220424dbfc28b4ea2480f52 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:50.988880 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74d0f5-f330-4a31-b551-f4c34112f9a3 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:50.989169 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74d0f5-f330-4a31-b551-f4c34112f9a3 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:50.989442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74d0f5-f330-4a31-b551-f4c34112f9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:51.023346 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-0d74d0f5-f330-4a31-b551-f4c34112f9a3 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:51.025675 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-0d74d0f5-f330-4a31-b551-f4c34112f9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:51.095132 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 942/1878] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:51.106947 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532b5de-024e-487d-a538-f6de59902e83 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:51.108504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-c532b5de-024e-487d-a538-f6de59902e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:51.214062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532b5de-024e-487d-a538-f6de59902e83 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:51.217805 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641a0f1-ef0e-4c10-9ef3-02604df8cf30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:51.218511 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641a0f1-ef0e-4c10-9ef3-02604df8cf30 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:51.218787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641a0f1-ef0e-4c10-9ef3-02604df8cf30 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:51.219054 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641a0f1-ef0e-4c10-9ef3-02604df8cf30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:51.228857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641a0f1-ef0e-4c10-9ef3-02604df8cf30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:51.230456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641a0f1-ef0e-4c10-9ef3-02604df8cf30 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:51.240116 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 937/1879] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:51.268434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74d0f5-f330-4a31-b551-f4c34112f9a3 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:51.270658 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-0d74d0f5-f330-4a31-b551-f4c34112f9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:51.295955 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74d0f5-f330-4a31-b551-f4c34112f9a3 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:51.306598 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d5c87-4ff1-4f45-bffa-6b0435c18044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:51.308947 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d5c87-4ff1-4f45-bffa-6b0435c18044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:51.309749 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d5c87-4ff1-4f45-bffa-6b0435c18044 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:51.312540 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d5c87-4ff1-4f45-bffa-6b0435c18044 admin admin] PATH_INFO: `/v3/projects/46ca9bf784d544a299896a3df196c504` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:51.313537 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d5c87-4ff1-4f45-bffa-6b0435c18044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ca9bf784d544a299896a3df196c504)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:51.318863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d5c87-4ff1-4f45-bffa-6b0435c18044 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:51.484084 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ae2d5c87-4ff1-4f45-bffa-6b0435c18044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ca9bf784d544a299896a3df196c504', 'request_id': 'req-ae2d5c87-4ff1-4f45-bffa-6b0435c18044'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:51.496359 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ae2d5c87-4ff1-4f45-bffa-6b0435c18044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ca9bf784d544a299896a3df196c504', 'request_id': 'req-ae2d5c87-4ff1-4f45-bffa-6b0435c18044'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:51.578586 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ae2d5c87-4ff1-4f45-bffa-6b0435c18044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ca9bf784d544a299896a3df196c504', 'request_id': 'req-ae2d5c87-4ff1-4f45-bffa-6b0435c18044'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:51.610108 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ae2d5c87-4ff1-4f45-bffa-6b0435c18044 admin admin] The token cache is being invalidate because project 46ca9bf784d544a299896a3df196c504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 09:59:51.610108 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ae2d5c87-4ff1-4f45-bffa-6b0435c18044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:51.610108 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ae2d5c87-4ff1-4f45-bffa-6b0435c18044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:51.610108 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 943/1880] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:59:51 2022] DELETE /identity/v3/projects/46ca9bf784d544a299896a3df196c504 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:51.613351 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641a0f1-ef0e-4c10-9ef3-02604df8cf30 service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:51.617224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641a0f1-ef0e-4c10-9ef3-02604df8cf30 service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:51.690378 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb91ab-b93d-4474-bd3a-de0cbf2f49b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:51.691826 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb91ab-b93d-4474-bd3a-de0cbf2f49b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:51.692289 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb91ab-b93d-4474-bd3a-de0cbf2f49b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:51.692641 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb91ab-b93d-4474-bd3a-de0cbf2f49b5 admin admin] PATH_INFO: `/v3/users/33cf7288edd2469bbad2adf2cd2398f1` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:51.693838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb91ab-b93d-4474-bd3a-de0cbf2f49b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33cf7288edd2469bbad2adf2cd2398f1)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:51.695859 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb91ab-b93d-4474-bd3a-de0cbf2f49b5 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:51.840746 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d5c87-4ff1-4f45-bffa-6b0435c18044 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:51.842530 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ae2d5c87-4ff1-4f45-bffa-6b0435c18044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:51.865757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d5c87-4ff1-4f45-bffa-6b0435c18044 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:51.873873 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9417927-13c8-49e6-b418-f64e1f40cf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:51.874655 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9417927-13c8-49e6-b418-f64e1f40cf8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:51.875030 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9417927-13c8-49e6-b418-f64e1f40cf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:51.875418 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9417927-13c8-49e6-b418-f64e1f40cf8d admin admin] PATH_INFO: `/v3/projects/58b61cde0e4b4b38a2be66db4218a29e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:51.876922 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9417927-13c8-49e6-b418-f64e1f40cf8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=58b61cde0e4b4b38a2be66db4218a29e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:51.887780 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9417927-13c8-49e6-b418-f64e1f40cf8d admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:51.915748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-96cb91ab-b93d-4474-bd3a-de0cbf2f49b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33cf7288edd2469bbad2adf2cd2398f1'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:51.933189 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-96cb91ab-b93d-4474-bd3a-de0cbf2f49b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33cf7288edd2469bbad2adf2cd2398f1'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:51.934136 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-96cb91ab-b93d-4474-bd3a-de0cbf2f49b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33cf7288edd2469bbad2adf2cd2398f1'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:51.942059 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-96cb91ab-b93d-4474-bd3a-de0cbf2f49b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33cf7288edd2469bbad2adf2cd2398f1'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:52.022228 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-b9417927-13c8-49e6-b418-f64e1f40cf8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58b61cde0e4b4b38a2be66db4218a29e', 'request_id': 'req-b9417927-13c8-49e6-b418-f64e1f40cf8d'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:52.027761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-b9417927-13c8-49e6-b418-f64e1f40cf8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58b61cde0e4b4b38a2be66db4218a29e', 'request_id': 'req-b9417927-13c8-49e6-b418-f64e1f40cf8d'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:52.033334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-96cb91ab-b93d-4474-bd3a-de0cbf2f49b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33cf7288edd2469bbad2adf2cd2398f1'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:52.049187 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 938/1881] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:59:51 2022] DELETE /identity/v3/users/33cf7288edd2469bbad2adf2cd2398f1 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:52.106803 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-b9417927-13c8-49e6-b418-f64e1f40cf8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58b61cde0e4b4b38a2be66db4218a29e', 'request_id': 'req-b9417927-13c8-49e6-b418-f64e1f40cf8d'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:52.118459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-b9417927-13c8-49e6-b418-f64e1f40cf8d admin admin] The token cache is being invalidate because project 58b61cde0e4b4b38a2be66db4218a29e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 09:59:52.118749 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-b9417927-13c8-49e6-b418-f64e1f40cf8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:52.119412 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-b9417927-13c8-49e6-b418-f64e1f40cf8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:52.121163 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 944/1882] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:59:51 2022] DELETE /identity/v3/projects/58b61cde0e4b4b38a2be66db4218a29e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 09:59:52.125169 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb91ab-b93d-4474-bd3a-de0cbf2f49b5 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:52.126620 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-96cb91ab-b93d-4474-bd3a-de0cbf2f49b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:52.188852 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb91ab-b93d-4474-bd3a-de0cbf2f49b5 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:52.202850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2321711-9055-4f28-84e8-7171beebacbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:52.203564 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2321711-9055-4f28-84e8-7171beebacbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:52.203846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2321711-9055-4f28-84e8-7171beebacbe admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:52.204125 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2321711-9055-4f28-84e8-7171beebacbe admin admin] PATH_INFO: `/v3/users/9906d905d8b04bb69ef5f9ac8c8c28c3` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:52.205541 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2321711-9055-4f28-84e8-7171beebacbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=9906d905d8b04bb69ef5f9ac8c8c28c3)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:52.208185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2321711-9055-4f28-84e8-7171beebacbe admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:52.374911 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c2321711-9055-4f28-84e8-7171beebacbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9906d905d8b04bb69ef5f9ac8c8c28c3'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:52.393289 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c2321711-9055-4f28-84e8-7171beebacbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9906d905d8b04bb69ef5f9ac8c8c28c3'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:52.394154 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c2321711-9055-4f28-84e8-7171beebacbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9906d905d8b04bb69ef5f9ac8c8c28c3'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:52.403311 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c2321711-9055-4f28-84e8-7171beebacbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9906d905d8b04bb69ef5f9ac8c8c28c3'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:52.518270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c2321711-9055-4f28-84e8-7171beebacbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9906d905d8b04bb69ef5f9ac8c8c28c3'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:52.525758 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9417927-13c8-49e6-b418-f64e1f40cf8d admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:52.527441 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-b9417927-13c8-49e6-b418-f64e1f40cf8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:52.533384 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 939/1883] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:59:52 2022] DELETE /identity/v3/users/9906d905d8b04bb69ef5f9ac8c8c28c3 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:52.597451 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9417927-13c8-49e6-b418-f64e1f40cf8d admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:52.684427 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad7264-e1a9-40bf-986d-fd517a02edc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:52.685280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad7264-e1a9-40bf-986d-fd517a02edc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:52.685774 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad7264-e1a9-40bf-986d-fd517a02edc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:52.686161 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad7264-e1a9-40bf-986d-fd517a02edc3 admin admin] PATH_INFO: `/v3/projects/7797709d35734120ac56373fff16786a` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:52.687556 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad7264-e1a9-40bf-986d-fd517a02edc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7797709d35734120ac56373fff16786a)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:52.690222 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad7264-e1a9-40bf-986d-fd517a02edc3 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:52.860605 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-55ad7264-e1a9-40bf-986d-fd517a02edc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7797709d35734120ac56373fff16786a', 'request_id': 'req-55ad7264-e1a9-40bf-986d-fd517a02edc3'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:52.868606 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-55ad7264-e1a9-40bf-986d-fd517a02edc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7797709d35734120ac56373fff16786a', 'request_id': 'req-55ad7264-e1a9-40bf-986d-fd517a02edc3'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:53.024512 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-55ad7264-e1a9-40bf-986d-fd517a02edc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7797709d35734120ac56373fff16786a', 'request_id': 'req-55ad7264-e1a9-40bf-986d-fd517a02edc3'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:53.049995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-55ad7264-e1a9-40bf-986d-fd517a02edc3 admin admin] The token cache is being invalidate because project 7797709d35734120ac56373fff16786a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 09:59:53.051919 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-55ad7264-e1a9-40bf-986d-fd517a02edc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:53.053794 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-55ad7264-e1a9-40bf-986d-fd517a02edc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:53.055656 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 945/1884] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:59:52 2022] DELETE /identity/v3/projects/7797709d35734120ac56373fff16786a => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:53.062512 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2321711-9055-4f28-84e8-7171beebacbe admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:53.064018 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-c2321711-9055-4f28-84e8-7171beebacbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:53.067273 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fea0c-d005-4f75-848c-de7d735d36c0 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:53.067555 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fea0c-d005-4f75-848c-de7d735d36c0 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:53.067887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fea0c-d005-4f75-848c-de7d735d36c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:53.091088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2321711-9055-4f28-84e8-7171beebacbe admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:53.105578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-970fea0c-d005-4f75-848c-de7d735d36c0 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:53.106593 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-970fea0c-d005-4f75-848c-de7d735d36c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:53.136777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:53.213698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 946/1885] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:53.223652 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0355979-f8ae-4b2a-9989-b6d241947f8b None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:53.223966 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0355979-f8ae-4b2a-9989-b6d241947f8b None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:53.224871 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0355979-f8ae-4b2a-9989-b6d241947f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:53.248535 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-f0355979-f8ae-4b2a-9989-b6d241947f8b None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:53.249867 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-f0355979-f8ae-4b2a-9989-b6d241947f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:53.253759 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a8f5e-12bd-4a58-bf54-649c570c9db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:53.258701 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 947/1886] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:53.260850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a8f5e-12bd-4a58-bf54-649c570c9db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:53.264697 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a8f5e-12bd-4a58-bf54-649c570c9db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:53.264697 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a8f5e-12bd-4a58-bf54-649c570c9db3 admin admin] PATH_INFO: `/v3/projects/a5e8b626faa541c3bda8f04ae6403607` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:53.264697 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a8f5e-12bd-4a58-bf54-649c570c9db3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5e8b626faa541c3bda8f04ae6403607)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:53.264697 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a8f5e-12bd-4a58-bf54-649c570c9db3 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:53.267448 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0355979-f8ae-4b2a-9989-b6d241947f8b None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:53.277137 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0355979-f8ae-4b2a-9989-b6d241947f8b None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:53.281776 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011a890-aba3-4df5-a349-582ee8484238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:53.282548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011a890-aba3-4df5-a349-582ee8484238 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:53.282824 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011a890-aba3-4df5-a349-582ee8484238 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:53.283088 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011a890-aba3-4df5-a349-582ee8484238 admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:53.283750 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011a890-aba3-4df5-a349-582ee8484238 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:59:53.284106 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011a890-aba3-4df5-a349-582ee8484238 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:53.286329 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011a890-aba3-4df5-a349-582ee8484238 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:53.298173 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 948/1887] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 09:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 09:59:53.302459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011a890-aba3-4df5-a349-582ee8484238 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:53.311843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011a890-aba3-4df5-a349-582ee8484238 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:53.316656 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f756d90-ad01-47fe-b8eb-a0af89a43f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:53.317464 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f756d90-ad01-47fe-b8eb-a0af89a43f16 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:53.319138 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:53.319634 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f756d90-ad01-47fe-b8eb-a0af89a43f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:53.319970 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f756d90-ad01-47fe-b8eb-a0af89a43f16 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:53.320594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f756d90-ad01-47fe-b8eb-a0af89a43f16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:53.322617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f756d90-ad01-47fe-b8eb-a0af89a43f16 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:53.411654 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-f76a8f5e-12bd-4a58-bf54-649c570c9db3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5e8b626faa541c3bda8f04ae6403607', 'request_id': 'req-f76a8f5e-12bd-4a58-bf54-649c570c9db3'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:53.416968 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-f76a8f5e-12bd-4a58-bf54-649c570c9db3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5e8b626faa541c3bda8f04ae6403607', 'request_id': 'req-f76a8f5e-12bd-4a58-bf54-649c570c9db3'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:53.423530 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-f76a8f5e-12bd-4a58-bf54-649c570c9db3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5e8b626faa541c3bda8f04ae6403607', 'request_id': 'req-f76a8f5e-12bd-4a58-bf54-649c570c9db3'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:53.428343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 949/1888] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:59:53 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 09:59:53.434540 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f756d90-ad01-47fe-b8eb-a0af89a43f16 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:53.497942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f756d90-ad01-47fe-b8eb-a0af89a43f16 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:53.503036 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e033e-7234-43e3-b792-495f82c82678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:53.504156 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e033e-7234-43e3-b792-495f82c82678 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:53.505394 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e033e-7234-43e3-b792-495f82c82678 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:53.505394 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e033e-7234-43e3-b792-495f82c82678 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:53.505394 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e033e-7234-43e3-b792-495f82c82678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:53.507418 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e033e-7234-43e3-b792-495f82c82678 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:53.527268 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-f76a8f5e-12bd-4a58-bf54-649c570c9db3 admin admin] The token cache is being invalidate because project a5e8b626faa541c3bda8f04ae6403607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 09:59:53.529988 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-f76a8f5e-12bd-4a58-bf54-649c570c9db3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:53.530993 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-f76a8f5e-12bd-4a58-bf54-649c570c9db3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:53.532543 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 940/1889] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:59:53 2022] DELETE /identity/v3/projects/a5e8b626faa541c3bda8f04ae6403607 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:53.537221 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a570ca-4307-4153-ab9b-a33579dcd86c None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:53.537507 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a570ca-4307-4153-ab9b-a33579dcd86c None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:53.537784 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a570ca-4307-4153-ab9b-a33579dcd86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:53.559598 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-b4a570ca-4307-4153-ab9b-a33579dcd86c None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:53.561316 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-b4a570ca-4307-4153-ab9b-a33579dcd86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:53.574195 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 941/1890] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 09:59:53.579762 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60927ca5-c2bd-4732-b6c4-90fa8d28ad22 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:53.580047 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60927ca5-c2bd-4732-b6c4-90fa8d28ad22 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:53.580318 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60927ca5-c2bd-4732-b6c4-90fa8d28ad22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:53.593143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 950/1891] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:53 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 09:59:53.599652 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e033e-7234-43e3-b792-495f82c82678 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:53.601335 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-048e033e-7234-43e3-b792-495f82c82678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:53.603324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-60927ca5-c2bd-4732-b6c4-90fa8d28ad22 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:53.604498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-60927ca5-c2bd-4732-b6c4-90fa8d28ad22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:53.613949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 942/1892] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 09:59:53.617134 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e033e-7234-43e3-b792-495f82c82678 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:53.618292 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60927ca5-c2bd-4732-b6c4-90fa8d28ad22 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:53.619177 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63ab39-1371-4872-ad73-2e21b9b35e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:53.622759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63ab39-1371-4872-ad73-2e21b9b35e47 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:53.622759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63ab39-1371-4872-ad73-2e21b9b35e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:53.622759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63ab39-1371-4872-ad73-2e21b9b35e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:53.622759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63ab39-1371-4872-ad73-2e21b9b35e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:53.622759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63ab39-1371-4872-ad73-2e21b9b35e47 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:53.629646 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60927ca5-c2bd-4732-b6c4-90fa8d28ad22 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:53.635418 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f5b0c-789c-42a6-a126-18401da9e348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:53.636107 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f5b0c-789c-42a6-a126-18401da9e348 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:53.636457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f5b0c-789c-42a6-a126-18401da9e348 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:53.636813 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f5b0c-789c-42a6-a126-18401da9e348 admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:53.637216 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 951/1893] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 09:59:53.638054 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f5b0c-789c-42a6-a126-18401da9e348 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:59:53.638207 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63ab39-1371-4872-ad73-2e21b9b35e47 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:53.638732 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f5b0c-789c-42a6-a126-18401da9e348 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:53.640812 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f5b0c-789c-42a6-a126-18401da9e348 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:53.651209 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63ab39-1371-4872-ad73-2e21b9b35e47 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:53.660893 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa27bdf-a923-47f2-83c3-49f014d9219e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:53.661518 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa27bdf-a923-47f2-83c3-49f014d9219e admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:53.662181 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa27bdf-a923-47f2-83c3-49f014d9219e admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:53.662181 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa27bdf-a923-47f2-83c3-49f014d9219e admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:53.663260 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa27bdf-a923-47f2-83c3-49f014d9219e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:53.664990 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa27bdf-a923-47f2-83c3-49f014d9219e admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:53.668970 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 943/1894] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 09:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:59:53.674597 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f5b0c-789c-42a6-a126-18401da9e348 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:53.677067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 952/1895] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:53.681130 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa27bdf-a923-47f2-83c3-49f014d9219e admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:53.692773 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa27bdf-a923-47f2-83c3-49f014d9219e admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:53.698733 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18abb50-f6ff-4d1a-8369-0c9192950432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:53.700324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18abb50-f6ff-4d1a-8369-0c9192950432 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:53.700438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f5b0c-789c-42a6-a126-18401da9e348 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:53.700549 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18abb50-f6ff-4d1a-8369-0c9192950432 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:53.700549 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18abb50-f6ff-4d1a-8369-0c9192950432 admin admin] PATH_INFO: `/v3/projects/89d6b7ff518947a8adcef9d584f17802/users/88824e1357874990a108caf63e2d0cb3/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:53.713255 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d2080-d32c-4b2a-8ce0-171038ef5b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:53.714198 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d2080-d32c-4b2a-8ce0-171038ef5b81 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:53.714478 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d2080-d32c-4b2a-8ce0-171038ef5b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:53.714814 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d2080-d32c-4b2a-8ce0-171038ef5b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:53.715671 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d2080-d32c-4b2a-8ce0-171038ef5b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:53.716941 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18abb50-f6ff-4d1a-8369-0c9192950432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d6b7ff518947a8adcef9d584f17802, user_id=88824e1357874990a108caf63e2d0cb3, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:53.717933 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d2080-d32c-4b2a-8ce0-171038ef5b81 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:53.719927 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18abb50-f6ff-4d1a-8369-0c9192950432 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:53.813164 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 953/1896] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:53 2022] PUT /identity/v3/projects/89d6b7ff518947a8adcef9d584f17802/users/88824e1357874990a108caf63e2d0cb3/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 09:59:53.815681 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 944/1897] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:59:53 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:53.820213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18abb50-f6ff-4d1a-8369-0c9192950432 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:53.823851 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1da335-5e49-4ae9-987d-56faacfdb67a None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:53.824223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1da335-5e49-4ae9-987d-56faacfdb67a None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:53.824593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1da335-5e49-4ae9-987d-56faacfdb67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:53.852598 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-4c1da335-5e49-4ae9-987d-56faacfdb67a None None] MFA Rules not processed for user `88824e1357874990a108caf63e2d0cb3`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:53.853999 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-4c1da335-5e49-4ae9-987d-56faacfdb67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:53.934506 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18abb50-f6ff-4d1a-8369-0c9192950432 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:53.948550 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 945/1898] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 09:59:53.950344 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1da335-5e49-4ae9-987d-56faacfdb67a None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:54.050827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9f2ea-1010-44be-9f17-40e9827deff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:54.051469 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9f2ea-1010-44be-9f17-40e9827deff0 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:54.051745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9f2ea-1010-44be-9f17-40e9827deff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:54.052145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9f2ea-1010-44be-9f17-40e9827deff0 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:54.053680 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9f2ea-1010-44be-9f17-40e9827deff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:54.055796 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9f2ea-1010-44be-9f17-40e9827deff0 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:54.077557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1da335-5e49-4ae9-987d-56faacfdb67a None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:54.083140 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f7d7f-b5ea-4217-b043-3d805bb45c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:54.083973 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f7d7f-b5ea-4217-b043-3d805bb45c99 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:54.084260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f7d7f-b5ea-4217-b043-3d805bb45c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:54.084710 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f7d7f-b5ea-4217-b043-3d805bb45c99 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:54.085354 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f7d7f-b5ea-4217-b043-3d805bb45c99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:54.087964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f7d7f-b5ea-4217-b043-3d805bb45c99 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:54.181826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 954/1899] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:53 2022] POST /identity/v3/users => generated 291 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:54.185873 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9f2ea-1010-44be-9f17-40e9827deff0 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:54.199013 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9f2ea-1010-44be-9f17-40e9827deff0 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:54.205086 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a03a7-09e9-47f4-a7b3-5c203f02154e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:54.205980 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a03a7-09e9-47f4-a7b3-5c203f02154e admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:54.206343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a03a7-09e9-47f4-a7b3-5c203f02154e admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:54.215992 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a03a7-09e9-47f4-a7b3-5c203f02154e admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:54.215992 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a03a7-09e9-47f4-a7b3-5c203f02154e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:54.215992 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a03a7-09e9-47f4-a7b3-5c203f02154e admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:54.216672 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 946/1900] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:59:53 2022] POST /identity/v3/projects => generated 379 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 09:59:54.217463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f7d7f-b5ea-4217-b043-3d805bb45c99 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:54.225819 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 955/1901] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 09:59:54.230014 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a03a7-09e9-47f4-a7b3-5c203f02154e admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:54.243393 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a03a7-09e9-47f4-a7b3-5c203f02154e admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:54.315330 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be1d7b-b856-499d-b744-92d9fb681a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:54.316921 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be1d7b-b856-499d-b744-92d9fb681a1e admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:54.317464 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be1d7b-b856-499d-b744-92d9fb681a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:54.318274 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be1d7b-b856-499d-b744-92d9fb681a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:54.319151 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be1d7b-b856-499d-b744-92d9fb681a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:54.320379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f7d7f-b5ea-4217-b043-3d805bb45c99 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:54.321245 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be1d7b-b856-499d-b744-92d9fb681a1e admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:54.326325 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ae3e1-6f63-4eab-8c36-9c38b853996f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:54.326951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae3e1-6f63-4eab-8c36-9c38b853996f admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:54.327233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae3e1-6f63-4eab-8c36-9c38b853996f admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:54.327506 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae3e1-6f63-4eab-8c36-9c38b853996f admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:54.328234 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ae3e1-6f63-4eab-8c36-9c38b853996f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:54.330317 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ae3e1-6f63-4eab-8c36-9c38b853996f admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:54.334882 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 956/1902] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 09:59:54.339612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be1d7b-b856-499d-b744-92d9fb681a1e admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:54.350787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be1d7b-b856-499d-b744-92d9fb681a1e admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:54.356961 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cac90-1a2b-48ce-9666-51ee48b0714c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:54.357813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cac90-1a2b-48ce-9666-51ee48b0714c admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:54.358104 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cac90-1a2b-48ce-9666-51ee48b0714c admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:54.358487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cac90-1a2b-48ce-9666-51ee48b0714c admin admin] PATH_INFO: `/v3/projects/8a0aa9a2014e4a85880e8bd4995cce1f/users/9dd97a7c21a8409197267e4c888bf1ff/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:54.374533 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cac90-1a2b-48ce-9666-51ee48b0714c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a0aa9a2014e4a85880e8bd4995cce1f, user_id=9dd97a7c21a8409197267e4c888bf1ff, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:54.377258 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cac90-1a2b-48ce-9666-51ee48b0714c admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:54.444048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 947/1903] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:54 2022] POST /identity/v3/users => generated 296 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 09:59:54.447764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ae3e1-6f63-4eab-8c36-9c38b853996f admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:54.460103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ae3e1-6f63-4eab-8c36-9c38b853996f admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:54.465564 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64b480-a7bd-43b3-8ace-8a8e2f5f831f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:54.466573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64b480-a7bd-43b3-8ace-8a8e2f5f831f admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:54.467325 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64b480-a7bd-43b3-8ace-8a8e2f5f831f admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:54.468424 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64b480-a7bd-43b3-8ace-8a8e2f5f831f admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:54.468894 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64b480-a7bd-43b3-8ace-8a8e2f5f831f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:54.470725 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64b480-a7bd-43b3-8ace-8a8e2f5f831f admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:54.483967 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 948/1904] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:54.488327 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64b480-a7bd-43b3-8ace-8a8e2f5f831f admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:54.505547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 957/1905] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:54 2022] PUT /identity/v3/projects/8a0aa9a2014e4a85880e8bd4995cce1f/users/9dd97a7c21a8409197267e4c888bf1ff/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 09:59:54.505835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64b480-a7bd-43b3-8ace-8a8e2f5f831f admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:54.521194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513fe20-9980-4c84-8ae8-4bdfc086fc04 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:54.521535 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513fe20-9980-4c84-8ae8-4bdfc086fc04 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:54.521949 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513fe20-9980-4c84-8ae8-4bdfc086fc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:54.551747 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-f513fe20-9980-4c84-8ae8-4bdfc086fc04 None None] MFA Rules not processed for user `9dd97a7c21a8409197267e4c888bf1ff`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:54.553041 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-f513fe20-9980-4c84-8ae8-4bdfc086fc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:54.726121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50650f2c-5a63-41a2-bc95-70776d21cce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:54.726121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50650f2c-5a63-41a2-bc95-70776d21cce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:54.726121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50650f2c-5a63-41a2-bc95-70776d21cce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:54.726121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50650f2c-5a63-41a2-bc95-70776d21cce8 admin admin] PATH_INFO: `/v3/projects/13cb763fb72243829391694ea4b35941/users/f529c11d75a3481a8f034f5286c9e0a6/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:54.731992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50650f2c-5a63-41a2-bc95-70776d21cce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13cb763fb72243829391694ea4b35941, user_id=f529c11d75a3481a8f034f5286c9e0a6, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:54.731992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50650f2c-5a63-41a2-bc95-70776d21cce8 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:54.732875 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 958/1906] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 09:59:54.735338 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513fe20-9980-4c84-8ae8-4bdfc086fc04 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:54.746821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513fe20-9980-4c84-8ae8-4bdfc086fc04 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:54.751565 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e941ca2-6188-4b8a-952e-ff6d0d1fb8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:54.752168 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e941ca2-6188-4b8a-952e-ff6d0d1fb8d2 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:54.752443 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e941ca2-6188-4b8a-952e-ff6d0d1fb8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:54.752709 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e941ca2-6188-4b8a-952e-ff6d0d1fb8d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:54.753402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e941ca2-6188-4b8a-952e-ff6d0d1fb8d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:54.755439 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e941ca2-6188-4b8a-952e-ff6d0d1fb8d2 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:54.943834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 949/1907] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:54 2022] PUT /identity/v3/projects/13cb763fb72243829391694ea4b35941/users/f529c11d75a3481a8f034f5286c9e0a6/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 09:59:54.969066 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50650f2c-5a63-41a2-bc95-70776d21cce8 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:55.037620 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50650f2c-5a63-41a2-bc95-70776d21cce8 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:55.041651 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409d9b5-d14d-45b0-9d66-efe28fbc1002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:55.042467 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409d9b5-d14d-45b0-9d66-efe28fbc1002 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:55.043462 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409d9b5-d14d-45b0-9d66-efe28fbc1002 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:55.044486 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409d9b5-d14d-45b0-9d66-efe28fbc1002 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:55.045580 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409d9b5-d14d-45b0-9d66-efe28fbc1002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:55.047223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409d9b5-d14d-45b0-9d66-efe28fbc1002 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:55.061691 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 950/1908] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:55.062818 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409d9b5-d14d-45b0-9d66-efe28fbc1002 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:55.089337 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 959/1909] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:59:54 2022] POST /identity/v3/projects => generated 381 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 09:59:55.089511 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409d9b5-d14d-45b0-9d66-efe28fbc1002 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:55.092453 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e941ca2-6188-4b8a-952e-ff6d0d1fb8d2 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:55.134682 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e3c5c-6e5c-4fe4-aa6b-5f361741455c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:55.144353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e3c5c-6e5c-4fe4-aa6b-5f361741455c admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:55.144353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e3c5c-6e5c-4fe4-aa6b-5f361741455c admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:55.144353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e3c5c-6e5c-4fe4-aa6b-5f361741455c admin admin] PATH_INFO: `/v3/projects/13cb763fb72243829391694ea4b35941/users/f529c11d75a3481a8f034f5286c9e0a6/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:55.144353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e3c5c-6e5c-4fe4-aa6b-5f361741455c admin admin] RBAC: Authorizing `identity:create_grant(project_id=13cb763fb72243829391694ea4b35941, user_id=f529c11d75a3481a8f034f5286c9e0a6, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:55.144353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e3c5c-6e5c-4fe4-aa6b-5f361741455c admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:55.158186 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 951/1910] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:55 2022] PUT /identity/v3/projects/13cb763fb72243829391694ea4b35941/users/f529c11d75a3481a8f034f5286c9e0a6/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:55.166982 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e941ca2-6188-4b8a-952e-ff6d0d1fb8d2 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:55.168568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd9042-5f62-4e25-8086-230795d21294 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:55.168852 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd9042-5f62-4e25-8086-230795d21294 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:55.169125 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd9042-5f62-4e25-8086-230795d21294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:55.196983 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-18bd9042-5f62-4e25-8086-230795d21294 None None] MFA Rules not processed for user `f529c11d75a3481a8f034f5286c9e0a6`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:55.198213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-18bd9042-5f62-4e25-8086-230795d21294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:55.224188 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84927be3-5034-4c87-a394-fc70efcad02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:55.229859 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84927be3-5034-4c87-a394-fc70efcad02d admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:55.229859 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84927be3-5034-4c87-a394-fc70efcad02d admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:55.229859 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84927be3-5034-4c87-a394-fc70efcad02d admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:55.229859 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84927be3-5034-4c87-a394-fc70efcad02d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:55.229859 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84927be3-5034-4c87-a394-fc70efcad02d admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:55.271325 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 952/1911] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 09:59:55.287589 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd9042-5f62-4e25-8086-230795d21294 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:55.287589 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-18bd9042-5f62-4e25-8086-230795d21294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:55.382213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 960/1912] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:55 2022] POST /identity/v3/users => generated 297 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 09:59:55.383574 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd9042-5f62-4e25-8086-230795d21294 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:55.386550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84927be3-5034-4c87-a394-fc70efcad02d admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:55.388360 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959eaf6b-dcbb-48dc-b806-c953b95e96eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:55.389030 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959eaf6b-dcbb-48dc-b806-c953b95e96eb service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:55.389311 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959eaf6b-dcbb-48dc-b806-c953b95e96eb service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:55.389581 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959eaf6b-dcbb-48dc-b806-c953b95e96eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:55.398485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84927be3-5034-4c87-a394-fc70efcad02d admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:55.403959 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c6336-046b-42fb-a41a-c1b083683413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:55.404651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c6336-046b-42fb-a41a-c1b083683413 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:55.405157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c6336-046b-42fb-a41a-c1b083683413 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:55.405520 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c6336-046b-42fb-a41a-c1b083683413 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:55.406302 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c6336-046b-42fb-a41a-c1b083683413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:55.407475 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959eaf6b-dcbb-48dc-b806-c953b95e96eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:55.408163 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c6336-046b-42fb-a41a-c1b083683413 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:55.409567 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959eaf6b-dcbb-48dc-b806-c953b95e96eb service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:55.419561 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 961/1913] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 09:59:55.421324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 953/1914] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 09:59:55.424127 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c6336-046b-42fb-a41a-c1b083683413 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:55.436135 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c6336-046b-42fb-a41a-c1b083683413 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:55.443837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef06a11-434c-4f5d-b9d2-1166d9552098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:55.444908 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef06a11-434c-4f5d-b9d2-1166d9552098 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:55.445190 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef06a11-434c-4f5d-b9d2-1166d9552098 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:55.445464 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef06a11-434c-4f5d-b9d2-1166d9552098 admin admin] PATH_INFO: `/v3/projects/4994e547b8de4ae4a18495e79c2d1e96/users/33c902b403e0400aae5952b06a668249/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:55.463400 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef06a11-434c-4f5d-b9d2-1166d9552098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4994e547b8de4ae4a18495e79c2d1e96, user_id=33c902b403e0400aae5952b06a668249, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:55.468245 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef06a11-434c-4f5d-b9d2-1166d9552098 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:55.581314 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 962/1915] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:55 2022] PUT /identity/v3/projects/4994e547b8de4ae4a18495e79c2d1e96/users/33c902b403e0400aae5952b06a668249/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:55.596300 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959eaf6b-dcbb-48dc-b806-c953b95e96eb service cinder] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:55.606490 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef06a11-434c-4f5d-b9d2-1166d9552098 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:55.615232 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-bef06a11-434c-4f5d-b9d2-1166d9552098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:55.621115 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959eaf6b-dcbb-48dc-b806-c953b95e96eb service cinder] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:55.783393 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef06a11-434c-4f5d-b9d2-1166d9552098 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:55.790790 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c202d4-dd80-4506-aa06-a572af01ec16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:55.790790 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c202d4-dd80-4506-aa06-a572af01ec16 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:55.790790 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c202d4-dd80-4506-aa06-a572af01ec16 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:55.790790 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c202d4-dd80-4506-aa06-a572af01ec16 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:55.791299 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c202d4-dd80-4506-aa06-a572af01ec16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:55.791498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c202d4-dd80-4506-aa06-a572af01ec16 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:55.803653 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a56d43-cde8-456f-a722-292b69678169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:55.805180 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a56d43-cde8-456f-a722-292b69678169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:55.808146 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a56d43-cde8-456f-a722-292b69678169 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:55.808640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a56d43-cde8-456f-a722-292b69678169 admin admin] PATH_INFO: `/v3/users/fa4224b36f234948b7f188a1373050f3` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:55.810792 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a56d43-cde8-456f-a722-292b69678169 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4224b36f234948b7f188a1373050f3)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:55.818785 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 954/1916] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:55.818785 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c202d4-dd80-4506-aa06-a572af01ec16 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:55.820148 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a56d43-cde8-456f-a722-292b69678169 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:55.826830 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-f8c202d4-dd80-4506-aa06-a572af01ec16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:55.861113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c202d4-dd80-4506-aa06-a572af01ec16 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:55.874373 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1652b2-6235-4691-b869-8928dcc03f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:55.875030 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1652b2-6235-4691-b869-8928dcc03f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:55.875312 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1652b2-6235-4691-b869-8928dcc03f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:55.875586 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1652b2-6235-4691-b869-8928dcc03f15 admin admin] PATH_INFO: `/v3/users/c90ab752f276431087371fb720201709` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:55.876788 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1652b2-6235-4691-b869-8928dcc03f15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c90ab752f276431087371fb720201709)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:55.881230 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1652b2-6235-4691-b869-8928dcc03f15 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:56.146055 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-60a56d43-cde8-456f-a722-292b69678169 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4224b36f234948b7f188a1373050f3'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:56.158024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-60a56d43-cde8-456f-a722-292b69678169 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4224b36f234948b7f188a1373050f3'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:56.158732 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-60a56d43-cde8-456f-a722-292b69678169 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4224b36f234948b7f188a1373050f3'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:56.160739 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-60a56d43-cde8-456f-a722-292b69678169 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4224b36f234948b7f188a1373050f3'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:56.168044 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-60a56d43-cde8-456f-a722-292b69678169 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4224b36f234948b7f188a1373050f3'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:56.170063 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-1a1652b2-6235-4691-b869-8928dcc03f15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c90ab752f276431087371fb720201709'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:56.181444 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-1a1652b2-6235-4691-b869-8928dcc03f15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c90ab752f276431087371fb720201709'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:56.182156 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-1a1652b2-6235-4691-b869-8928dcc03f15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c90ab752f276431087371fb720201709'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:56.188814 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-1a1652b2-6235-4691-b869-8928dcc03f15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c90ab752f276431087371fb720201709'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:56.255481 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 963/1917] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:59:55 2022] DELETE /identity/v3/users/fa4224b36f234948b7f188a1373050f3 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:56.256184 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a56d43-cde8-456f-a722-292b69678169 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:56.259347 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-60a56d43-cde8-456f-a722-292b69678169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:56.325641 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a56d43-cde8-456f-a722-292b69678169 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:56.330316 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c148d7-d05a-4283-9db8-11c40d1e9832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:56.330968 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c148d7-d05a-4283-9db8-11c40d1e9832 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:56.331824 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c148d7-d05a-4283-9db8-11c40d1e9832 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:56.332098 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c148d7-d05a-4283-9db8-11c40d1e9832 admin admin] PATH_INFO: `/v3/projects/4994e547b8de4ae4a18495e79c2d1e96/users/33c902b403e0400aae5952b06a668249/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:56.334048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c148d7-d05a-4283-9db8-11c40d1e9832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4994e547b8de4ae4a18495e79c2d1e96, user_id=33c902b403e0400aae5952b06a668249, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:56.376138 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-1a1652b2-6235-4691-b869-8928dcc03f15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c90ab752f276431087371fb720201709'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:56.376309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c148d7-d05a-4283-9db8-11c40d1e9832 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:56.376415 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 955/1918] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:59:55 2022] DELETE /identity/v3/users/c90ab752f276431087371fb720201709 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:56.376415 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff6865-a80c-4413-a88f-4d44c2e17242 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:56.376415 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff6865-a80c-4413-a88f-4d44c2e17242 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:56.376415 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff6865-a80c-4413-a88f-4d44c2e17242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:56.376714 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 964/1919] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 09:59:56 2022] PUT /identity/v3/projects/4994e547b8de4ae4a18495e79c2d1e96/users/33c902b403e0400aae5952b06a668249/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:56.376714 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c148d7-d05a-4283-9db8-11c40d1e9832 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:56.376714 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-67c148d7-d05a-4283-9db8-11c40d1e9832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:56.376957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-5dff6865-a80c-4413-a88f-4d44c2e17242 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:56.376957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-5dff6865-a80c-4413-a88f-4d44c2e17242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:56.420459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c148d7-d05a-4283-9db8-11c40d1e9832 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:56.425162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51422add-85b4-4e97-9e78-5bfedd0736c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:56.425785 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51422add-85b4-4e97-9e78-5bfedd0736c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:56.426060 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51422add-85b4-4e97-9e78-5bfedd0736c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:56.426276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 956/1920] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:56.426380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51422add-85b4-4e97-9e78-5bfedd0736c0 admin admin] PATH_INFO: `/v3/users/88824e1357874990a108caf63e2d0cb3` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:56.427483 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51422add-85b4-4e97-9e78-5bfedd0736c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88824e1357874990a108caf63e2d0cb3)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:56.427608 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dc5eb-0083-452f-b452-df94bed045ce None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:56.427838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dc5eb-0083-452f-b452-df94bed045ce None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:56.428115 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dc5eb-0083-452f-b452-df94bed045ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:56.429406 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51422add-85b4-4e97-9e78-5bfedd0736c0 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:56.449735 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-928dc5eb-0083-452f-b452-df94bed045ce None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:56.450968 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-928dc5eb-0083-452f-b452-df94bed045ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:56.459195 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 957/1921] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:56.460494 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68c770-da74-49b7-baca-1eed33d80983 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:56.460773 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68c770-da74-49b7-baca-1eed33d80983 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:56.461039 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68c770-da74-49b7-baca-1eed33d80983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:56.487149 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-7e68c770-da74-49b7-baca-1eed33d80983 None None] MFA Rules not processed for user `33c902b403e0400aae5952b06a668249`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:56.488353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-7e68c770-da74-49b7-baca-1eed33d80983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:56.552079 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 958/1922] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:56 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:56.554997 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68c770-da74-49b7-baca-1eed33d80983 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:56.565153 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-7e68c770-da74-49b7-baca-1eed33d80983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:56.618860 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68c770-da74-49b7-baca-1eed33d80983 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:56.622675 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be045def-ab96-4270-a2b1-c32cf22c8a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:56.623279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be045def-ab96-4270-a2b1-c32cf22c8a7a service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:56.623552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be045def-ab96-4270-a2b1-c32cf22c8a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:56.623944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be045def-ab96-4270-a2b1-c32cf22c8a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:56.641465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be045def-ab96-4270-a2b1-c32cf22c8a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:56.642993 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be045def-ab96-4270-a2b1-c32cf22c8a7a service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:56.654533 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 959/1923] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:56.655548 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be045def-ab96-4270-a2b1-c32cf22c8a7a service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:56.665229 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be045def-ab96-4270-a2b1-c32cf22c8a7a service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:56.681320 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f36cb8-a768-4780-b099-d89708f1a0b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:56.681320 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f36cb8-a768-4780-b099-d89708f1a0b9 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:56.681320 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f36cb8-a768-4780-b099-d89708f1a0b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:56.681320 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f36cb8-a768-4780-b099-d89708f1a0b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:56.681856 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-51422add-85b4-4e97-9e78-5bfedd0736c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88824e1357874990a108caf63e2d0cb3'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:56.681937 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f36cb8-a768-4780-b099-d89708f1a0b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:56.682385 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f36cb8-a768-4780-b099-d89708f1a0b9 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:56.691144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-51422add-85b4-4e97-9e78-5bfedd0736c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88824e1357874990a108caf63e2d0cb3'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:56.691917 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-51422add-85b4-4e97-9e78-5bfedd0736c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88824e1357874990a108caf63e2d0cb3'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:56.692209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 960/1924] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:56.692855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-51422add-85b4-4e97-9e78-5bfedd0736c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88824e1357874990a108caf63e2d0cb3'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:56.693034 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f36cb8-a768-4780-b099-d89708f1a0b9 service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:56.694325 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-30f36cb8-a768-4780-b099-d89708f1a0b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:56.700520 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-51422add-85b4-4e97-9e78-5bfedd0736c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88824e1357874990a108caf63e2d0cb3'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:56.760042 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f36cb8-a768-4780-b099-d89708f1a0b9 service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:56.765406 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37d1a9-3aed-4132-bcbd-caa264a2cac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:56.766110 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37d1a9-3aed-4132-bcbd-caa264a2cac3 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:56.766861 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37d1a9-3aed-4132-bcbd-caa264a2cac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:56.767306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37d1a9-3aed-4132-bcbd-caa264a2cac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:56.770348 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-6c37d1a9-3aed-4132-bcbd-caa264a2cac3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:56.783938 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37d1a9-3aed-4132-bcbd-caa264a2cac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:56.785487 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37d1a9-3aed-4132-bcbd-caa264a2cac3 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:56.795426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 961/1925] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:56 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 09:59:56.820150 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 965/1926] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:59:56 2022] DELETE /identity/v3/users/88824e1357874990a108caf63e2d0cb3 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:56.826799 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4836f6-c654-4b2f-b81a-61e27eda806c None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:56.826889 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4836f6-c654-4b2f-b81a-61e27eda806c None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:56.827258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4836f6-c654-4b2f-b81a-61e27eda806c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:56.857635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-5e4836f6-c654-4b2f-b81a-61e27eda806c None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:56.858960 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-5e4836f6-c654-4b2f-b81a-61e27eda806c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:56.913156 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51422add-85b4-4e97-9e78-5bfedd0736c0 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:56.914598 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-51422add-85b4-4e97-9e78-5bfedd0736c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:56.921001 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:56.940366 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 962/1927] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:56.951267 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4836f6-c654-4b2f-b81a-61e27eda806c None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:56.952678 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-5e4836f6-c654-4b2f-b81a-61e27eda806c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:56.973884 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51422add-85b4-4e97-9e78-5bfedd0736c0 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:56.979560 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2665ec1-6f75-4566-84b3-d651f39d8aba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:56.988018 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2665ec1-6f75-4566-84b3-d651f39d8aba service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:56.988018 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2665ec1-6f75-4566-84b3-d651f39d8aba service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:56.988018 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2665ec1-6f75-4566-84b3-d651f39d8aba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:56.988018 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-c2665ec1-6f75-4566-84b3-d651f39d8aba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:57.020704 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4836f6-c654-4b2f-b81a-61e27eda806c None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:57.026867 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a701648-add2-4152-955c-939b91bae969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:57.027491 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a701648-add2-4152-955c-939b91bae969 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:57.027974 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a701648-add2-4152-955c-939b91bae969 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:57.028254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a701648-add2-4152-955c-939b91bae969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:57.040783 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a701648-add2-4152-955c-939b91bae969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:57.043433 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a701648-add2-4152-955c-939b91bae969 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:57.050970 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2665ec1-6f75-4566-84b3-d651f39d8aba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:57.052616 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2665ec1-6f75-4566-84b3-d651f39d8aba service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:57.057451 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 963/1928] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 09:59:57.062776 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 966/1929] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 09:59:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 09:59:57.133133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:57.376043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a701648-add2-4152-955c-939b91bae969 service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:57.376557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-7a701648-add2-4152-955c-939b91bae969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:57.394320 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a701648-add2-4152-955c-939b91bae969 service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:57.398893 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540140e-220e-44e3-afaf-8e89122bdef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:57.399518 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540140e-220e-44e3-afaf-8e89122bdef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:57.399792 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540140e-220e-44e3-afaf-8e89122bdef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:57.400112 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540140e-220e-44e3-afaf-8e89122bdef1 admin admin] PATH_INFO: `/v3/projects/d60a33a437954e3ab60348b2b1b46d63` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:57.401273 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540140e-220e-44e3-afaf-8e89122bdef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d60a33a437954e3ab60348b2b1b46d63)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:57.403256 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540140e-220e-44e3-afaf-8e89122bdef1 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:57.470355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2665ec1-6f75-4566-84b3-d651f39d8aba service cinder] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:57.470355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-c2665ec1-6f75-4566-84b3-d651f39d8aba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:57.482931 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2665ec1-6f75-4566-84b3-d651f39d8aba service cinder] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:57.496758 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f395195-cde0-4d51-aa27-05e07485abe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:57.497576 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f395195-cde0-4d51-aa27-05e07485abe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:57.498386 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f395195-cde0-4d51-aa27-05e07485abe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:57.501235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f395195-cde0-4d51-aa27-05e07485abe1 admin admin] PATH_INFO: `/v3/projects/bc3e2edd75eb4ef7a86746efc9202e7f` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:57.501235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f395195-cde0-4d51-aa27-05e07485abe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc3e2edd75eb4ef7a86746efc9202e7f)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:57.502610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f395195-cde0-4d51-aa27-05e07485abe1 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:57.573166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-6540140e-220e-44e3-afaf-8e89122bdef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60a33a437954e3ab60348b2b1b46d63', 'request_id': 'req-6540140e-220e-44e3-afaf-8e89122bdef1'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:57.580561 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-6540140e-220e-44e3-afaf-8e89122bdef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60a33a437954e3ab60348b2b1b46d63', 'request_id': 'req-6540140e-220e-44e3-afaf-8e89122bdef1'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:57.587548 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-6540140e-220e-44e3-afaf-8e89122bdef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60a33a437954e3ab60348b2b1b46d63', 'request_id': 'req-6540140e-220e-44e3-afaf-8e89122bdef1'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:57.646683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-4f395195-cde0-4d51-aa27-05e07485abe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc3e2edd75eb4ef7a86746efc9202e7f', 'request_id': 'req-4f395195-cde0-4d51-aa27-05e07485abe1'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:57.652547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-4f395195-cde0-4d51-aa27-05e07485abe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc3e2edd75eb4ef7a86746efc9202e7f', 'request_id': 'req-4f395195-cde0-4d51-aa27-05e07485abe1'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:57.669736 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-6540140e-220e-44e3-afaf-8e89122bdef1 admin admin] The token cache is being invalidate because project d60a33a437954e3ab60348b2b1b46d63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 09:59:57.670054 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-6540140e-220e-44e3-afaf-8e89122bdef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:57.670714 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-6540140e-220e-44e3-afaf-8e89122bdef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:57.675163 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 964/1930] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:59:57 2022] DELETE /identity/v3/projects/d60a33a437954e3ab60348b2b1b46d63 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:57.680628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540140e-220e-44e3-afaf-8e89122bdef1 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:57.682067 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-6540140e-220e-44e3-afaf-8e89122bdef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:57.749328 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-4f395195-cde0-4d51-aa27-05e07485abe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc3e2edd75eb4ef7a86746efc9202e7f', 'request_id': 'req-4f395195-cde0-4d51-aa27-05e07485abe1'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:57.750244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540140e-220e-44e3-afaf-8e89122bdef1 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:57.762905 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-4f395195-cde0-4d51-aa27-05e07485abe1 admin admin] The token cache is being invalidate because project bc3e2edd75eb4ef7a86746efc9202e7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 09:59:57.763513 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-4f395195-cde0-4d51-aa27-05e07485abe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:57.764358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-4f395195-cde0-4d51-aa27-05e07485abe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:57.766334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 967/1931] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:59:57 2022] DELETE /identity/v3/projects/bc3e2edd75eb4ef7a86746efc9202e7f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:57.767486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f395195-cde0-4d51-aa27-05e07485abe1 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:57.769914 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-4f395195-cde0-4d51-aa27-05e07485abe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:57.850738 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d2a95-2fb9-48db-8163-87dbc8c123f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:57.851509 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d2a95-2fb9-48db-8163-87dbc8c123f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:57.851710 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d2a95-2fb9-48db-8163-87dbc8c123f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:57.852040 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d2a95-2fb9-48db-8163-87dbc8c123f7 admin admin] PATH_INFO: `/v3/projects/89d6b7ff518947a8adcef9d584f17802` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:57.853249 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d2a95-2fb9-48db-8163-87dbc8c123f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d6b7ff518947a8adcef9d584f17802)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:57.855267 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d2a95-2fb9-48db-8163-87dbc8c123f7 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:57.863080 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f395195-cde0-4d51-aa27-05e07485abe1 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:57.874200 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f8c99-48b9-4bbb-9d11-4240ec816427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:57.879111 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f8c99-48b9-4bbb-9d11-4240ec816427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:57.879111 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f8c99-48b9-4bbb-9d11-4240ec816427 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:57.879321 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f8c99-48b9-4bbb-9d11-4240ec816427 admin admin] PATH_INFO: `/v3/users/d4b1b4cfdcae46388365cb081c9273e8` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:57.880620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f8c99-48b9-4bbb-9d11-4240ec816427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b1b4cfdcae46388365cb081c9273e8)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:57.882778 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f8c99-48b9-4bbb-9d11-4240ec816427 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:58.008801 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-849d2a95-2fb9-48db-8163-87dbc8c123f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d6b7ff518947a8adcef9d584f17802', 'request_id': 'req-849d2a95-2fb9-48db-8163-87dbc8c123f7'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:58.017090 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-849d2a95-2fb9-48db-8163-87dbc8c123f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d6b7ff518947a8adcef9d584f17802', 'request_id': 'req-849d2a95-2fb9-48db-8163-87dbc8c123f7'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:58.023842 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-849d2a95-2fb9-48db-8163-87dbc8c123f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d6b7ff518947a8adcef9d584f17802', 'request_id': 'req-849d2a95-2fb9-48db-8163-87dbc8c123f7'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:58.117740 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-849d2a95-2fb9-48db-8163-87dbc8c123f7 admin admin] The token cache is being invalidate because project 89d6b7ff518947a8adcef9d584f17802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 09:59:58.118025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-849d2a95-2fb9-48db-8163-87dbc8c123f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:58.122053 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-849d2a95-2fb9-48db-8163-87dbc8c123f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:58.122053 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 965/1932] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:59:57 2022] DELETE /identity/v3/projects/89d6b7ff518947a8adcef9d584f17802 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:58.122485 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d2a95-2fb9-48db-8163-87dbc8c123f7 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:58.124126 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-849d2a95-2fb9-48db-8163-87dbc8c123f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:58.129676 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-375f8c99-48b9-4bbb-9d11-4240ec816427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b1b4cfdcae46388365cb081c9273e8'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:58.141783 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-375f8c99-48b9-4bbb-9d11-4240ec816427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b1b4cfdcae46388365cb081c9273e8'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:58.142485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-375f8c99-48b9-4bbb-9d11-4240ec816427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b1b4cfdcae46388365cb081c9273e8'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:58.143147 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-375f8c99-48b9-4bbb-9d11-4240ec816427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b1b4cfdcae46388365cb081c9273e8'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:58.152047 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-375f8c99-48b9-4bbb-9d11-4240ec816427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b1b4cfdcae46388365cb081c9273e8'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:58.191848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d2a95-2fb9-48db-8163-87dbc8c123f7 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:58.196413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95723c1a-021b-42cd-b184-27aef0902714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:58.197036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95723c1a-021b-42cd-b184-27aef0902714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:58.200437 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95723c1a-021b-42cd-b184-27aef0902714 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:58.200437 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95723c1a-021b-42cd-b184-27aef0902714 admin admin] PATH_INFO: `/v3/users/a3df887e05b449c9a4589c36d9425aff` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:58.200437 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95723c1a-021b-42cd-b184-27aef0902714 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3df887e05b449c9a4589c36d9425aff)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:58.200722 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95723c1a-021b-42cd-b184-27aef0902714 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:58.226163 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 968/1933] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:59:57 2022] DELETE /identity/v3/users/d4b1b4cfdcae46388365cb081c9273e8 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:58.227368 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f8c99-48b9-4bbb-9d11-4240ec816427 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:58.231155 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-375f8c99-48b9-4bbb-9d11-4240ec816427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:58.293800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f8c99-48b9-4bbb-9d11-4240ec816427 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:58.298541 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9014d-3292-4bc9-be92-f29b1c766432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:58.299175 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9014d-3292-4bc9-be92-f29b1c766432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:58.299450 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9014d-3292-4bc9-be92-f29b1c766432 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:58.300254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9014d-3292-4bc9-be92-f29b1c766432 admin admin] PATH_INFO: `/v3/users/f529c11d75a3481a8f034f5286c9e0a6` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:58.301390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9014d-3292-4bc9-be92-f29b1c766432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f529c11d75a3481a8f034f5286c9e0a6)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:58.303336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9014d-3292-4bc9-be92-f29b1c766432 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:58.471578 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-95723c1a-021b-42cd-b184-27aef0902714 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3df887e05b449c9a4589c36d9425aff'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:58.485879 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-95723c1a-021b-42cd-b184-27aef0902714 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3df887e05b449c9a4589c36d9425aff'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:58.486637 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-95723c1a-021b-42cd-b184-27aef0902714 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3df887e05b449c9a4589c36d9425aff'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:58.495430 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-95723c1a-021b-42cd-b184-27aef0902714 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3df887e05b449c9a4589c36d9425aff'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:58.517303 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-4cb9014d-3292-4bc9-be92-f29b1c766432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f529c11d75a3481a8f034f5286c9e0a6'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:58.533036 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-4cb9014d-3292-4bc9-be92-f29b1c766432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f529c11d75a3481a8f034f5286c9e0a6'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:58.534588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-4cb9014d-3292-4bc9-be92-f29b1c766432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f529c11d75a3481a8f034f5286c9e0a6'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:58.535344 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-4cb9014d-3292-4bc9-be92-f29b1c766432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f529c11d75a3481a8f034f5286c9e0a6'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:58.543744 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-4cb9014d-3292-4bc9-be92-f29b1c766432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f529c11d75a3481a8f034f5286c9e0a6'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:58.563611 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-95723c1a-021b-42cd-b184-27aef0902714 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3df887e05b449c9a4589c36d9425aff'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:58.573838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 966/1934] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:59:58 2022] DELETE /identity/v3/users/a3df887e05b449c9a4589c36d9425aff => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:58.617017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 969/1935] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 09:59:58 2022] DELETE /identity/v3/users/f529c11d75a3481a8f034f5286c9e0a6 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:58.724808 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95723c1a-021b-42cd-b184-27aef0902714 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:58.726315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-95723c1a-021b-42cd-b184-27aef0902714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:58.823366 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95723c1a-021b-42cd-b184-27aef0902714 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:58.841294 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:58.880725 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69628d-9916-48a5-a28f-2f4f3a9c41e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:58.881366 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69628d-9916-48a5-a28f-2f4f3a9c41e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:58.881647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69628d-9916-48a5-a28f-2f4f3a9c41e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:58.881924 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69628d-9916-48a5-a28f-2f4f3a9c41e7 admin admin] PATH_INFO: `/v3/projects/63ebaa1622994c5d899eb016544a7273` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:58.883078 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69628d-9916-48a5-a28f-2f4f3a9c41e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63ebaa1622994c5d899eb016544a7273)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:58.885311 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69628d-9916-48a5-a28f-2f4f3a9c41e7 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:59.005416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ea69628d-9916-48a5-a28f-2f4f3a9c41e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63ebaa1622994c5d899eb016544a7273', 'request_id': 'req-ea69628d-9916-48a5-a28f-2f4f3a9c41e7'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:59.022513 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ea69628d-9916-48a5-a28f-2f4f3a9c41e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63ebaa1622994c5d899eb016544a7273', 'request_id': 'req-ea69628d-9916-48a5-a28f-2f4f3a9c41e7'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:59.031222 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ea69628d-9916-48a5-a28f-2f4f3a9c41e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63ebaa1622994c5d899eb016544a7273', 'request_id': 'req-ea69628d-9916-48a5-a28f-2f4f3a9c41e7'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:59.076052 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 09:59:59.109608 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ea69628d-9916-48a5-a28f-2f4f3a9c41e7 admin admin] The token cache is being invalidate because project 63ebaa1622994c5d899eb016544a7273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 09:59:59.109938 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ea69628d-9916-48a5-a28f-2f4f3a9c41e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:59.110604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ea69628d-9916-48a5-a28f-2f4f3a9c41e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:59.112374 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 967/1936] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:59:58 2022] DELETE /identity/v3/projects/63ebaa1622994c5d899eb016544a7273 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 09:59:59.117265 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5aa86d-8d00-41e6-9139-90b9f3d8c93a None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:59.117549 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5aa86d-8d00-41e6-9139-90b9f3d8c93a None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:59.117818 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5aa86d-8d00-41e6-9139-90b9f3d8c93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:59.138532 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-5c5aa86d-8d00-41e6-9139-90b9f3d8c93a None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:59.139781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-5c5aa86d-8d00-41e6-9139-90b9f3d8c93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:59.208144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 970/1937] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:59.210022 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4cd23-0053-4e62-8388-8cad603b7d7e None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:59.210405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4cd23-0053-4e62-8388-8cad603b7d7e None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:59.210746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4cd23-0053-4e62-8388-8cad603b7d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:59.230676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-e5a4cd23-0053-4e62-8388-8cad603b7d7e None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 09:59:59.231888 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-e5a4cd23-0053-4e62-8388-8cad603b7d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:59.241890 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 968/1938] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 09:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 09:59:59.248798 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5aa86d-8d00-41e6-9139-90b9f3d8c93a None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:59.259661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5aa86d-8d00-41e6-9139-90b9f3d8c93a None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:59.264335 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e074e-324e-402d-bf9a-d007170760d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:59.265067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e074e-324e-402d-bf9a-d007170760d9 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:59.265337 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e074e-324e-402d-bf9a-d007170760d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:59.265598 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e074e-324e-402d-bf9a-d007170760d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:59.266280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e074e-324e-402d-bf9a-d007170760d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 09:59:59.266576 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e074e-324e-402d-bf9a-d007170760d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:59.268216 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e074e-324e-402d-bf9a-d007170760d9 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:59.291507 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 971/1939] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 09:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 09:59:59.296231 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4cd23-0053-4e62-8388-8cad603b7d7e None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:59.305148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4cd23-0053-4e62-8388-8cad603b7d7e None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:59.310727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c10b5-ccad-4860-834d-2da0ef07b80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:59.311433 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c10b5-ccad-4860-834d-2da0ef07b80d admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:59.311707 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c10b5-ccad-4860-834d-2da0ef07b80d admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:59.311973 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c10b5-ccad-4860-834d-2da0ef07b80d admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:59.312597 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c10b5-ccad-4860-834d-2da0ef07b80d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:59.317535 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c10b5-ccad-4860-834d-2da0ef07b80d admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:59.443927 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 969/1940] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 09:59:59 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:59.445537 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e074e-324e-402d-bf9a-d007170760d9 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:59.457238 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e074e-324e-402d-bf9a-d007170760d9 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:59.514448 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899152da-1adf-44ce-a640-c10c7ae2c98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:59.515055 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899152da-1adf-44ce-a640-c10c7ae2c98b admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:59.515329 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899152da-1adf-44ce-a640-c10c7ae2c98b admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:59.515595 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899152da-1adf-44ce-a640-c10c7ae2c98b admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:59.516201 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899152da-1adf-44ce-a640-c10c7ae2c98b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:59.518113 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899152da-1adf-44ce-a640-c10c7ae2c98b admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:59.636534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 972/1941] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 09:59:59 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 09:59:59.636686 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c10b5-ccad-4860-834d-2da0ef07b80d admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:59.637884 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899152da-1adf-44ce-a640-c10c7ae2c98b admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:59.638830 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-0d2c10b5-ccad-4860-834d-2da0ef07b80d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:59.649851 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899152da-1adf-44ce-a640-c10c7ae2c98b admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:59.663770 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c10b5-ccad-4860-834d-2da0ef07b80d admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:59.674785 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e4de0-99f9-4260-bcb5-512058c50abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:59.675453 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e4de0-99f9-4260-bcb5-512058c50abb admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:59.675827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e4de0-99f9-4260-bcb5-512058c50abb admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:59.675943 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a8230-2b50-41bf-a313-381a1845095b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:59.676035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e4de0-99f9-4260-bcb5-512058c50abb admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:59.676622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a8230-2b50-41bf-a313-381a1845095b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:59.676754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e4de0-99f9-4260-bcb5-512058c50abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:59.676934 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a8230-2b50-41bf-a313-381a1845095b admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:59.677162 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a8230-2b50-41bf-a313-381a1845095b admin admin] PATH_INFO: `/v3/projects/1107cffb673843e898f6116e5ffae2fb` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:59.678532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a8230-2b50-41bf-a313-381a1845095b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1107cffb673843e898f6116e5ffae2fb)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:59.681123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a8230-2b50-41bf-a313-381a1845095b admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:59.684651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e4de0-99f9-4260-bcb5-512058c50abb admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:59.705170 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 973/1942] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 09:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 09:59:59.706697 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e4de0-99f9-4260-bcb5-512058c50abb admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 09:59:59.708461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-240e4de0-99f9-4260-bcb5-512058c50abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 09:59:59.721625 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e4de0-99f9-4260-bcb5-512058c50abb admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 09:59:59.726222 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd346438-4618-472c-8e24-873976dbbc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 09:59:59.726840 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd346438-4618-472c-8e24-873976dbbc62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 09:59:59.727117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd346438-4618-472c-8e24-873976dbbc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 09:59:59.727388 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd346438-4618-472c-8e24-873976dbbc62 admin admin] PATH_INFO: `/v3/projects/13cb763fb72243829391694ea4b35941` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 09:59:59.728694 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd346438-4618-472c-8e24-873976dbbc62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13cb763fb72243829391694ea4b35941)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 09:59:59.730663 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd346438-4618-472c-8e24-873976dbbc62 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 09:59:59.867574 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-d94a8230-2b50-41bf-a313-381a1845095b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1107cffb673843e898f6116e5ffae2fb', 'request_id': 'req-d94a8230-2b50-41bf-a313-381a1845095b'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:59.873160 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-d94a8230-2b50-41bf-a313-381a1845095b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1107cffb673843e898f6116e5ffae2fb', 'request_id': 'req-d94a8230-2b50-41bf-a313-381a1845095b'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:59.881774 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-d94a8230-2b50-41bf-a313-381a1845095b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1107cffb673843e898f6116e5ffae2fb', 'request_id': 'req-d94a8230-2b50-41bf-a313-381a1845095b'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:59.897514 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-bd346438-4618-472c-8e24-873976dbbc62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13cb763fb72243829391694ea4b35941', 'request_id': 'req-bd346438-4618-472c-8e24-873976dbbc62'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 09:59:59.902821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-bd346438-4618-472c-8e24-873976dbbc62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13cb763fb72243829391694ea4b35941', 'request_id': 'req-bd346438-4618-472c-8e24-873976dbbc62'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:00.049052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-d94a8230-2b50-41bf-a313-381a1845095b admin admin] The token cache is being invalidate because project 1107cffb673843e898f6116e5ffae2fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:00:00.049388 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-d94a8230-2b50-41bf-a313-381a1845095b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:00.050708 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-d94a8230-2b50-41bf-a313-381a1845095b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:00.052213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 970/1943] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:59:59 2022] DELETE /identity/v3/projects/1107cffb673843e898f6116e5ffae2fb => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:00.054953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a8230-2b50-41bf-a313-381a1845095b admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:00.054953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-d94a8230-2b50-41bf-a313-381a1845095b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:00.122528 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a8230-2b50-41bf-a313-381a1845095b admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:00.170773 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-bd346438-4618-472c-8e24-873976dbbc62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13cb763fb72243829391694ea4b35941', 'request_id': 'req-bd346438-4618-472c-8e24-873976dbbc62'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:00.184249 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76b91e-e4fe-4424-a303-7e0ddcb8917d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:00.184445 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-bd346438-4618-472c-8e24-873976dbbc62 admin admin] The token cache is being invalidate because project 13cb763fb72243829391694ea4b35941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:00:00.184606 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-bd346438-4618-472c-8e24-873976dbbc62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:00.190794 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76b91e-e4fe-4424-a303-7e0ddcb8917d admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:00.190794 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76b91e-e4fe-4424-a303-7e0ddcb8917d admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:00.191090 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-bd346438-4618-472c-8e24-873976dbbc62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:00.191168 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76b91e-e4fe-4424-a303-7e0ddcb8917d admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:00.191168 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76b91e-e4fe-4424-a303-7e0ddcb8917d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:00.191300 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 974/1944] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 09:59:59 2022] DELETE /identity/v3/projects/13cb763fb72243829391694ea4b35941 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:00.191379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76b91e-e4fe-4424-a303-7e0ddcb8917d admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:00.191448 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832ee67-d59d-4398-90ba-71965b38f304 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:00.191448 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832ee67-d59d-4398-90ba-71965b38f304 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:00.191448 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832ee67-d59d-4398-90ba-71965b38f304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:00.202310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 971/1945] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:00.206903 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d75908-f19f-415a-922e-70b2a7bd5375 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:00.207194 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d75908-f19f-415a-922e-70b2a7bd5375 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:00.207471 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d75908-f19f-415a-922e-70b2a7bd5375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:00.223506 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-b832ee67-d59d-4398-90ba-71965b38f304 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:00.224875 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-b832ee67-d59d-4398-90ba-71965b38f304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:00.239690 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 975/1946] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:00.240671 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832ee67-d59d-4398-90ba-71965b38f304 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:00.243619 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-d0d75908-f19f-415a-922e-70b2a7bd5375 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:00.244845 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-d0d75908-f19f-415a-922e-70b2a7bd5375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:00.246632 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-b832ee67-d59d-4398-90ba-71965b38f304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:00.264476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 972/1947] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:00.265534 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9848327-dec7-4950-b7ad-7e495f25e549 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:00.265815 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9848327-dec7-4950-b7ad-7e495f25e549 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:00.265922 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832ee67-d59d-4398-90ba-71965b38f304 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:00.266105 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9848327-dec7-4950-b7ad-7e495f25e549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:00.271391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae7e49-a8da-400a-a05c-c7557818d233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:00.272981 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae7e49-a8da-400a-a05c-c7557818d233 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:00.274349 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae7e49-a8da-400a-a05c-c7557818d233 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:00.275580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae7e49-a8da-400a-a05c-c7557818d233 admin admin] PATH_INFO: `/v3/projects/0d89027683ab4d5986cc1d05c29b2234/users/e7d9baae58814621a263bf11bcee02f5/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:00.297268 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-c9848327-dec7-4950-b7ad-7e495f25e549 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:00.297738 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae7e49-a8da-400a-a05c-c7557818d233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d89027683ab4d5986cc1d05c29b2234, user_id=e7d9baae58814621a263bf11bcee02f5, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:00.298761 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-c9848327-dec7-4950-b7ad-7e495f25e549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:00.301139 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae7e49-a8da-400a-a05c-c7557818d233 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:00.308156 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 973/1948] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:00.309669 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e13fe-95ac-40e8-91eb-904259c830ea None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:00.310029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e13fe-95ac-40e8-91eb-904259c830ea None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:00.317111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e13fe-95ac-40e8-91eb-904259c830ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:00.330731 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-e96e13fe-95ac-40e8-91eb-904259c830ea None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:00.332023 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-e96e13fe-95ac-40e8-91eb-904259c830ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:00.342645 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 974/1949] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:00.344380 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e13fe-95ac-40e8-91eb-904259c830ea None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:00.354150 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e13fe-95ac-40e8-91eb-904259c830ea None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:00.360269 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f479a-1339-4495-ad8a-1fcd9afbac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:00.362138 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f479a-1339-4495-ad8a-1fcd9afbac82 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:00.363416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f479a-1339-4495-ad8a-1fcd9afbac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:00.363416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f479a-1339-4495-ad8a-1fcd9afbac82 admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:00.363416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f479a-1339-4495-ad8a-1fcd9afbac82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:00:00.364129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f479a-1339-4495-ad8a-1fcd9afbac82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:00.366635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f479a-1339-4495-ad8a-1fcd9afbac82 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:00.380511 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 975/1950] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:00:00.381354 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f479a-1339-4495-ad8a-1fcd9afbac82 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:00.405937 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f479a-1339-4495-ad8a-1fcd9afbac82 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:00.410236 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 976/1951] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:00 2022] PUT /identity/v3/projects/0d89027683ab4d5986cc1d05c29b2234/users/e7d9baae58814621a263bf11bcee02f5/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:00.410236 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae7e49-a8da-400a-a05c-c7557818d233 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:00.418210 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-4dae7e49-a8da-400a-a05c-c7557818d233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:00.492803 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8c4e0-0c27-4bb4-9f56-d29d5beb53c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:00.493557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8c4e0-0c27-4bb4-9f56-d29d5beb53c9 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:00.493900 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8c4e0-0c27-4bb4-9f56-d29d5beb53c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:00.494266 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8c4e0-0c27-4bb4-9f56-d29d5beb53c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:00.494992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8c4e0-0c27-4bb4-9f56-d29d5beb53c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:00:00.495365 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8c4e0-0c27-4bb4-9f56-d29d5beb53c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:00.497041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8c4e0-0c27-4bb4-9f56-d29d5beb53c9 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:00.515739 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae7e49-a8da-400a-a05c-c7557818d233 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:00.522390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9345a-31b7-4516-92fc-2cb87d51d8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:00.522560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 976/1952] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:00:00.523039 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9345a-31b7-4516-92fc-2cb87d51d8d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:00.523297 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8c4e0-0c27-4bb4-9f56-d29d5beb53c9 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:00.523400 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9345a-31b7-4516-92fc-2cb87d51d8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:00.523567 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9345a-31b7-4516-92fc-2cb87d51d8d8 admin admin] PATH_INFO: `/v3/users/9dd97a7c21a8409197267e4c888bf1ff` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:00.524844 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9345a-31b7-4516-92fc-2cb87d51d8d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dd97a7c21a8409197267e4c888bf1ff)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:00.526967 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9345a-31b7-4516-92fc-2cb87d51d8d8 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:00.538786 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8c4e0-0c27-4bb4-9f56-d29d5beb53c9 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:00.544425 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea81084-a8ff-423d-a016-059e23e022ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:00.545179 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea81084-a8ff-423d-a016-059e23e022ab admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:00.545458 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea81084-a8ff-423d-a016-059e23e022ab admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:00.545730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea81084-a8ff-423d-a016-059e23e022ab admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:00.554951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea81084-a8ff-423d-a016-059e23e022ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:00.561466 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea81084-a8ff-423d-a016-059e23e022ab admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:00.684294 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 977/1953] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:00:00 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:00.688683 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fde0e-8464-4f1a-8d15-9e3ed08c6042 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:00.689177 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fde0e-8464-4f1a-8d15-9e3ed08c6042 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:00.689523 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fde0e-8464-4f1a-8d15-9e3ed08c6042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:00.719674 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-3c0fde0e-8464-4f1a-8d15-9e3ed08c6042 None None] MFA Rules not processed for user `e7d9baae58814621a263bf11bcee02f5`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:00.721278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-3c0fde0e-8464-4f1a-8d15-9e3ed08c6042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:00.765090 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f3a9345a-31b7-4516-92fc-2cb87d51d8d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dd97a7c21a8409197267e4c888bf1ff'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:00.783048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f3a9345a-31b7-4516-92fc-2cb87d51d8d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dd97a7c21a8409197267e4c888bf1ff'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:00.783862 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f3a9345a-31b7-4516-92fc-2cb87d51d8d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dd97a7c21a8409197267e4c888bf1ff'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:00.784611 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f3a9345a-31b7-4516-92fc-2cb87d51d8d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dd97a7c21a8409197267e4c888bf1ff'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:00.793038 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f3a9345a-31b7-4516-92fc-2cb87d51d8d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dd97a7c21a8409197267e4c888bf1ff'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:00.795637 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 978/1954] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:00.796521 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fde0e-8464-4f1a-8d15-9e3ed08c6042 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:00.894809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fde0e-8464-4f1a-8d15-9e3ed08c6042 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:00.899965 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f0e4a-9b3e-42ee-bbc1-dd50ddaf1e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:00.900576 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f0e4a-9b3e-42ee-bbc1-dd50ddaf1e64 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:00.901592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f0e4a-9b3e-42ee-bbc1-dd50ddaf1e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:00.901592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f0e4a-9b3e-42ee-bbc1-dd50ddaf1e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:00.901878 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f0e4a-9b3e-42ee-bbc1-dd50ddaf1e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:00.904864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f0e4a-9b3e-42ee-bbc1-dd50ddaf1e64 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:00.910315 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 977/1955] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:00:00 2022] DELETE /identity/v3/users/9dd97a7c21a8409197267e4c888bf1ff => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:00.913740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9345a-31b7-4516-92fc-2cb87d51d8d8 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:00.915145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-f3a9345a-31b7-4516-92fc-2cb87d51d8d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:01.008676 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9345a-31b7-4516-92fc-2cb87d51d8d8 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:01.014580 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 979/1956] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:00:00 2022] POST /identity/v3/projects => generated 383 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:01.015127 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889adce-6c82-4642-abf6-ba49880345b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:01.015599 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f0e4a-9b3e-42ee-bbc1-dd50ddaf1e64 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:01.016578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889adce-6c82-4642-abf6-ba49880345b7 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:01.016856 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889adce-6c82-4642-abf6-ba49880345b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:01.017129 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889adce-6c82-4642-abf6-ba49880345b7 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:01.017525 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-108f0e4a-9b3e-42ee-bbc1-dd50ddaf1e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:01.018013 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889adce-6c82-4642-abf6-ba49880345b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:01.020022 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889adce-6c82-4642-abf6-ba49880345b7 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:01.095964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:01.103164 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f0e4a-9b3e-42ee-bbc1-dd50ddaf1e64 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:01.108967 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 978/1957] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:00:00 2022] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:01.110112 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be862f0-56cc-4432-b97c-7191228ecf98 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:01.110401 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be862f0-56cc-4432-b97c-7191228ecf98 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:01.115202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be862f0-56cc-4432-b97c-7191228ecf98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:01.119076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f432d-24b3-46dd-901c-439d7b38d980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:01.129116 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f432d-24b3-46dd-901c-439d7b38d980 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:01.129738 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f432d-24b3-46dd-901c-439d7b38d980 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:01.130404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f432d-24b3-46dd-901c-439d7b38d980 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:01.131980 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f432d-24b3-46dd-901c-439d7b38d980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:01.134507 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f432d-24b3-46dd-901c-439d7b38d980 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:01.137721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-6be862f0-56cc-4432-b97c-7191228ecf98 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:01.138488 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-6be862f0-56cc-4432-b97c-7191228ecf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:01.152176 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 979/1958] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:01.152176 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be862f0-56cc-4432-b97c-7191228ecf98 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:01.154330 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-6be862f0-56cc-4432-b97c-7191228ecf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:01.177867 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be862f0-56cc-4432-b97c-7191228ecf98 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:01.183080 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939d521-a4fe-416d-8606-848ae44eeeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:01.187326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939d521-a4fe-416d-8606-848ae44eeeb4 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:01.187326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939d521-a4fe-416d-8606-848ae44eeeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:01.187326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939d521-a4fe-416d-8606-848ae44eeeb4 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:01.187326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939d521-a4fe-416d-8606-848ae44eeeb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:01.187326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939d521-a4fe-416d-8606-848ae44eeeb4 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:01.269646 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 980/1959] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:00:01 2022] POST /identity/v3/projects => generated 385 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:01.269646 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f432d-24b3-46dd-901c-439d7b38d980 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:01.296211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 980/1960] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:00:01 2022] POST /identity/v3/users => generated 292 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:01.297097 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939d521-a4fe-416d-8606-848ae44eeeb4 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:01.300766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-4939d521-a4fe-416d-8606-848ae44eeeb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:01.342228 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f432d-24b3-46dd-901c-439d7b38d980 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:01.348072 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d30a4e-fa7f-4d84-a105-a48a67ced765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:01.348949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d30a4e-fa7f-4d84-a105-a48a67ced765 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:01.349382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d30a4e-fa7f-4d84-a105-a48a67ced765 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:01.349649 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d30a4e-fa7f-4d84-a105-a48a67ced765 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:01.350494 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d30a4e-fa7f-4d84-a105-a48a67ced765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:01.352098 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d30a4e-fa7f-4d84-a105-a48a67ced765 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:01.363729 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 981/1961] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:01.364561 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d30a4e-fa7f-4d84-a105-a48a67ced765 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:01.370103 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:01.378817 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d30a4e-fa7f-4d84-a105-a48a67ced765 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:01.388391 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f28c4-a27b-4892-b39d-b9f329a91f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:01.389487 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f28c4-a27b-4892-b39d-b9f329a91f62 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:01.389906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f28c4-a27b-4892-b39d-b9f329a91f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:01.390221 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f28c4-a27b-4892-b39d-b9f329a91f62 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:01.390906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f28c4-a27b-4892-b39d-b9f329a91f62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:01.392952 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f28c4-a27b-4892-b39d-b9f329a91f62 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:01.416792 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939d521-a4fe-416d-8606-848ae44eeeb4 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:01.489624 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 982/1962] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:00:01 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:01.490503 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f28c4-a27b-4892-b39d-b9f329a91f62 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:01.506183 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a15de-0059-4970-b363-d4e2d0b450b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:01.507213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a15de-0059-4970-b363-d4e2d0b450b2 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:01.507699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a15de-0059-4970-b363-d4e2d0b450b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:01.508198 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a15de-0059-4970-b363-d4e2d0b450b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:01.510165 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f28c4-a27b-4892-b39d-b9f329a91f62 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:01.523421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba3125-0d8f-457d-bc0c-9f803a6d161e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:01.524044 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba3125-0d8f-457d-bc0c-9f803a6d161e admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:01.524343 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba3125-0d8f-457d-bc0c-9f803a6d161e admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:01.524674 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba3125-0d8f-457d-bc0c-9f803a6d161e admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:01.525292 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba3125-0d8f-457d-bc0c-9f803a6d161e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:01.526155 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a15de-0059-4970-b363-d4e2d0b450b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:01.526891 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba3125-0d8f-457d-bc0c-9f803a6d161e admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:01.528910 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a15de-0059-4970-b363-d4e2d0b450b2 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:01.546165 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 981/1963] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:00:01.548120 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a15de-0059-4970-b363-d4e2d0b450b2 service neutron] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:01.558032 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 983/1964] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:01.559472 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba3125-0d8f-457d-bc0c-9f803a6d161e admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:01.563422 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a15de-0059-4970-b363-d4e2d0b450b2 service neutron] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:01.570448 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d90a6-3604-4d0b-9d36-46ae0b37d4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:01.575740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d90a6-3604-4d0b-9d36-46ae0b37d4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:01.575740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d90a6-3604-4d0b-9d36-46ae0b37d4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:01.575978 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba3125-0d8f-457d-bc0c-9f803a6d161e admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:01.576075 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d90a6-3604-4d0b-9d36-46ae0b37d4a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:01.576075 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d90a6-3604-4d0b-9d36-46ae0b37d4a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:01.576075 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d90a6-3604-4d0b-9d36-46ae0b37d4a9 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:01.577711 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56ef58-8712-40f0-92a0-27f0b7b92fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:01.578593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56ef58-8712-40f0-92a0-27f0b7b92fbb admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:01.579076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56ef58-8712-40f0-92a0-27f0b7b92fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:01.579542 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56ef58-8712-40f0-92a0-27f0b7b92fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:01.580406 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56ef58-8712-40f0-92a0-27f0b7b92fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:01.582809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56ef58-8712-40f0-92a0-27f0b7b92fbb admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:01.591450 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 982/1965] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:01.592909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d90a6-3604-4d0b-9d36-46ae0b37d4a9 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:01.594987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 984/1966] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:01.596056 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56ef58-8712-40f0-92a0-27f0b7b92fbb admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:01.607495 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56ef58-8712-40f0-92a0-27f0b7b92fbb admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:01.608321 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d90a6-3604-4d0b-9d36-46ae0b37d4a9 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:01.613671 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54784fcd-538a-43d9-a12f-f0c4d56e7000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:01.614746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54784fcd-538a-43d9-a12f-f0c4d56e7000 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:01.615246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54784fcd-538a-43d9-a12f-f0c4d56e7000 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:01.615769 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54784fcd-538a-43d9-a12f-f0c4d56e7000 admin admin] PATH_INFO: `/v3/projects/d015cafbeac4406e864cf2b7068ab4b5/users/0bacbac107dc4474b51c3a39023b2905/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:01.616192 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76f094-3055-4e59-a22b-000312832f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:01.617158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76f094-3055-4e59-a22b-000312832f29 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:01.617158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76f094-3055-4e59-a22b-000312832f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:01.617429 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76f094-3055-4e59-a22b-000312832f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:01.618071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76f094-3055-4e59-a22b-000312832f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:01.620314 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76f094-3055-4e59-a22b-000312832f29 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:01.636275 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 983/1967] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:01.637989 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76f094-3055-4e59-a22b-000312832f29 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:01.639985 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54784fcd-538a-43d9-a12f-f0c4d56e7000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d015cafbeac4406e864cf2b7068ab4b5, user_id=0bacbac107dc4474b51c3a39023b2905, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:01.642706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54784fcd-538a-43d9-a12f-f0c4d56e7000 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:01.656869 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76f094-3055-4e59-a22b-000312832f29 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:01.662787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d504ff-b222-4d0c-bf6b-a499e5040c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:01.663741 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d504ff-b222-4d0c-bf6b-a499e5040c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:01.664068 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d504ff-b222-4d0c-bf6b-a499e5040c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:01.664412 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d504ff-b222-4d0c-bf6b-a499e5040c97 admin admin] PATH_INFO: `/v3/projects/f2a188073baf4a06971a70ba2c37448b/users/c8b406e3c7bf4db585ffe6c99a0c2ba4/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:01.682588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d504ff-b222-4d0c-bf6b-a499e5040c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2a188073baf4a06971a70ba2c37448b, user_id=c8b406e3c7bf4db585ffe6c99a0c2ba4, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:01.685926 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d504ff-b222-4d0c-bf6b-a499e5040c97 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:01.758258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 985/1968] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:01 2022] PUT /identity/v3/projects/d015cafbeac4406e864cf2b7068ab4b5/users/0bacbac107dc4474b51c3a39023b2905/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:01.758258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54784fcd-538a-43d9-a12f-f0c4d56e7000 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:01.782589 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 984/1969] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:01 2022] PUT /identity/v3/projects/f2a188073baf4a06971a70ba2c37448b/users/c8b406e3c7bf4db585ffe6c99a0c2ba4/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:01.788781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58070f72-a830-45cb-864f-76534a44660d None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:01.789194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58070f72-a830-45cb-864f-76534a44660d None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:01.789577 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58070f72-a830-45cb-864f-76534a44660d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:01.839821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-58070f72-a830-45cb-864f-76534a44660d None None] MFA Rules not processed for user `0bacbac107dc4474b51c3a39023b2905`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:01.842282 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-58070f72-a830-45cb-864f-76534a44660d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:01.871420 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54784fcd-538a-43d9-a12f-f0c4d56e7000 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:01.945170 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 985/1970] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:01.946359 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58070f72-a830-45cb-864f-76534a44660d None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:01.972188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467de613-7411-41a2-818e-7a8af3221865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:01.974620 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467de613-7411-41a2-818e-7a8af3221865 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:01.975368 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467de613-7411-41a2-818e-7a8af3221865 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:01.976083 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467de613-7411-41a2-818e-7a8af3221865 admin admin] PATH_INFO: `/v3/projects/d369ad6ba41d46aa8d480be5176b0bff/users/985cc092239d44dca63c90fb415cbe1a/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:01.996438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467de613-7411-41a2-818e-7a8af3221865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d369ad6ba41d46aa8d480be5176b0bff, user_id=985cc092239d44dca63c90fb415cbe1a, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:01.999246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467de613-7411-41a2-818e-7a8af3221865 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:02.025562 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58070f72-a830-45cb-864f-76534a44660d None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:02.030690 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86224f12-6cf0-487f-be06-a6f65c3b9fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:02.031311 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86224f12-6cf0-487f-be06-a6f65c3b9fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:02.031669 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86224f12-6cf0-487f-be06-a6f65c3b9fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:02.031909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86224f12-6cf0-487f-be06-a6f65c3b9fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:02.032494 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86224f12-6cf0-487f-be06-a6f65c3b9fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:02.034176 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86224f12-6cf0-487f-be06-a6f65c3b9fe3 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:02.045803 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 986/1971] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:02.046852 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86224f12-6cf0-487f-be06-a6f65c3b9fe3 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:02.060164 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86224f12-6cf0-487f-be06-a6f65c3b9fe3 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:02.066529 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9393d7-7733-46bf-b94e-0a0183f55545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:02.067433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9393d7-7733-46bf-b94e-0a0183f55545 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:02.067872 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9393d7-7733-46bf-b94e-0a0183f55545 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:02.068142 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9393d7-7733-46bf-b94e-0a0183f55545 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:02.068769 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9393d7-7733-46bf-b94e-0a0183f55545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:02.070752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9393d7-7733-46bf-b94e-0a0183f55545 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:02.084376 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:02.093946 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 986/1972] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:01 2022] PUT /identity/v3/projects/d369ad6ba41d46aa8d480be5176b0bff/users/985cc092239d44dca63c90fb415cbe1a/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:02.095109 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467de613-7411-41a2-818e-7a8af3221865 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:02.198812 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467de613-7411-41a2-818e-7a8af3221865 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:02.199335 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04683f4-b5f6-44b4-a604-1d590c2cf304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:02.207572 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04683f4-b5f6-44b4-a604-1d590c2cf304 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:02.207869 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04683f4-b5f6-44b4-a604-1d590c2cf304 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:02.208234 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04683f4-b5f6-44b4-a604-1d590c2cf304 admin admin] PATH_INFO: `/v3/projects/f2a188073baf4a06971a70ba2c37448b/users/c8b406e3c7bf4db585ffe6c99a0c2ba4/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:02.215733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04683f4-b5f6-44b4-a604-1d590c2cf304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2a188073baf4a06971a70ba2c37448b, user_id=c8b406e3c7bf4db585ffe6c99a0c2ba4, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:02.218726 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04683f4-b5f6-44b4-a604-1d590c2cf304 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:02.234175 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 987/1973] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:02 2022] PUT /identity/v3/projects/f2a188073baf4a06971a70ba2c37448b/users/c8b406e3c7bf4db585ffe6c99a0c2ba4/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:02.236449 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b9e00-25ed-4293-ad6f-c58ee8b04d19 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:02.236734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b9e00-25ed-4293-ad6f-c58ee8b04d19 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:02.237536 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b9e00-25ed-4293-ad6f-c58ee8b04d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:02.279688 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-a17b9e00-25ed-4293-ad6f-c58ee8b04d19 None None] MFA Rules not processed for user `985cc092239d44dca63c90fb415cbe1a`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:02.280896 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-a17b9e00-25ed-4293-ad6f-c58ee8b04d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:02.281460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 987/1974] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:00:02 2022] POST /identity/v3/projects => generated 381 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:02.282624 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699da0f7-b8ab-4ed7-98b4-220cfeee3ddb None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:02.282907 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699da0f7-b8ab-4ed7-98b4-220cfeee3ddb None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:02.283179 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699da0f7-b8ab-4ed7-98b4-220cfeee3ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:02.316277 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-699da0f7-b8ab-4ed7-98b4-220cfeee3ddb None None] MFA Rules not processed for user `c8b406e3c7bf4db585ffe6c99a0c2ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:02.318040 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-699da0f7-b8ab-4ed7-98b4-220cfeee3ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:02.375073 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 988/1975] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:02.376272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b9e00-25ed-4293-ad6f-c58ee8b04d19 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:02.442096 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 988/1976] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:02.443022 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699da0f7-b8ab-4ed7-98b4-220cfeee3ddb None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:02.448881 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-699da0f7-b8ab-4ed7-98b4-220cfeee3ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:02.467593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b9e00-25ed-4293-ad6f-c58ee8b04d19 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:02.480758 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a451e-1ea8-454d-855d-9328984efcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:02.481733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a451e-1ea8-454d-855d-9328984efcd3 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:02.482305 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a451e-1ea8-454d-855d-9328984efcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:02.482777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a451e-1ea8-454d-855d-9328984efcd3 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:02.484247 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a451e-1ea8-454d-855d-9328984efcd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:02.491807 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a451e-1ea8-454d-855d-9328984efcd3 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:02.535572 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699da0f7-b8ab-4ed7-98b4-220cfeee3ddb None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:02.540775 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99171f7-d5fa-4f90-9770-bebaa50b6c2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:02.542168 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99171f7-d5fa-4f90-9770-bebaa50b6c2b service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:02.542883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99171f7-d5fa-4f90-9770-bebaa50b6c2b service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:02.543313 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99171f7-d5fa-4f90-9770-bebaa50b6c2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:02.552329 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:02.555958 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99171f7-d5fa-4f90-9770-bebaa50b6c2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:02.557383 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99171f7-d5fa-4f90-9770-bebaa50b6c2b service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:02.567547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 989/1977] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:00:02.568194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99171f7-d5fa-4f90-9770-bebaa50b6c2b service cinder] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:02.569484 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-e99171f7-d5fa-4f90-9770-bebaa50b6c2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:02.591397 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 989/1978] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:00:02 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:02.592444 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a451e-1ea8-454d-855d-9328984efcd3 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:02.597289 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99171f7-d5fa-4f90-9770-bebaa50b6c2b service cinder] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:02.599597 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-628a451e-1ea8-454d-855d-9328984efcd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:02.609033 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a03be-a91f-4dcc-a01e-b72a73151fdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:02.609668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a03be-a91f-4dcc-a01e-b72a73151fdc service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:02.609947 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a03be-a91f-4dcc-a01e-b72a73151fdc service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:02.610240 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a03be-a91f-4dcc-a01e-b72a73151fdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:02.632646 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a03be-a91f-4dcc-a01e-b72a73151fdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:02.635118 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a03be-a91f-4dcc-a01e-b72a73151fdc service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:02.641173 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a451e-1ea8-454d-855d-9328984efcd3 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:02.651005 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 990/1979] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:00:02.652230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a03be-a91f-4dcc-a01e-b72a73151fdc service cinder] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:02.666437 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8ff9b-fe02-4a8d-8856-c7580b1ff41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:02.673325 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8ff9b-fe02-4a8d-8856-c7580b1ff41c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:02.673697 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8ff9b-fe02-4a8d-8856-c7580b1ff41c admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:02.674125 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8ff9b-fe02-4a8d-8856-c7580b1ff41c admin admin] PATH_INFO: `/v3/projects/8a0aa9a2014e4a85880e8bd4995cce1f` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:02.678618 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8ff9b-fe02-4a8d-8856-c7580b1ff41c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a0aa9a2014e4a85880e8bd4995cce1f)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:02.683927 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8ff9b-fe02-4a8d-8856-c7580b1ff41c admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:02.691683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a03be-a91f-4dcc-a01e-b72a73151fdc service cinder] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:02.705527 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af348320-b19c-4740-8312-2a646d809f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:02.709217 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af348320-b19c-4740-8312-2a646d809f21 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:02.709524 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af348320-b19c-4740-8312-2a646d809f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:02.709803 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af348320-b19c-4740-8312-2a646d809f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:02.710498 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af348320-b19c-4740-8312-2a646d809f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:02.717757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af348320-b19c-4740-8312-2a646d809f21 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:02.743968 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 991/1980] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:02.748915 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af348320-b19c-4740-8312-2a646d809f21 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:02.771801 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af348320-b19c-4740-8312-2a646d809f21 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:02.782844 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17f037-6c3d-4c2e-843e-53c8c6b2a228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:02.785488 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17f037-6c3d-4c2e-843e-53c8c6b2a228 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:02.786730 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17f037-6c3d-4c2e-843e-53c8c6b2a228 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:02.787025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17f037-6c3d-4c2e-843e-53c8c6b2a228 admin admin] PATH_INFO: `/v3/projects/3128fbc420a449e1b05007f0e46d84f7/users/e5496dcc2d8c4d11864d93b085c0de55/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:02.823473 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17f037-6c3d-4c2e-843e-53c8c6b2a228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3128fbc420a449e1b05007f0e46d84f7, user_id=e5496dcc2d8c4d11864d93b085c0de55, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:02.826418 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17f037-6c3d-4c2e-843e-53c8c6b2a228 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:02.924378 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-3cc8ff9b-fe02-4a8d-8856-c7580b1ff41c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a0aa9a2014e4a85880e8bd4995cce1f', 'request_id': 'req-3cc8ff9b-fe02-4a8d-8856-c7580b1ff41c'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:02.929042 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 992/1981] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:02 2022] PUT /identity/v3/projects/3128fbc420a449e1b05007f0e46d84f7/users/e5496dcc2d8c4d11864d93b085c0de55/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:02.933000 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17f037-6c3d-4c2e-843e-53c8c6b2a228 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:02.935997 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-3cc8ff9b-fe02-4a8d-8856-c7580b1ff41c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a0aa9a2014e4a85880e8bd4995cce1f', 'request_id': 'req-3cc8ff9b-fe02-4a8d-8856-c7580b1ff41c'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:02.948082 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-3cc8ff9b-fe02-4a8d-8856-c7580b1ff41c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a0aa9a2014e4a85880e8bd4995cce1f', 'request_id': 'req-3cc8ff9b-fe02-4a8d-8856-c7580b1ff41c'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:03.057258 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17f037-6c3d-4c2e-843e-53c8c6b2a228 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:03.064211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22381cb3-1323-4ace-b5ac-9bfef2ea4854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:03.064966 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22381cb3-1323-4ace-b5ac-9bfef2ea4854 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:03.065317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22381cb3-1323-4ace-b5ac-9bfef2ea4854 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:03.069097 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22381cb3-1323-4ace-b5ac-9bfef2ea4854 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:03.069097 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22381cb3-1323-4ace-b5ac-9bfef2ea4854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:03.069097 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22381cb3-1323-4ace-b5ac-9bfef2ea4854 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:03.084050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 993/1982] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:00:03.091938 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22381cb3-1323-4ace-b5ac-9bfef2ea4854 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:03.097747 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-3cc8ff9b-fe02-4a8d-8856-c7580b1ff41c admin admin] The token cache is being invalidate because project 8a0aa9a2014e4a85880e8bd4995cce1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:00:03.097747 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-3cc8ff9b-fe02-4a8d-8856-c7580b1ff41c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:03.097747 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-3cc8ff9b-fe02-4a8d-8856-c7580b1ff41c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:03.103288 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 990/1983] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:00:02 2022] DELETE /identity/v3/projects/8a0aa9a2014e4a85880e8bd4995cce1f => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:03.106996 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8ff9b-fe02-4a8d-8856-c7580b1ff41c admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:03.110739 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-3cc8ff9b-fe02-4a8d-8856-c7580b1ff41c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:03.126961 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22381cb3-1323-4ace-b5ac-9bfef2ea4854 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:03.143888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a774899-07e6-4ade-a6ea-a2a51ba8a8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:03.144972 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a774899-07e6-4ade-a6ea-a2a51ba8a8a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:03.145314 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a774899-07e6-4ade-a6ea-a2a51ba8a8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:03.145651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a774899-07e6-4ade-a6ea-a2a51ba8a8a7 admin admin] PATH_INFO: `/v3/projects/3128fbc420a449e1b05007f0e46d84f7/users/e5496dcc2d8c4d11864d93b085c0de55/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:03.149442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a774899-07e6-4ade-a6ea-a2a51ba8a8a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3128fbc420a449e1b05007f0e46d84f7, user_id=e5496dcc2d8c4d11864d93b085c0de55, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:03.154890 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a774899-07e6-4ade-a6ea-a2a51ba8a8a7 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:03.181303 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 994/1984] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:03 2022] PUT /identity/v3/projects/3128fbc420a449e1b05007f0e46d84f7/users/e5496dcc2d8c4d11864d93b085c0de55/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:03.197095 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c0b89-8102-4225-bf79-52d590e20167 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:03.197594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c0b89-8102-4225-bf79-52d590e20167 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:03.197957 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c0b89-8102-4225-bf79-52d590e20167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:03.255980 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8ff9b-fe02-4a8d-8856-c7580b1ff41c admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:03.284070 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-672c0b89-8102-4225-bf79-52d590e20167 None None] MFA Rules not processed for user `e5496dcc2d8c4d11864d93b085c0de55`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:03.285396 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-672c0b89-8102-4225-bf79-52d590e20167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:03.363638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed088de7-9f8f-42fa-8fce-b95151aabb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:03.366124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed088de7-9f8f-42fa-8fce-b95151aabb9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:03.369520 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed088de7-9f8f-42fa-8fce-b95151aabb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:03.369520 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed088de7-9f8f-42fa-8fce-b95151aabb9d admin admin] PATH_INFO: `/v3/users/33c902b403e0400aae5952b06a668249` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:03.370858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed088de7-9f8f-42fa-8fce-b95151aabb9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=33c902b403e0400aae5952b06a668249)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:03.375565 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed088de7-9f8f-42fa-8fce-b95151aabb9d admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:03.470686 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 995/1985] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:00:03.511385 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c0b89-8102-4225-bf79-52d590e20167 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:03.512690 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-672c0b89-8102-4225-bf79-52d590e20167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:03.681098 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ed088de7-9f8f-42fa-8fce-b95151aabb9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33c902b403e0400aae5952b06a668249'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:03.705899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c0b89-8102-4225-bf79-52d590e20167 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:03.721541 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522fe91-e7a6-4095-8e0c-2f0d27cfd14e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:03.722764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522fe91-e7a6-4095-8e0c-2f0d27cfd14e service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:03.724179 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522fe91-e7a6-4095-8e0c-2f0d27cfd14e service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:03.724764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522fe91-e7a6-4095-8e0c-2f0d27cfd14e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:03.725566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ed088de7-9f8f-42fa-8fce-b95151aabb9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33c902b403e0400aae5952b06a668249'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:03.731578 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ed088de7-9f8f-42fa-8fce-b95151aabb9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33c902b403e0400aae5952b06a668249'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:03.751578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522fe91-e7a6-4095-8e0c-2f0d27cfd14e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:03.754852 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522fe91-e7a6-4095-8e0c-2f0d27cfd14e service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:03.758569 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ed088de7-9f8f-42fa-8fce-b95151aabb9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33c902b403e0400aae5952b06a668249'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:03.780344 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 996/1986] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:00:03.881022 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ed088de7-9f8f-42fa-8fce-b95151aabb9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33c902b403e0400aae5952b06a668249'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:03.893744 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 991/1987] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:00:03 2022] DELETE /identity/v3/users/33c902b403e0400aae5952b06a668249 => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:00:04.078736 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522fe91-e7a6-4095-8e0c-2f0d27cfd14e service cinder] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:04.080553 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-3522fe91-e7a6-4095-8e0c-2f0d27cfd14e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:04.097772 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522fe91-e7a6-4095-8e0c-2f0d27cfd14e service cinder] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:04.168247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d766732-c099-4085-a24c-f1b244916e42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:04.169227 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d766732-c099-4085-a24c-f1b244916e42 service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:04.169815 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d766732-c099-4085-a24c-f1b244916e42 service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:04.170302 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d766732-c099-4085-a24c-f1b244916e42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:04.173023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-7d766732-c099-4085-a24c-f1b244916e42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:04.251531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d766732-c099-4085-a24c-f1b244916e42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:04.253032 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d766732-c099-4085-a24c-f1b244916e42 service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:04.264285 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 997/1988] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:00:04.335158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:04.670656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed088de7-9f8f-42fa-8fce-b95151aabb9d admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:04.673202 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-ed088de7-9f8f-42fa-8fce-b95151aabb9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:04.718044 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:04.739889 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d766732-c099-4085-a24c-f1b244916e42 service cinder] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:04.741566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-7d766732-c099-4085-a24c-f1b244916e42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:04.823944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed088de7-9f8f-42fa-8fce-b95151aabb9d admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:04.829502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fbae2-09dc-48a7-9203-7ec7c666d601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:04.830492 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fbae2-09dc-48a7-9203-7ec7c666d601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:04.831565 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fbae2-09dc-48a7-9203-7ec7c666d601 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:04.831992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fbae2-09dc-48a7-9203-7ec7c666d601 admin admin] PATH_INFO: `/v3/projects/4994e547b8de4ae4a18495e79c2d1e96` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:04.833433 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9fbae2-09dc-48a7-9203-7ec7c666d601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4994e547b8de4ae4a18495e79c2d1e96)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:04.836365 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9fbae2-09dc-48a7-9203-7ec7c666d601 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:04.890406 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d766732-c099-4085-a24c-f1b244916e42 service cinder] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:04.897278 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bc995-6a8b-4294-b72e-c2b6c5cbaa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:04.897992 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bc995-6a8b-4294-b72e-c2b6c5cbaa8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:04.898309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bc995-6a8b-4294-b72e-c2b6c5cbaa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:04.898787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bc995-6a8b-4294-b72e-c2b6c5cbaa8f admin admin] PATH_INFO: `/v3/users/e7d9baae58814621a263bf11bcee02f5` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:04.899977 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bc995-6a8b-4294-b72e-c2b6c5cbaa8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7d9baae58814621a263bf11bcee02f5)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:04.903961 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bc995-6a8b-4294-b72e-c2b6c5cbaa8f admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:04.994265 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-3c9fbae2-09dc-48a7-9203-7ec7c666d601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4994e547b8de4ae4a18495e79c2d1e96', 'request_id': 'req-3c9fbae2-09dc-48a7-9203-7ec7c666d601'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:05.003552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-3c9fbae2-09dc-48a7-9203-7ec7c666d601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4994e547b8de4ae4a18495e79c2d1e96', 'request_id': 'req-3c9fbae2-09dc-48a7-9203-7ec7c666d601'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:05.012331 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-3c9fbae2-09dc-48a7-9203-7ec7c666d601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4994e547b8de4ae4a18495e79c2d1e96', 'request_id': 'req-3c9fbae2-09dc-48a7-9203-7ec7c666d601'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:05.139514 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-3c9fbae2-09dc-48a7-9203-7ec7c666d601 admin admin] The token cache is being invalidate because project 4994e547b8de4ae4a18495e79c2d1e96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:00:05.139844 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-3c9fbae2-09dc-48a7-9203-7ec7c666d601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:05.145121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-3c9fbae2-09dc-48a7-9203-7ec7c666d601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:05.147406 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 992/1989] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:00:04 2022] DELETE /identity/v3/projects/4994e547b8de4ae4a18495e79c2d1e96 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:05.156329 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed4491-34b3-4c3a-b4a1-bdf7c7549a7d None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:05.156706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed4491-34b3-4c3a-b4a1-bdf7c7549a7d None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:05.156992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed4491-34b3-4c3a-b4a1-bdf7c7549a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:05.209353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-d8ed4491-34b3-4c3a-b4a1-bdf7c7549a7d None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:05.211819 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-d8ed4491-34b3-4c3a-b4a1-bdf7c7549a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:05.222387 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ff0bc995-6a8b-4294-b72e-c2b6c5cbaa8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7d9baae58814621a263bf11bcee02f5'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:05.240055 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ff0bc995-6a8b-4294-b72e-c2b6c5cbaa8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7d9baae58814621a263bf11bcee02f5'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:05.241247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ff0bc995-6a8b-4294-b72e-c2b6c5cbaa8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7d9baae58814621a263bf11bcee02f5'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:05.241836 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ff0bc995-6a8b-4294-b72e-c2b6c5cbaa8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7d9baae58814621a263bf11bcee02f5'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:05.249522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ff0bc995-6a8b-4294-b72e-c2b6c5cbaa8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7d9baae58814621a263bf11bcee02f5'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:05.285529 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 993/1990] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:05.286283 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed4491-34b3-4c3a-b4a1-bdf7c7549a7d None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:05.287558 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-d8ed4491-34b3-4c3a-b4a1-bdf7c7549a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:05.300775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed4491-34b3-4c3a-b4a1-bdf7c7549a7d None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:05.306534 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c35e6-8e6e-46b3-b2e1-7a45140585ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:05.313942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c35e6-8e6e-46b3-b2e1-7a45140585ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:05.313942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c35e6-8e6e-46b3-b2e1-7a45140585ad admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:05.313942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c35e6-8e6e-46b3-b2e1-7a45140585ad admin admin] PATH_INFO: `/v3/users/0bacbac107dc4474b51c3a39023b2905` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:05.313942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c35e6-8e6e-46b3-b2e1-7a45140585ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bacbac107dc4474b51c3a39023b2905)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:05.313942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c35e6-8e6e-46b3-b2e1-7a45140585ad admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:05.343094 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 998/1991] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:00:04 2022] DELETE /identity/v3/users/e7d9baae58814621a263bf11bcee02f5 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:00:05.343094 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91832739-b797-4f58-bfa0-1129959cfd3d None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:05.343094 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91832739-b797-4f58-bfa0-1129959cfd3d None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:05.343378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91832739-b797-4f58-bfa0-1129959cfd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:05.367315 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-91832739-b797-4f58-bfa0-1129959cfd3d None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:05.369169 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-91832739-b797-4f58-bfa0-1129959cfd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:05.445327 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 999/1992] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:05.447106 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dc8d9-75e3-460d-ba46-09210e70e349 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:05.447738 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dc8d9-75e3-460d-ba46-09210e70e349 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:05.448323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dc8d9-75e3-460d-ba46-09210e70e349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:05.467299 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-636dc8d9-75e3-460d-ba46-09210e70e349 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:05.468911 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-636dc8d9-75e3-460d-ba46-09210e70e349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:05.477357 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1000/1993] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:05.478552 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636dc8d9-75e3-460d-ba46-09210e70e349 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:05.490739 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636dc8d9-75e3-460d-ba46-09210e70e349 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:05.498384 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9a660-6753-41f2-a69a-13a87dfd390c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:05.499312 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9a660-6753-41f2-a69a-13a87dfd390c admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:05.499820 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9a660-6753-41f2-a69a-13a87dfd390c admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:05.500303 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9a660-6753-41f2-a69a-13a87dfd390c admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:05.501258 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9a660-6753-41f2-a69a-13a87dfd390c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:00:05.501943 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9a660-6753-41f2-a69a-13a87dfd390c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:05.503841 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9a660-6753-41f2-a69a-13a87dfd390c admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:05.505210 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-174c35e6-8e6e-46b3-b2e1-7a45140585ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bacbac107dc4474b51c3a39023b2905'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:05.519290 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-174c35e6-8e6e-46b3-b2e1-7a45140585ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bacbac107dc4474b51c3a39023b2905'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:05.520043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-174c35e6-8e6e-46b3-b2e1-7a45140585ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bacbac107dc4474b51c3a39023b2905'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:05.522825 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1001/1994] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:00:05.523860 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9a660-6753-41f2-a69a-13a87dfd390c admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:05.525860 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-30f9a660-6753-41f2-a69a-13a87dfd390c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:05.528211 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-174c35e6-8e6e-46b3-b2e1-7a45140585ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bacbac107dc4474b51c3a39023b2905'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:05.589505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9a660-6753-41f2-a69a-13a87dfd390c admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:05.593179 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a66077-016a-4d3f-8871-fe11c8004bbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:05.593788 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a66077-016a-4d3f-8871-fe11c8004bbf service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:05.594064 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a66077-016a-4d3f-8871-fe11c8004bbf service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:05.594380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a66077-016a-4d3f-8871-fe11c8004bbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:05.603504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-174c35e6-8e6e-46b3-b2e1-7a45140585ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bacbac107dc4474b51c3a39023b2905'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:05.605725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a66077-016a-4d3f-8871-fe11c8004bbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:05.605839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:05.606014 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a66077-016a-4d3f-8871-fe11c8004bbf service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:05.613169 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 994/1995] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:00:05 2022] DELETE /identity/v3/users/0bacbac107dc4474b51c3a39023b2905 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:05.617069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1002/1996] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:00:05.618439 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6c82f-42c6-4dd5-9466-5bc0d09ad407 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:05.618727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6c82f-42c6-4dd5-9466-5bc0d09ad407 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:05.619061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6c82f-42c6-4dd5-9466-5bc0d09ad407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:05.619313 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c35e6-8e6e-46b3-b2e1-7a45140585ad admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:05.620682 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-174c35e6-8e6e-46b3-b2e1-7a45140585ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:05.643301 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-6ff6c82f-42c6-4dd5-9466-5bc0d09ad407 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:05.644523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-6ff6c82f-42c6-4dd5-9466-5bc0d09ad407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:05.700664 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c35e6-8e6e-46b3-b2e1-7a45140585ad admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:05.705493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666e130-c7bd-4aba-9cc0-d30ebd44ee9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:05.706338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666e130-c7bd-4aba-9cc0-d30ebd44ee9e admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:05.706845 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666e130-c7bd-4aba-9cc0-d30ebd44ee9e admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:05.707260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666e130-c7bd-4aba-9cc0-d30ebd44ee9e admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:05.708036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666e130-c7bd-4aba-9cc0-d30ebd44ee9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:05.710261 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666e130-c7bd-4aba-9cc0-d30ebd44ee9e admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:05.728688 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1003/1997] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:05.739297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6c82f-42c6-4dd5-9466-5bc0d09ad407 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:05.743283 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-6ff6c82f-42c6-4dd5-9466-5bc0d09ad407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:05.797137 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6c82f-42c6-4dd5-9466-5bc0d09ad407 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:05.800697 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103f898-bd50-420e-bfee-59da75b3c00c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:05.801303 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103f898-bd50-420e-bfee-59da75b3c00c service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:05.801578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103f898-bd50-420e-bfee-59da75b3c00c service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:05.801843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103f898-bd50-420e-bfee-59da75b3c00c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:05.810710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103f898-bd50-420e-bfee-59da75b3c00c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:05.812141 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103f898-bd50-420e-bfee-59da75b3c00c service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:05.821968 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1004/1998] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:00:05.840777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 995/1999] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:00:05 2022] POST /identity/v3/projects => generated 367 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:05.842275 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103f898-bd50-420e-bfee-59da75b3c00c service neutron] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:05.855324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103f898-bd50-420e-bfee-59da75b3c00c service neutron] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:05.917373 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38bca3-7cbe-4a2f-a906-e34f9faf3660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:05.918113 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38bca3-7cbe-4a2f-a906-e34f9faf3660 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:05.918423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38bca3-7cbe-4a2f-a906-e34f9faf3660 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:05.918697 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38bca3-7cbe-4a2f-a906-e34f9faf3660 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:05.919319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38bca3-7cbe-4a2f-a906-e34f9faf3660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:05.921277 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38bca3-7cbe-4a2f-a906-e34f9faf3660 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:06.039199 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1005/2000] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:00:05 2022] POST /identity/v3/users => generated 284 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:06.040769 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666e130-c7bd-4aba-9cc0-d30ebd44ee9e admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:06.052781 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666e130-c7bd-4aba-9cc0-d30ebd44ee9e admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:06.057776 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f2dba-25c8-4b4d-a77d-c134920d46af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:06.058439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f2dba-25c8-4b4d-a77d-c134920d46af admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:06.058719 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f2dba-25c8-4b4d-a77d-c134920d46af admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:06.058992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f2dba-25c8-4b4d-a77d-c134920d46af admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:06.059767 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f2dba-25c8-4b4d-a77d-c134920d46af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:06.061399 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f2dba-25c8-4b4d-a77d-c134920d46af admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:06.072294 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 996/2001] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:06.076279 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38bca3-7cbe-4a2f-a906-e34f9faf3660 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:06.087462 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38bca3-7cbe-4a2f-a906-e34f9faf3660 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:06.095793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51d5ad-4f87-4a6b-9fc1-dda0099c399c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:06.095793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51d5ad-4f87-4a6b-9fc1-dda0099c399c admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:06.095793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51d5ad-4f87-4a6b-9fc1-dda0099c399c admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:06.095793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51d5ad-4f87-4a6b-9fc1-dda0099c399c admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:06.096846 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51d5ad-4f87-4a6b-9fc1-dda0099c399c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:06.096846 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51d5ad-4f87-4a6b-9fc1-dda0099c399c admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:06.107014 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1006/2002] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:00:06.111155 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f2dba-25c8-4b4d-a77d-c134920d46af admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:06.122442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f2dba-25c8-4b4d-a77d-c134920d46af admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:06.142741 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d377d2-8586-4467-9fae-c22a13a6b5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:06.142741 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d377d2-8586-4467-9fae-c22a13a6b5b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:06.142741 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d377d2-8586-4467-9fae-c22a13a6b5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:06.142741 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d377d2-8586-4467-9fae-c22a13a6b5b2 admin admin] PATH_INFO: `/v3/projects/1aa81e18984548f489ad1efd07f0999e/users/662d8cc77653484c92101ab1c5bf0f99/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:06.150677 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d377d2-8586-4467-9fae-c22a13a6b5b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aa81e18984548f489ad1efd07f0999e, user_id=662d8cc77653484c92101ab1c5bf0f99, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:06.153380 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d377d2-8586-4467-9fae-c22a13a6b5b2 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:06.196565 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51d5ad-4f87-4a6b-9fc1-dda0099c399c admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:06.199077 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-8a51d5ad-4f87-4a6b-9fc1-dda0099c399c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:06.215519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51d5ad-4f87-4a6b-9fc1-dda0099c399c admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:06.220703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:06.223738 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74807f5-3ff4-45f3-8e98-e96291254a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:06.224382 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74807f5-3ff4-45f3-8e98-e96291254a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:06.224674 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74807f5-3ff4-45f3-8e98-e96291254a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:06.224987 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74807f5-3ff4-45f3-8e98-e96291254a21 admin admin] PATH_INFO: `/v3/projects/0d89027683ab4d5986cc1d05c29b2234` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:06.226025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74807f5-3ff4-45f3-8e98-e96291254a21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d89027683ab4d5986cc1d05c29b2234)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:06.228107 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74807f5-3ff4-45f3-8e98-e96291254a21 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:06.285041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 997/2003] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:06 2022] PUT /identity/v3/projects/1aa81e18984548f489ad1efd07f0999e/users/662d8cc77653484c92101ab1c5bf0f99/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:06.296658 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd34363-f384-4df4-8f24-4a119b01621e None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:06.296658 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd34363-f384-4df4-8f24-4a119b01621e None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:06.296843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd34363-f384-4df4-8f24-4a119b01621e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:06.327202 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-bcd34363-f384-4df4-8f24-4a119b01621e None None] MFA Rules not processed for user `662d8cc77653484c92101ab1c5bf0f99`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:06.328892 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-bcd34363-f384-4df4-8f24-4a119b01621e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:06.392190 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-c74807f5-3ff4-45f3-8e98-e96291254a21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d89027683ab4d5986cc1d05c29b2234', 'request_id': 'req-c74807f5-3ff4-45f3-8e98-e96291254a21'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:06.394230 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 998/2004] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:00:06.397382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd34363-f384-4df4-8f24-4a119b01621e None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:06.398312 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-c74807f5-3ff4-45f3-8e98-e96291254a21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d89027683ab4d5986cc1d05c29b2234', 'request_id': 'req-c74807f5-3ff4-45f3-8e98-e96291254a21'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:06.469217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd34363-f384-4df4-8f24-4a119b01621e None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:06.490627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-c74807f5-3ff4-45f3-8e98-e96291254a21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d89027683ab4d5986cc1d05c29b2234', 'request_id': 'req-c74807f5-3ff4-45f3-8e98-e96291254a21'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:06.503413 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-c74807f5-3ff4-45f3-8e98-e96291254a21 admin admin] The token cache is being invalidate because project 0d89027683ab4d5986cc1d05c29b2234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:00:06.503860 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-c74807f5-3ff4-45f3-8e98-e96291254a21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:06.504660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-c74807f5-3ff4-45f3-8e98-e96291254a21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:06.506234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1007/2005] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:00:06 2022] DELETE /identity/v3/projects/0d89027683ab4d5986cc1d05c29b2234 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:06.507062 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74807f5-3ff4-45f3-8e98-e96291254a21 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:06.508418 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-c74807f5-3ff4-45f3-8e98-e96291254a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:06.525905 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6b917-a8a2-4c75-a184-32d4a2bbe129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:06.526936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6b917-a8a2-4c75-a184-32d4a2bbe129 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:06.527041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6b917-a8a2-4c75-a184-32d4a2bbe129 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:06.527229 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6b917-a8a2-4c75-a184-32d4a2bbe129 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:06.527848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6b917-a8a2-4c75-a184-32d4a2bbe129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:06.529900 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6b917-a8a2-4c75-a184-32d4a2bbe129 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:06.575435 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74807f5-3ff4-45f3-8e98-e96291254a21 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:06.580252 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4477ad-94e3-4f12-9c16-f91807f532d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:06.581010 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4477ad-94e3-4f12-9c16-f91807f532d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:06.581294 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4477ad-94e3-4f12-9c16-f91807f532d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:06.581564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4477ad-94e3-4f12-9c16-f91807f532d7 admin admin] PATH_INFO: `/v3/projects/d015cafbeac4406e864cf2b7068ab4b5` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:06.582727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4477ad-94e3-4f12-9c16-f91807f532d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d015cafbeac4406e864cf2b7068ab4b5)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:06.584633 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4477ad-94e3-4f12-9c16-f91807f532d7 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:06.628355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 999/2006] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:00:06 2022] POST /identity/v3/projects => generated 365 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:06.629420 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6b917-a8a2-4c75-a184-32d4a2bbe129 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:06.631108 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-24f6b917-a8a2-4c75-a184-32d4a2bbe129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:06.695793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6b917-a8a2-4c75-a184-32d4a2bbe129 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:06.700607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ec080-0c09-4b3c-8e52-900bd5ff623c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:06.701262 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ec080-0c09-4b3c-8e52-900bd5ff623c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:06.701538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ec080-0c09-4b3c-8e52-900bd5ff623c admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:06.701816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ec080-0c09-4b3c-8e52-900bd5ff623c admin admin] PATH_INFO: `/v3/users/c8b406e3c7bf4db585ffe6c99a0c2ba4` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:06.702961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ec080-0c09-4b3c-8e52-900bd5ff623c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8b406e3c7bf4db585ffe6c99a0c2ba4)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:06.704977 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ec080-0c09-4b3c-8e52-900bd5ff623c admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:06.734203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-0c4477ad-94e3-4f12-9c16-f91807f532d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd015cafbeac4406e864cf2b7068ab4b5', 'request_id': 'req-0c4477ad-94e3-4f12-9c16-f91807f532d7'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:06.740098 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-0c4477ad-94e3-4f12-9c16-f91807f532d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd015cafbeac4406e864cf2b7068ab4b5', 'request_id': 'req-0c4477ad-94e3-4f12-9c16-f91807f532d7'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:06.819938 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-0c4477ad-94e3-4f12-9c16-f91807f532d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd015cafbeac4406e864cf2b7068ab4b5', 'request_id': 'req-0c4477ad-94e3-4f12-9c16-f91807f532d7'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:06.831255 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-0c4477ad-94e3-4f12-9c16-f91807f532d7 admin admin] The token cache is being invalidate because project d015cafbeac4406e864cf2b7068ab4b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:00:06.831547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-0c4477ad-94e3-4f12-9c16-f91807f532d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:06.832185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-0c4477ad-94e3-4f12-9c16-f91807f532d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:06.833695 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1008/2007] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:00:06 2022] DELETE /identity/v3/projects/d015cafbeac4406e864cf2b7068ab4b5 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:06.836802 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4477ad-94e3-4f12-9c16-f91807f532d7 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:06.836802 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-0c4477ad-94e3-4f12-9c16-f91807f532d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:06.896760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-1f0ec080-0c09-4b3c-8e52-900bd5ff623c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8b406e3c7bf4db585ffe6c99a0c2ba4'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:06.899715 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4477ad-94e3-4f12-9c16-f91807f532d7 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:06.904592 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3295e9-a245-4cff-a593-44b91ce79974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:06.905377 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3295e9-a245-4cff-a593-44b91ce79974 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:06.905667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3295e9-a245-4cff-a593-44b91ce79974 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:06.905942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3295e9-a245-4cff-a593-44b91ce79974 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:06.906629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3295e9-a245-4cff-a593-44b91ce79974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:06.908417 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-1f0ec080-0c09-4b3c-8e52-900bd5ff623c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8b406e3c7bf4db585ffe6c99a0c2ba4'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:06.909082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3295e9-a245-4cff-a593-44b91ce79974 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:06.909586 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-1f0ec080-0c09-4b3c-8e52-900bd5ff623c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8b406e3c7bf4db585ffe6c99a0c2ba4'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:06.916312 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-1f0ec080-0c09-4b3c-8e52-900bd5ff623c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8b406e3c7bf4db585ffe6c99a0c2ba4'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:07.023009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-1f0ec080-0c09-4b3c-8e52-900bd5ff623c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8b406e3c7bf4db585ffe6c99a0c2ba4'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:07.036362 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1009/2008] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:00:06 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:07.036486 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1000/2009] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:00:06 2022] DELETE /identity/v3/users/c8b406e3c7bf4db585ffe6c99a0c2ba4 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:07.036589 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3295e9-a245-4cff-a593-44b91ce79974 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:07.036589 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-8b3295e9-a245-4cff-a593-44b91ce79974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:07.036756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ec080-0c09-4b3c-8e52-900bd5ff623c admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:07.037653 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-1f0ec080-0c09-4b3c-8e52-900bd5ff623c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:07.047064 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3295e9-a245-4cff-a593-44b91ce79974 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:07.105362 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ec080-0c09-4b3c-8e52-900bd5ff623c admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:07.109882 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7af61a-ff27-4c10-8f67-bcc17df329ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:07.110520 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7af61a-ff27-4c10-8f67-bcc17df329ff admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:07.110847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7af61a-ff27-4c10-8f67-bcc17df329ff admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:07.111058 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7af61a-ff27-4c10-8f67-bcc17df329ff admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:07.111747 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7af61a-ff27-4c10-8f67-bcc17df329ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:07.113855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7af61a-ff27-4c10-8f67-bcc17df329ff admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:07.114787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d664659-74e9-44ae-bec2-bd83b9695543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:07.115430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d664659-74e9-44ae-bec2-bd83b9695543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:07.115707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d664659-74e9-44ae-bec2-bd83b9695543 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:07.116102 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d664659-74e9-44ae-bec2-bd83b9695543 admin admin] PATH_INFO: `/v3/users/e5496dcc2d8c4d11864d93b085c0de55` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:07.117783 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d664659-74e9-44ae-bec2-bd83b9695543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5496dcc2d8c4d11864d93b085c0de55)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:07.120572 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d664659-74e9-44ae-bec2-bd83b9695543 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:07.127012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1001/2010] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:07.128133 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7af61a-ff27-4c10-8f67-bcc17df329ff admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:07.137708 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7af61a-ff27-4c10-8f67-bcc17df329ff admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:07.142309 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccea119-eae3-4ec8-8eb9-44fe0a921fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:07.146610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccea119-eae3-4ec8-8eb9-44fe0a921fc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:07.146610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccea119-eae3-4ec8-8eb9-44fe0a921fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:07.146610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccea119-eae3-4ec8-8eb9-44fe0a921fc2 admin admin] PATH_INFO: `/v3/projects/e031b391c6e344afb267b9e047e767b8/users/ff25c8509d6a400fa522f7064a439266/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:07.159330 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccea119-eae3-4ec8-8eb9-44fe0a921fc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e031b391c6e344afb267b9e047e767b8, user_id=ff25c8509d6a400fa522f7064a439266, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:07.162153 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccea119-eae3-4ec8-8eb9-44fe0a921fc2 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:07.261637 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:07.274025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1002/2011] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:07 2022] PUT /identity/v3/projects/e031b391c6e344afb267b9e047e767b8/users/ff25c8509d6a400fa522f7064a439266/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:07.274985 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccea119-eae3-4ec8-8eb9-44fe0a921fc2 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:07.351991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccea119-eae3-4ec8-8eb9-44fe0a921fc2 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:07.357339 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c1729-43f9-48ab-8985-cadc164df85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:07.357898 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c1729-43f9-48ab-8985-cadc164df85d admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:07.358208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c1729-43f9-48ab-8985-cadc164df85d admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:07.358619 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c1729-43f9-48ab-8985-cadc164df85d admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:07.359407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c1729-43f9-48ab-8985-cadc164df85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:07.360945 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c1729-43f9-48ab-8985-cadc164df85d admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:07.382889 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1003/2012] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:07.384017 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c1729-43f9-48ab-8985-cadc164df85d admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:07.395300 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c1729-43f9-48ab-8985-cadc164df85d admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:07.400792 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186beb9b-a59b-4c20-8924-7b87dee645ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:07.401436 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186beb9b-a59b-4c20-8924-7b87dee645ed admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:07.401718 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186beb9b-a59b-4c20-8924-7b87dee645ed admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:07.401994 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186beb9b-a59b-4c20-8924-7b87dee645ed admin admin] PATH_INFO: `/v3/projects/e031b391c6e344afb267b9e047e767b8/users/ff25c8509d6a400fa522f7064a439266/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:07.404025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-1d664659-74e9-44ae-bec2-bd83b9695543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5496dcc2d8c4d11864d93b085c0de55'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:07.404212 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186beb9b-a59b-4c20-8924-7b87dee645ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e031b391c6e344afb267b9e047e767b8, user_id=ff25c8509d6a400fa522f7064a439266, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:07.407379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186beb9b-a59b-4c20-8924-7b87dee645ed admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:07.418457 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-1d664659-74e9-44ae-bec2-bd83b9695543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5496dcc2d8c4d11864d93b085c0de55'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:07.420514 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-1d664659-74e9-44ae-bec2-bd83b9695543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5496dcc2d8c4d11864d93b085c0de55'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:07.421386 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-1d664659-74e9-44ae-bec2-bd83b9695543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5496dcc2d8c4d11864d93b085c0de55'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:07.429378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-1d664659-74e9-44ae-bec2-bd83b9695543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5496dcc2d8c4d11864d93b085c0de55'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:07.429567 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1004/2013] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:07 2022] PUT /identity/v3/projects/e031b391c6e344afb267b9e047e767b8/users/ff25c8509d6a400fa522f7064a439266/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:07.430931 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa72e80-e851-4877-8212-08ad442fecf9 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:07.431221 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa72e80-e851-4877-8212-08ad442fecf9 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:07.431497 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa72e80-e851-4877-8212-08ad442fecf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:07.458958 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-4fa72e80-e851-4877-8212-08ad442fecf9 None None] MFA Rules not processed for user `ff25c8509d6a400fa522f7064a439266`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:07.460191 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-4fa72e80-e851-4877-8212-08ad442fecf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:07.531816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1005/2014] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:07.532896 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa72e80-e851-4877-8212-08ad442fecf9 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:07.536210 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-4fa72e80-e851-4877-8212-08ad442fecf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:07.558850 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1010/2015] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:00:07 2022] DELETE /identity/v3/users/e5496dcc2d8c4d11864d93b085c0de55 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:07.563280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d664659-74e9-44ae-bec2-bd83b9695543 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:07.563280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-1d664659-74e9-44ae-bec2-bd83b9695543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:07.616047 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa72e80-e851-4877-8212-08ad442fecf9 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:07.641104 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d664659-74e9-44ae-bec2-bd83b9695543 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:07.647702 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d44f2-2659-443d-bd95-c22c3623d3fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:07.649299 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d44f2-2659-443d-bd95-c22c3623d3fe service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:07.650248 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d44f2-2659-443d-bd95-c22c3623d3fe service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:07.650691 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d44f2-2659-443d-bd95-c22c3623d3fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:07.712094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794c7fa-603a-4eac-97b6-1176b0cdcb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:07.712720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794c7fa-603a-4eac-97b6-1176b0cdcb1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:07.712996 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794c7fa-603a-4eac-97b6-1176b0cdcb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:07.714145 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794c7fa-603a-4eac-97b6-1176b0cdcb1f admin admin] PATH_INFO: `/v3/projects/f2a188073baf4a06971a70ba2c37448b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:07.717838 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:07.718845 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794c7fa-603a-4eac-97b6-1176b0cdcb1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2a188073baf4a06971a70ba2c37448b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:07.721008 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794c7fa-603a-4eac-97b6-1176b0cdcb1f admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:07.747762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d44f2-2659-443d-bd95-c22c3623d3fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:07.749450 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d44f2-2659-443d-bd95-c22c3623d3fe service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:07.761733 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1011/2016] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:07 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:00:07.931952 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c794c7fa-603a-4eac-97b6-1176b0cdcb1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2a188073baf4a06971a70ba2c37448b', 'request_id': 'req-c794c7fa-603a-4eac-97b6-1176b0cdcb1f'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:07.947836 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c794c7fa-603a-4eac-97b6-1176b0cdcb1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2a188073baf4a06971a70ba2c37448b', 'request_id': 'req-c794c7fa-603a-4eac-97b6-1176b0cdcb1f'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:07.960214 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c794c7fa-603a-4eac-97b6-1176b0cdcb1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2a188073baf4a06971a70ba2c37448b', 'request_id': 'req-c794c7fa-603a-4eac-97b6-1176b0cdcb1f'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:08.016054 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d44f2-2659-443d-bd95-c22c3623d3fe service cinder] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:08.025313 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d44f2-2659-443d-bd95-c22c3623d3fe service cinder] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:08.057265 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c794c7fa-603a-4eac-97b6-1176b0cdcb1f admin admin] The token cache is being invalidate because project f2a188073baf4a06971a70ba2c37448b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:00:08.057652 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c794c7fa-603a-4eac-97b6-1176b0cdcb1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:08.058551 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c794c7fa-603a-4eac-97b6-1176b0cdcb1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:08.060341 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1006/2017] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:00:07 2022] DELETE /identity/v3/projects/f2a188073baf4a06971a70ba2c37448b => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:08.064852 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec6533-3964-4167-b854-7d5ba21a990b None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:08.065762 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec6533-3964-4167-b854-7d5ba21a990b None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:08.066167 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec6533-3964-4167-b854-7d5ba21a990b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:08.078368 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626a799-2dbf-4885-9d39-85b44af3a619 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:08.091830 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626a799-2dbf-4885-9d39-85b44af3a619 service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:08.091830 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626a799-2dbf-4885-9d39-85b44af3a619 service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:08.091830 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626a799-2dbf-4885-9d39-85b44af3a619 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:08.095392 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-0aec6533-3964-4167-b854-7d5ba21a990b None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:08.097005 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-0aec6533-3964-4167-b854-7d5ba21a990b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:08.100365 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-d626a799-2dbf-4885-9d39-85b44af3a619 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:08.186668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626a799-2dbf-4885-9d39-85b44af3a619 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:08.189524 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626a799-2dbf-4885-9d39-85b44af3a619 service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:08.200495 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1007/2018] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:00:08.201865 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec6533-3964-4167-b854-7d5ba21a990b None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:08.203115 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1012/2019] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:00:08.203460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-0aec6533-3964-4167-b854-7d5ba21a990b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:08.208404 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09da10-bfe6-4f1d-b806-a07a85b37638 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:08.208642 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09da10-bfe6-4f1d-b806-a07a85b37638 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:08.208914 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09da10-bfe6-4f1d-b806-a07a85b37638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:08.218566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec6533-3964-4167-b854-7d5ba21a990b None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:08.225544 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958ecdc-f329-4ee2-b3f7-abb4d4ec126b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:08.226404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958ecdc-f329-4ee2-b3f7-abb4d4ec126b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:08.226920 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958ecdc-f329-4ee2-b3f7-abb4d4ec126b admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:08.227336 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958ecdc-f329-4ee2-b3f7-abb4d4ec126b admin admin] PATH_INFO: `/v3/projects/3128fbc420a449e1b05007f0e46d84f7` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:08.228226 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-0b09da10-bfe6-4f1d-b806-a07a85b37638 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:08.229100 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958ecdc-f329-4ee2-b3f7-abb4d4ec126b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3128fbc420a449e1b05007f0e46d84f7)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:08.229442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-0b09da10-bfe6-4f1d-b806-a07a85b37638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:08.231469 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958ecdc-f329-4ee2-b3f7-abb4d4ec126b admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:08.242431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1013/2020] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:08.243319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09da10-bfe6-4f1d-b806-a07a85b37638 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:08.253496 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09da10-bfe6-4f1d-b806-a07a85b37638 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:08.258397 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700549c5-2b17-4c7b-917f-08e341a8295f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:08.258984 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700549c5-2b17-4c7b-917f-08e341a8295f admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:08.259260 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700549c5-2b17-4c7b-917f-08e341a8295f admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:08.259529 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700549c5-2b17-4c7b-917f-08e341a8295f admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:08.260177 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700549c5-2b17-4c7b-917f-08e341a8295f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:00:08.260529 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700549c5-2b17-4c7b-917f-08e341a8295f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:08.262156 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700549c5-2b17-4c7b-917f-08e341a8295f admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:08.281059 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1014/2021] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:00:08.281059 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700549c5-2b17-4c7b-917f-08e341a8295f admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:08.302498 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700549c5-2b17-4c7b-917f-08e341a8295f admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:08.314189 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd5a49-a006-4058-a368-71a323bbe6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:08.316242 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd5a49-a006-4058-a368-71a323bbe6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:08.317296 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd5a49-a006-4058-a368-71a323bbe6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:08.317700 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd5a49-a006-4058-a368-71a323bbe6e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:08.318726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd5a49-a006-4058-a368-71a323bbe6e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:08.325257 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd5a49-a006-4058-a368-71a323bbe6e2 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:08.347816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-9958ecdc-f329-4ee2-b3f7-abb4d4ec126b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3128fbc420a449e1b05007f0e46d84f7', 'request_id': 'req-9958ecdc-f329-4ee2-b3f7-abb4d4ec126b'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:08.357034 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-9958ecdc-f329-4ee2-b3f7-abb4d4ec126b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3128fbc420a449e1b05007f0e46d84f7', 'request_id': 'req-9958ecdc-f329-4ee2-b3f7-abb4d4ec126b'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:08.364903 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-9958ecdc-f329-4ee2-b3f7-abb4d4ec126b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3128fbc420a449e1b05007f0e46d84f7', 'request_id': 'req-9958ecdc-f329-4ee2-b3f7-abb4d4ec126b'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:08.381245 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:08.447251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1015/2022] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:00:08 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:08.451501 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd5a49-a006-4058-a368-71a323bbe6e2 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:08.478638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-9958ecdc-f329-4ee2-b3f7-abb4d4ec126b admin admin] The token cache is being invalidate because project 3128fbc420a449e1b05007f0e46d84f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:00:08.479580 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-9958ecdc-f329-4ee2-b3f7-abb4d4ec126b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:08.480592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-9958ecdc-f329-4ee2-b3f7-abb4d4ec126b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:08.484106 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1008/2023] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:00:08 2022] DELETE /identity/v3/projects/3128fbc420a449e1b05007f0e46d84f7 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:08.489654 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b32e1-85b3-434d-a11c-fda2b05407aa None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:08.491180 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b32e1-85b3-434d-a11c-fda2b05407aa None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:08.491689 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b32e1-85b3-434d-a11c-fda2b05407aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:08.517401 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-7d4b32e1-85b3-434d-a11c-fda2b05407aa None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:08.518706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-7d4b32e1-85b3-434d-a11c-fda2b05407aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:08.554029 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd5a49-a006-4058-a368-71a323bbe6e2 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:08.567428 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169cfa1-8944-48bf-84d5-31c0d1fb84f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:08.568144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169cfa1-8944-48bf-84d5-31c0d1fb84f8 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:08.568331 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169cfa1-8944-48bf-84d5-31c0d1fb84f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:08.568608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169cfa1-8944-48bf-84d5-31c0d1fb84f8 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:08.569242 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169cfa1-8944-48bf-84d5-31c0d1fb84f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:08.571951 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169cfa1-8944-48bf-84d5-31c0d1fb84f8 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:08.613956 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1009/2024] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:08.622773 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584c4cf-ecf4-4221-ade9-e78d0b359ee3 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:08.623061 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584c4cf-ecf4-4221-ade9-e78d0b359ee3 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:08.623339 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584c4cf-ecf4-4221-ade9-e78d0b359ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:08.645348 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-1584c4cf-ecf4-4221-ade9-e78d0b359ee3 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:08.646522 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-1584c4cf-ecf4-4221-ade9-e78d0b359ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:08.656597 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1010/2025] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:00:08.664895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584c4cf-ecf4-4221-ade9-e78d0b359ee3 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:08.674704 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584c4cf-ecf4-4221-ade9-e78d0b359ee3 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:08.684418 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31724bc4-766c-4126-b08f-33bf1ce77146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:08.689030 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31724bc4-766c-4126-b08f-33bf1ce77146 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:08.689263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1016/2026] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:00:08 2022] POST /identity/v3/users => generated 287 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:08.689345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31724bc4-766c-4126-b08f-33bf1ce77146 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:08.689345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31724bc4-766c-4126-b08f-33bf1ce77146 admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:08.689345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31724bc4-766c-4126-b08f-33bf1ce77146 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:00:08.689345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31724bc4-766c-4126-b08f-33bf1ce77146 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:08.689979 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31724bc4-766c-4126-b08f-33bf1ce77146 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:08.692055 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169cfa1-8944-48bf-84d5-31c0d1fb84f8 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:08.701603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-d169cfa1-8944-48bf-84d5-31c0d1fb84f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:08.707100 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1011/2027] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:00:08.717661 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31724bc4-766c-4126-b08f-33bf1ce77146 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:08.718155 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169cfa1-8944-48bf-84d5-31c0d1fb84f8 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:08.722745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73638d2-ffe7-4beb-b300-85f21a272ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:08.723399 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73638d2-ffe7-4beb-b300-85f21a272ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:08.723681 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73638d2-ffe7-4beb-b300-85f21a272ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:08.723960 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73638d2-ffe7-4beb-b300-85f21a272ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:08.724711 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73638d2-ffe7-4beb-b300-85f21a272ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:08.726338 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73638d2-ffe7-4beb-b300-85f21a272ee9 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:08.726468 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31724bc4-766c-4126-b08f-33bf1ce77146 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:08.732055 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02bc62-c778-4b4e-aed3-e07e4e067cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:08.732650 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02bc62-c778-4b4e-aed3-e07e4e067cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:08.733232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02bc62-c778-4b4e-aed3-e07e4e067cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:08.733378 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02bc62-c778-4b4e-aed3-e07e4e067cb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:08.733886 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02bc62-c778-4b4e-aed3-e07e4e067cb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:08.735814 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02bc62-c778-4b4e-aed3-e07e4e067cb3 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:08.741259 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1017/2028] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:08.752514 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73638d2-ffe7-4beb-b300-85f21a272ee9 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:08.760524 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73638d2-ffe7-4beb-b300-85f21a272ee9 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:08.765459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c91d0b-6f8e-45ba-bead-52270c8e0b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:08.766158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c91d0b-6f8e-45ba-bead-52270c8e0b56 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:08.766527 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c91d0b-6f8e-45ba-bead-52270c8e0b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:08.766867 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c91d0b-6f8e-45ba-bead-52270c8e0b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:08.767577 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c91d0b-6f8e-45ba-bead-52270c8e0b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:08.769771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c91d0b-6f8e-45ba-bead-52270c8e0b56 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:08.781005 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1018/2029] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:08.785600 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c91d0b-6f8e-45ba-bead-52270c8e0b56 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:08.800974 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c91d0b-6f8e-45ba-bead-52270c8e0b56 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:08.807946 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96f357-31a2-4852-8c73-f9c06b7c88e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:08.807946 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96f357-31a2-4852-8c73-f9c06b7c88e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:08.807946 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96f357-31a2-4852-8c73-f9c06b7c88e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:08.807946 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96f357-31a2-4852-8c73-f9c06b7c88e9 admin admin] PATH_INFO: `/v3/projects/5bae0bece8044690ac87610fe730bb95/users/ad1378dc8de24356ac591e49759f3b75/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:08.825992 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96f357-31a2-4852-8c73-f9c06b7c88e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bae0bece8044690ac87610fe730bb95, user_id=ad1378dc8de24356ac591e49759f3b75, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:08.828854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96f357-31a2-4852-8c73-f9c06b7c88e9 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:08.844014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1012/2030] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:00:08 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:00:08.847966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02bc62-c778-4b4e-aed3-e07e4e067cb3 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:08.863532 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:08.940871 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02bc62-c778-4b4e-aed3-e07e4e067cb3 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:08.946992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9e426-47b0-404a-b05a-915faa88a4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:08.947665 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9e426-47b0-404a-b05a-915faa88a4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:08.947855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9e426-47b0-404a-b05a-915faa88a4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:08.948121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9e426-47b0-404a-b05a-915faa88a4a1 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:08.948749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9e426-47b0-404a-b05a-915faa88a4a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:08.950736 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9e426-47b0-404a-b05a-915faa88a4a1 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:08.995293 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1019/2031] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:08 2022] PUT /identity/v3/projects/5bae0bece8044690ac87610fe730bb95/users/ad1378dc8de24356ac591e49759f3b75/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:09.001409 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44283d6c-22e4-4030-afac-0b2c007678df None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:09.002049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44283d6c-22e4-4030-afac-0b2c007678df None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:09.002507 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44283d6c-22e4-4030-afac-0b2c007678df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:09.034197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-44283d6c-22e4-4030-afac-0b2c007678df None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:09.036014 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-44283d6c-22e4-4030-afac-0b2c007678df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:09.112402 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1013/2032] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:00:08 2022] POST /identity/v3/users => generated 288 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:09.113541 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9e426-47b0-404a-b05a-915faa88a4a1 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:09.126532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9e426-47b0-404a-b05a-915faa88a4a1 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:09.130124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1020/2033] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:00:09.133351 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a91a2-99e2-40db-9f94-b50dd6a2070e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:09.133351 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a91a2-99e2-40db-9f94-b50dd6a2070e admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:09.133351 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a91a2-99e2-40db-9f94-b50dd6a2070e admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:09.133351 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a91a2-99e2-40db-9f94-b50dd6a2070e admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:09.133856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a91a2-99e2-40db-9f94-b50dd6a2070e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:09.135851 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a91a2-99e2-40db-9f94-b50dd6a2070e admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:09.144818 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44283d6c-22e4-4030-afac-0b2c007678df None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:09.146553 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-44283d6c-22e4-4030-afac-0b2c007678df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:09.151950 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1014/2034] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:09.152998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a91a2-99e2-40db-9f94-b50dd6a2070e admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:09.165224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a91a2-99e2-40db-9f94-b50dd6a2070e admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:09.170456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c9bdf-e955-4e08-9713-5f206be33da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:09.171140 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c9bdf-e955-4e08-9713-5f206be33da7 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:09.171489 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c9bdf-e955-4e08-9713-5f206be33da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:09.171880 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c9bdf-e955-4e08-9713-5f206be33da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:09.172703 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c9bdf-e955-4e08-9713-5f206be33da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:09.174693 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c9bdf-e955-4e08-9713-5f206be33da7 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:09.202126 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1015/2035] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:00:09.203096 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c9bdf-e955-4e08-9713-5f206be33da7 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:09.216012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c9bdf-e955-4e08-9713-5f206be33da7 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:09.220776 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f055d2-05a3-4ef6-8cc8-8a62b23c4a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:09.221885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f055d2-05a3-4ef6-8cc8-8a62b23c4a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:09.222073 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f055d2-05a3-4ef6-8cc8-8a62b23c4a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:09.222388 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f055d2-05a3-4ef6-8cc8-8a62b23c4a80 admin admin] PATH_INFO: `/v3/projects/50cb5ebbf5a84e63a8f536e23ebfa92f/users/bda470ade8254d66a7b4475de1c13e46/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:09.225619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44283d6c-22e4-4030-afac-0b2c007678df None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:09.230328 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1b34c-b9b8-4740-9cdb-c84619096282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:09.238168 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1b34c-b9b8-4740-9cdb-c84619096282 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:09.238168 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1b34c-b9b8-4740-9cdb-c84619096282 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:09.238168 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1b34c-b9b8-4740-9cdb-c84619096282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:09.238460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f055d2-05a3-4ef6-8cc8-8a62b23c4a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50cb5ebbf5a84e63a8f536e23ebfa92f, user_id=bda470ade8254d66a7b4475de1c13e46, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:09.240378 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f055d2-05a3-4ef6-8cc8-8a62b23c4a80 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:09.240835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1b34c-b9b8-4740-9cdb-c84619096282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:09.242317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1b34c-b9b8-4740-9cdb-c84619096282 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:09.251640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1021/2036] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:00:09.321737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1016/2037] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:09 2022] PUT /identity/v3/projects/50cb5ebbf5a84e63a8f536e23ebfa92f/users/bda470ade8254d66a7b4475de1c13e46/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:09.333155 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de949c2-0878-4895-8166-95028a54e0ce None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:09.333487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de949c2-0878-4895-8166-95028a54e0ce None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:09.335741 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de949c2-0878-4895-8166-95028a54e0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:09.363813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-8de949c2-0878-4895-8166-95028a54e0ce None None] MFA Rules not processed for user `bda470ade8254d66a7b4475de1c13e46`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:09.365727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-8de949c2-0878-4895-8166-95028a54e0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:09.442226 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1022/2038] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:09.454681 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f055d2-05a3-4ef6-8cc8-8a62b23c4a80 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:09.457844 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-38f055d2-05a3-4ef6-8cc8-8a62b23c4a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:09.537350 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f055d2-05a3-4ef6-8cc8-8a62b23c4a80 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:09.541052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da858e29-bf80-48f1-bd99-b5903dbde6c5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7791be968594cea9c32b51a7b3454b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:09.541712 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da858e29-bf80-48f1-bd99-b5903dbde6c5 service glance] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:09.541985 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da858e29-bf80-48f1-bd99-b5903dbde6c5 service glance] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:09.542278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da858e29-bf80-48f1-bd99-b5903dbde6c5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:09.551297 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da858e29-bf80-48f1-bd99-b5903dbde6c5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:09.552724 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da858e29-bf80-48f1-bd99-b5903dbde6c5 service glance] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:09.561568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1017/2039] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:00:09.694954 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:10.753182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52feedf1-1b5f-44fc-b9d0-d7d90f97f3f0 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:10.754460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52feedf1-1b5f-44fc-b9d0-d7d90f97f3f0 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:10.754974 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52feedf1-1b5f-44fc-b9d0-d7d90f97f3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:10.803217 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-52feedf1-1b5f-44fc-b9d0-d7d90f97f3f0 None None] MFA Rules not processed for user `ad1378dc8de24356ac591e49759f3b75`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:10.804722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-52feedf1-1b5f-44fc-b9d0-d7d90f97f3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:10.866324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:10.895555 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1023/2040] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:00:10.900169 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da858e29-bf80-48f1-bd99-b5903dbde6c5 service glance] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:10.970159 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da858e29-bf80-48f1-bd99-b5903dbde6c5 service glance] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:10.976147 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3e8f9-95b7-4250-8e7f-5d4ece482624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:10.977057 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3e8f9-95b7-4250-8e7f-5d4ece482624 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:10.977531 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3e8f9-95b7-4250-8e7f-5d4ece482624 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:10.978118 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3e8f9-95b7-4250-8e7f-5d4ece482624 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:10.979389 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3e8f9-95b7-4250-8e7f-5d4ece482624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:10.981499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3e8f9-95b7-4250-8e7f-5d4ece482624 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:11.116974 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1018/2041] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:00:10 2022] POST /identity/v3/projects => generated 371 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:11.118199 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52feedf1-1b5f-44fc-b9d0-d7d90f97f3f0 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:11.131893 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52feedf1-1b5f-44fc-b9d0-d7d90f97f3f0 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:11.187702 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5a7e4-a0fd-4cbc-b01b-e4804537f14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:11.188318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5a7e4-a0fd-4cbc-b01b-e4804537f14a admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:11.188595 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5a7e4-a0fd-4cbc-b01b-e4804537f14a admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:11.188865 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5a7e4-a0fd-4cbc-b01b-e4804537f14a admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:11.189497 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad5a7e4-a0fd-4cbc-b01b-e4804537f14a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:11.192010 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad5a7e4-a0fd-4cbc-b01b-e4804537f14a admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:11.284221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1024/2042] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:00:11 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:00:11.287952 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3e8f9-95b7-4250-8e7f-5d4ece482624 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:11.299910 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3e8f9-95b7-4250-8e7f-5d4ece482624 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:11.304446 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e053a-e818-4022-b027-21b124d6668f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:11.305040 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e053a-e818-4022-b027-21b124d6668f admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:11.305315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e053a-e818-4022-b027-21b124d6668f admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:11.305583 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e053a-e818-4022-b027-21b124d6668f admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:11.306247 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e053a-e818-4022-b027-21b124d6668f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:11.307862 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e053a-e818-4022-b027-21b124d6668f admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:11.318447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1019/2043] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:11.322612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5a7e4-a0fd-4cbc-b01b-e4804537f14a admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:11.332895 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5a7e4-a0fd-4cbc-b01b-e4804537f14a admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:11.340482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9f7da-235c-47f9-acaa-c09f8596f63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:11.341474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9f7da-235c-47f9-acaa-c09f8596f63f admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:11.341844 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9f7da-235c-47f9-acaa-c09f8596f63f admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:11.342585 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9f7da-235c-47f9-acaa-c09f8596f63f admin admin] PATH_INFO: `/v3/projects/7d5d8ffe92084b4d9a808cb6c19949fc/users/f8b03f5aaa1c4463adc55bb55d5a10eb/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:11.363364 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9f7da-235c-47f9-acaa-c09f8596f63f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d5d8ffe92084b4d9a808cb6c19949fc, user_id=f8b03f5aaa1c4463adc55bb55d5a10eb, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:11.366810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9f7da-235c-47f9-acaa-c09f8596f63f admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:11.481488 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1025/2044] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:11 2022] PUT /identity/v3/projects/7d5d8ffe92084b4d9a808cb6c19949fc/users/f8b03f5aaa1c4463adc55bb55d5a10eb/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:11.485440 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e053a-e818-4022-b027-21b124d6668f admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:11.495332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e053a-e818-4022-b027-21b124d6668f admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:11.550839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc2bdb-7ad1-41ff-98a0-980f54af94b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:11.551446 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc2bdb-7ad1-41ff-98a0-980f54af94b9 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:11.551723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc2bdb-7ad1-41ff-98a0-980f54af94b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:11.551994 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc2bdb-7ad1-41ff-98a0-980f54af94b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:11.552628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc2bdb-7ad1-41ff-98a0-980f54af94b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:11.554320 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc2bdb-7ad1-41ff-98a0-980f54af94b9 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:11.568337 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1020/2045] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:11.568913 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9f7da-235c-47f9-acaa-c09f8596f63f admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:11.580004 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9f7da-235c-47f9-acaa-c09f8596f63f admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:11.585538 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd162a1-a19a-4b07-bfad-cc65213f99c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:11.586158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd162a1-a19a-4b07-bfad-cc65213f99c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:11.586441 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd162a1-a19a-4b07-bfad-cc65213f99c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:11.586799 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd162a1-a19a-4b07-bfad-cc65213f99c4 admin admin] PATH_INFO: `/v3/projects/7d5d8ffe92084b4d9a808cb6c19949fc/users/f8b03f5aaa1c4463adc55bb55d5a10eb/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:11.588871 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd162a1-a19a-4b07-bfad-cc65213f99c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d5d8ffe92084b4d9a808cb6c19949fc, user_id=f8b03f5aaa1c4463adc55bb55d5a10eb, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:11.591587 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd162a1-a19a-4b07-bfad-cc65213f99c4 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:11.606597 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1026/2046] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:11 2022] PUT /identity/v3/projects/7d5d8ffe92084b4d9a808cb6c19949fc/users/f8b03f5aaa1c4463adc55bb55d5a10eb/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:12.240438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc2bdb-7ad1-41ff-98a0-980f54af94b9 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:12.242513 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-95dc2bdb-7ad1-41ff-98a0-980f54af94b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:12.263841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc2bdb-7ad1-41ff-98a0-980f54af94b9 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:12.352094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc86ad-4dc1-4ee0-ac40-2c61f49640df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:12.352788 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc86ad-4dc1-4ee0-ac40-2c61f49640df admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:12.353055 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc86ad-4dc1-4ee0-ac40-2c61f49640df admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:12.353322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc86ad-4dc1-4ee0-ac40-2c61f49640df admin admin] PATH_INFO: `/v3/users/985cc092239d44dca63c90fb415cbe1a` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:12.354510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc86ad-4dc1-4ee0-ac40-2c61f49640df admin admin] RBAC: Authorizing `identity:delete_user(user_id=985cc092239d44dca63c90fb415cbe1a)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:12.356505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc86ad-4dc1-4ee0-ac40-2c61f49640df admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:12.425197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:12.577505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a4bc86ad-4dc1-4ee0-ac40-2c61f49640df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '985cc092239d44dca63c90fb415cbe1a'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:12.592538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a4bc86ad-4dc1-4ee0-ac40-2c61f49640df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '985cc092239d44dca63c90fb415cbe1a'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:12.593731 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a4bc86ad-4dc1-4ee0-ac40-2c61f49640df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '985cc092239d44dca63c90fb415cbe1a'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:12.601995 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a4bc86ad-4dc1-4ee0-ac40-2c61f49640df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '985cc092239d44dca63c90fb415cbe1a'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:12.724601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a4bc86ad-4dc1-4ee0-ac40-2c61f49640df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '985cc092239d44dca63c90fb415cbe1a'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:12.736652 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1021/2047] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:00:12 2022] DELETE /identity/v3/users/985cc092239d44dca63c90fb415cbe1a => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:12.739008 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69dae8-038e-46cf-9f0d-4ae8fbde54c8 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:12.739629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69dae8-038e-46cf-9f0d-4ae8fbde54c8 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:12.739901 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69dae8-038e-46cf-9f0d-4ae8fbde54c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:12.763258 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-5e69dae8-038e-46cf-9f0d-4ae8fbde54c8 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:12.764944 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-5e69dae8-038e-46cf-9f0d-4ae8fbde54c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:12.833302 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1027/2048] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:12.847874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc86ad-4dc1-4ee0-ac40-2c61f49640df admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:12.849442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-a4bc86ad-4dc1-4ee0-ac40-2c61f49640df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:12.909446 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc86ad-4dc1-4ee0-ac40-2c61f49640df admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:12.913252 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729ecc9-4e7a-4cbe-afa5-9cc91306b627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:12.913759 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729ecc9-4e7a-4cbe-afa5-9cc91306b627 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:12.914104 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729ecc9-4e7a-4cbe-afa5-9cc91306b627 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:12.914376 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729ecc9-4e7a-4cbe-afa5-9cc91306b627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:12.924314 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729ecc9-4e7a-4cbe-afa5-9cc91306b627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:12.926493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729ecc9-4e7a-4cbe-afa5-9cc91306b627 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:12.936669 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1022/2049] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:00:13.146639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:13.366777 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b4005-5088-43dd-9614-7c421c4a7713 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:13.367978 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b4005-5088-43dd-9614-7c421c4a7713 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:13.368391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b4005-5088-43dd-9614-7c421c4a7713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:13.433904 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-e54b4005-5088-43dd-9614-7c421c4a7713 None None] MFA Rules not processed for user `f8b03f5aaa1c4463adc55bb55d5a10eb`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:13.436136 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-e54b4005-5088-43dd-9614-7c421c4a7713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:13.469390 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729ecc9-4e7a-4cbe-afa5-9cc91306b627 service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:13.472291 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-b729ecc9-4e7a-4cbe-afa5-9cc91306b627 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:13.507554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729ecc9-4e7a-4cbe-afa5-9cc91306b627 service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:13.520355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e647a-d536-43fa-bae8-17363c37babf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:13.522518 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e647a-d536-43fa-bae8-17363c37babf admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:13.522518 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e647a-d536-43fa-bae8-17363c37babf admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:13.522518 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e647a-d536-43fa-bae8-17363c37babf admin admin] PATH_INFO: `/v3/projects/d369ad6ba41d46aa8d480be5176b0bff` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:13.523416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e647a-d536-43fa-bae8-17363c37babf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d369ad6ba41d46aa8d480be5176b0bff)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:13.526396 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e647a-d536-43fa-bae8-17363c37babf admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:13.622027 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1028/2050] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:00:13.629087 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6640f-9ecf-4195-8f66-b9d2282dece9 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:13.630410 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6640f-9ecf-4195-8f66-b9d2282dece9 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:13.631629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6640f-9ecf-4195-8f66-b9d2282dece9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:13.662060 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-dcb6640f-9ecf-4195-8f66-b9d2282dece9 None None] MFA Rules not processed for user `ad1378dc8de24356ac591e49759f3b75`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:13.663570 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-dcb6640f-9ecf-4195-8f66-b9d2282dece9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:13.726481 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a30e647a-d536-43fa-bae8-17363c37babf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd369ad6ba41d46aa8d480be5176b0bff', 'request_id': 'req-a30e647a-d536-43fa-bae8-17363c37babf'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:13.731916 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1029/2051] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:13.736639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a30e647a-d536-43fa-bae8-17363c37babf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd369ad6ba41d46aa8d480be5176b0bff', 'request_id': 'req-a30e647a-d536-43fa-bae8-17363c37babf'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:13.746057 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6640f-9ecf-4195-8f66-b9d2282dece9 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:13.747819 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-dcb6640f-9ecf-4195-8f66-b9d2282dece9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:13.757677 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a30e647a-d536-43fa-bae8-17363c37babf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd369ad6ba41d46aa8d480be5176b0bff', 'request_id': 'req-a30e647a-d536-43fa-bae8-17363c37babf'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:13.823675 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a30e647a-d536-43fa-bae8-17363c37babf admin admin] The token cache is being invalidate because project d369ad6ba41d46aa8d480be5176b0bff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:00:13.824067 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a30e647a-d536-43fa-bae8-17363c37babf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:13.825900 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a30e647a-d536-43fa-bae8-17363c37babf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:13.828425 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1023/2052] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:00:13 2022] DELETE /identity/v3/projects/d369ad6ba41d46aa8d480be5176b0bff => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:13.832701 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a663bc-79f3-4f2b-a7c4-01e0b770a905 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:13.833185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a663bc-79f3-4f2b-a7c4-01e0b770a905 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:13.833459 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a663bc-79f3-4f2b-a7c4-01e0b770a905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:13.856102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-73a663bc-79f3-4f2b-a7c4-01e0b770a905 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:13.857607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-73a663bc-79f3-4f2b-a7c4-01e0b770a905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:13.858723 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6640f-9ecf-4195-8f66-b9d2282dece9 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:13.957864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1024/2053] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:00:13.965035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0d797-3d2b-4587-b1b4-41337343b68a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:13.965503 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76050f2a-21ad-481e-a754-9215681473e1 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:13.965719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0d797-3d2b-4587-b1b4-41337343b68a service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:13.966010 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76050f2a-21ad-481e-a754-9215681473e1 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:13.966150 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0d797-3d2b-4587-b1b4-41337343b68a service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:13.966304 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0d797-3d2b-4587-b1b4-41337343b68a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:13.966578 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76050f2a-21ad-481e-a754-9215681473e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:13.968208 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-65b0d797-3d2b-4587-b1b4-41337343b68a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:13.996354 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-76050f2a-21ad-481e-a754-9215681473e1 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:13.998232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-76050f2a-21ad-481e-a754-9215681473e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:14.016684 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1025/2054] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:14.020958 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76050f2a-21ad-481e-a754-9215681473e1 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:14.030978 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76050f2a-21ad-481e-a754-9215681473e1 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:14.036523 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99002a-c812-473a-94c1-127c6e899132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:14.037625 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99002a-c812-473a-94c1-127c6e899132 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:14.038177 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99002a-c812-473a-94c1-127c6e899132 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:14.038680 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99002a-c812-473a-94c1-127c6e899132 admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:14.039568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99002a-c812-473a-94c1-127c6e899132 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:00:14.039977 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99002a-c812-473a-94c1-127c6e899132 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:14.041789 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99002a-c812-473a-94c1-127c6e899132 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:14.044288 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0d797-3d2b-4587-b1b4-41337343b68a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:14.046175 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0d797-3d2b-4587-b1b4-41337343b68a service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:14.057443 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1026/2055] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:00:14.058904 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1030/2056] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:00:14.062447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99002a-c812-473a-94c1-127c6e899132 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:14.073446 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99002a-c812-473a-94c1-127c6e899132 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:14.078484 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bd4f7-bb4f-42b3-83ad-df2ba556700c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:14.079091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bd4f7-bb4f-42b3-83ad-df2ba556700c admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:14.079636 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bd4f7-bb4f-42b3-83ad-df2ba556700c admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:14.079636 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bd4f7-bb4f-42b3-83ad-df2ba556700c admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:14.080237 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6bd4f7-bb4f-42b3-83ad-df2ba556700c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:14.082456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6bd4f7-bb4f-42b3-83ad-df2ba556700c admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:14.195247 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1027/2057] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:00:14 2022] POST /identity/v3/projects => generated 361 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:00:14.199558 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0d797-3d2b-4587-b1b4-41337343b68a service nova] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:14.211168 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0d797-3d2b-4587-b1b4-41337343b68a service nova] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:14.295051 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c5802-7ddf-4f09-83a7-11e8280683e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:14.296207 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c5802-7ddf-4f09-83a7-11e8280683e5 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:14.296547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c5802-7ddf-4f09-83a7-11e8280683e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:14.297038 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c5802-7ddf-4f09-83a7-11e8280683e5 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:14.297738 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c5802-7ddf-4f09-83a7-11e8280683e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:14.300068 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c5802-7ddf-4f09-83a7-11e8280683e5 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:14.391634 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1031/2058] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:00:14 2022] POST /identity/v3/users => generated 281 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:00:14.396131 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bd4f7-bb4f-42b3-83ad-df2ba556700c admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:14.409052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bd4f7-bb4f-42b3-83ad-df2ba556700c admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:14.414658 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2993a19-5be1-4d4a-bdf9-b521d8a6abcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:14.417037 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2993a19-5be1-4d4a-bdf9-b521d8a6abcc admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:14.417037 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2993a19-5be1-4d4a-bdf9-b521d8a6abcc admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:14.417037 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2993a19-5be1-4d4a-bdf9-b521d8a6abcc admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:14.417037 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2993a19-5be1-4d4a-bdf9-b521d8a6abcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:14.418645 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2993a19-5be1-4d4a-bdf9-b521d8a6abcc admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:14.434060 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1028/2059] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:00:14.435885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c5802-7ddf-4f09-83a7-11e8280683e5 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:14.449407 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c5802-7ddf-4f09-83a7-11e8280683e5 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:14.453105 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc94ab3-c540-424a-b049-51773ab520d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:14.453762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc94ab3-c540-424a-b049-51773ab520d2 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:14.454008 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc94ab3-c540-424a-b049-51773ab520d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:14.454309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc94ab3-c540-424a-b049-51773ab520d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:14.454949 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc94ab3-c540-424a-b049-51773ab520d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:14.456780 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc94ab3-c540-424a-b049-51773ab520d2 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:14.471589 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1032/2060] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:00:14.476639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2993a19-5be1-4d4a-bdf9-b521d8a6abcc admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:14.487196 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2993a19-5be1-4d4a-bdf9-b521d8a6abcc admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:14.492527 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f1a79-1767-4398-98a6-3e865c88044e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:14.493256 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f1a79-1767-4398-98a6-3e865c88044e admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:14.493619 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f1a79-1767-4398-98a6-3e865c88044e admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:14.494066 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f1a79-1767-4398-98a6-3e865c88044e admin admin] PATH_INFO: `/v3/projects/ffaeb125641d4a38b2163a25a0f446ce/users/c16bcbb19c714aff89694b7c4910e691/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:14.515086 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f1a79-1767-4398-98a6-3e865c88044e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffaeb125641d4a38b2163a25a0f446ce, user_id=c16bcbb19c714aff89694b7c4910e691, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:14.517967 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f1a79-1767-4398-98a6-3e865c88044e admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:14.623981 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1029/2061] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:14 2022] PUT /identity/v3/projects/ffaeb125641d4a38b2163a25a0f446ce/users/c16bcbb19c714aff89694b7c4910e691/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:14.634804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801371f-3846-4230-8ed5-82cabdf2ae0b None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:14.635164 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801371f-3846-4230-8ed5-82cabdf2ae0b None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:14.635514 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801371f-3846-4230-8ed5-82cabdf2ae0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:14.666332 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-2801371f-3846-4230-8ed5-82cabdf2ae0b None None] MFA Rules not processed for user `c16bcbb19c714aff89694b7c4910e691`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:14.668367 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-2801371f-3846-4230-8ed5-82cabdf2ae0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:14.756059 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:14.769967 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1033/2062] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:00:14.818400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f1a79-1767-4398-98a6-3e865c88044e admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:14.821053 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-760f1a79-1767-4398-98a6-3e865c88044e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:14.897531 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:14.901218 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f1a79-1767-4398-98a6-3e865c88044e admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:14.906839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b288593-91db-43b8-b640-f5d28e3fa378 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:14.907667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b288593-91db-43b8-b640-f5d28e3fa378 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:14.908004 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b288593-91db-43b8-b640-f5d28e3fa378 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:14.908278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b288593-91db-43b8-b640-f5d28e3fa378 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:14.919219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b288593-91db-43b8-b640-f5d28e3fa378 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:14.920786 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b288593-91db-43b8-b640-f5d28e3fa378 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:14.931874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1030/2063] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:00:14.948781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801371f-3846-4230-8ed5-82cabdf2ae0b None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:15.041359 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801371f-3846-4230-8ed5-82cabdf2ae0b None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:15.046530 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7a1ac-e7cd-4c62-919c-a6ff655f3840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:15.047391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7a1ac-e7cd-4c62-919c-a6ff655f3840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:15.047685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7a1ac-e7cd-4c62-919c-a6ff655f3840 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:15.047961 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7a1ac-e7cd-4c62-919c-a6ff655f3840 admin admin] PATH_INFO: `/v3/users/c16bcbb19c714aff89694b7c4910e691` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:15.049143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7a1ac-e7cd-4c62-919c-a6ff655f3840 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c16bcbb19c714aff89694b7c4910e691)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:15.051184 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7a1ac-e7cd-4c62-919c-a6ff655f3840 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:15.328155 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-13f7a1ac-e7cd-4c62-919c-a6ff655f3840 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c16bcbb19c714aff89694b7c4910e691'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:15.343174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-13f7a1ac-e7cd-4c62-919c-a6ff655f3840 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c16bcbb19c714aff89694b7c4910e691'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:15.343896 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-13f7a1ac-e7cd-4c62-919c-a6ff655f3840 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c16bcbb19c714aff89694b7c4910e691'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:15.344517 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-13f7a1ac-e7cd-4c62-919c-a6ff655f3840 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c16bcbb19c714aff89694b7c4910e691'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:15.353161 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-13f7a1ac-e7cd-4c62-919c-a6ff655f3840 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c16bcbb19c714aff89694b7c4910e691'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:15.446847 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1034/2064] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:00:14 2022] DELETE /identity/v3/users/c16bcbb19c714aff89694b7c4910e691 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:15.452283 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cb184-4354-4a15-8483-edf9ec07f317 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:15.452568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cb184-4354-4a15-8483-edf9ec07f317 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:15.452909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cb184-4354-4a15-8483-edf9ec07f317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:15.476505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-757cb184-4354-4a15-8483-edf9ec07f317 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:15.477728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-757cb184-4354-4a15-8483-edf9ec07f317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:15.554664 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1031/2065] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:00:15.578578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7a1ac-e7cd-4c62-919c-a6ff655f3840 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:15.582192 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-13f7a1ac-e7cd-4c62-919c-a6ff655f3840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:15.616315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cb184-4354-4a15-8483-edf9ec07f317 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:15.619465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-757cb184-4354-4a15-8483-edf9ec07f317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:15.639198 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cb184-4354-4a15-8483-edf9ec07f317 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:15.650488 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80453395-090a-470c-9560-d5e031f7bbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:15.651557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80453395-090a-470c-9560-d5e031f7bbed admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:15.653333 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80453395-090a-470c-9560-d5e031f7bbed admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:15.653712 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80453395-090a-470c-9560-d5e031f7bbed admin admin] PATH_INFO: `/v3/users/662d8cc77653484c92101ab1c5bf0f99` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:15.655314 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80453395-090a-470c-9560-d5e031f7bbed admin admin] RBAC: Authorizing `identity:delete_user(user_id=662d8cc77653484c92101ab1c5bf0f99)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:15.664205 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80453395-090a-470c-9560-d5e031f7bbed admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:15.724683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7a1ac-e7cd-4c62-919c-a6ff655f3840 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:15.728992 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae7e09-de2f-4ada-979f-91cf5a802e72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:15.729761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae7e09-de2f-4ada-979f-91cf5a802e72 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:15.730170 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae7e09-de2f-4ada-979f-91cf5a802e72 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:15.730536 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae7e09-de2f-4ada-979f-91cf5a802e72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:15.743378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae7e09-de2f-4ada-979f-91cf5a802e72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:15.744923 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae7e09-de2f-4ada-979f-91cf5a802e72 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:15.758288 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1035/2066] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:00:15.917111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-80453395-090a-470c-9560-d5e031f7bbed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '662d8cc77653484c92101ab1c5bf0f99'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:15.936373 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-80453395-090a-470c-9560-d5e031f7bbed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '662d8cc77653484c92101ab1c5bf0f99'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:15.937502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-80453395-090a-470c-9560-d5e031f7bbed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '662d8cc77653484c92101ab1c5bf0f99'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:15.946719 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-80453395-090a-470c-9560-d5e031f7bbed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '662d8cc77653484c92101ab1c5bf0f99'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:16.014072 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-80453395-090a-470c-9560-d5e031f7bbed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '662d8cc77653484c92101ab1c5bf0f99'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:16.024829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1032/2067] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:00:15 2022] DELETE /identity/v3/users/662d8cc77653484c92101ab1c5bf0f99 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:16.042505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde213b-0276-4ec7-90f5-3f3e20e3f6f0 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:16.042505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde213b-0276-4ec7-90f5-3f3e20e3f6f0 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:16.042505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde213b-0276-4ec7-90f5-3f3e20e3f6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:16.058994 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-dcde213b-0276-4ec7-90f5-3f3e20e3f6f0 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:16.063931 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-dcde213b-0276-4ec7-90f5-3f3e20e3f6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:16.161997 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1036/2068] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:00:16.176810 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80453395-090a-470c-9560-d5e031f7bbed admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:16.178904 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-80453395-090a-470c-9560-d5e031f7bbed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:16.215665 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:16.283300 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80453395-090a-470c-9560-d5e031f7bbed admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:16.288465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26a144-9baf-4f65-961e-9603a7879598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:16.293285 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26a144-9baf-4f65-961e-9603a7879598 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:16.293285 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26a144-9baf-4f65-961e-9603a7879598 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:16.293285 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26a144-9baf-4f65-961e-9603a7879598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:16.318170 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26a144-9baf-4f65-961e-9603a7879598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:16.320747 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26a144-9baf-4f65-961e-9603a7879598 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:16.342552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1033/2069] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:00:16.397240 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde213b-0276-4ec7-90f5-3f3e20e3f6f0 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:16.398871 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-dcde213b-0276-4ec7-90f5-3f3e20e3f6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:16.412058 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde213b-0276-4ec7-90f5-3f3e20e3f6f0 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:16.419784 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d909e84-e3e2-4fcc-92d2-e54d6a5edec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:16.431844 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d909e84-e3e2-4fcc-92d2-e54d6a5edec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:16.431844 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d909e84-e3e2-4fcc-92d2-e54d6a5edec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:16.431844 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d909e84-e3e2-4fcc-92d2-e54d6a5edec0 admin admin] PATH_INFO: `/v3/projects/ffaeb125641d4a38b2163a25a0f446ce` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:16.431844 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d909e84-e3e2-4fcc-92d2-e54d6a5edec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffaeb125641d4a38b2163a25a0f446ce)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:16.431844 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d909e84-e3e2-4fcc-92d2-e54d6a5edec0 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:16.568056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-1d909e84-e3e2-4fcc-92d2-e54d6a5edec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffaeb125641d4a38b2163a25a0f446ce', 'request_id': 'req-1d909e84-e3e2-4fcc-92d2-e54d6a5edec0'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:16.578254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-1d909e84-e3e2-4fcc-92d2-e54d6a5edec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffaeb125641d4a38b2163a25a0f446ce', 'request_id': 'req-1d909e84-e3e2-4fcc-92d2-e54d6a5edec0'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:16.686235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-1d909e84-e3e2-4fcc-92d2-e54d6a5edec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffaeb125641d4a38b2163a25a0f446ce', 'request_id': 'req-1d909e84-e3e2-4fcc-92d2-e54d6a5edec0'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:16.700441 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-1d909e84-e3e2-4fcc-92d2-e54d6a5edec0 admin admin] The token cache is being invalidate because project ffaeb125641d4a38b2163a25a0f446ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:00:16.700821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-1d909e84-e3e2-4fcc-92d2-e54d6a5edec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:16.702522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-1d909e84-e3e2-4fcc-92d2-e54d6a5edec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:16.710207 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1037/2070] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:00:16 2022] DELETE /identity/v3/projects/ffaeb125641d4a38b2163a25a0f446ce => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:16.713514 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25670b84-cb8d-4266-8a4e-d5366b519407 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:16.714032 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25670b84-cb8d-4266-8a4e-d5366b519407 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:16.714177 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25670b84-cb8d-4266-8a4e-d5366b519407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:16.741200 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-25670b84-cb8d-4266-8a4e-d5366b519407 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:16.742465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-25670b84-cb8d-4266-8a4e-d5366b519407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:16.834678 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1034/2071] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:16.849205 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4834eff-58ea-4e59-a87c-737c710e0673 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:16.849205 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4834eff-58ea-4e59-a87c-737c710e0673 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:16.849205 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4834eff-58ea-4e59-a87c-737c710e0673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:16.859064 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25670b84-cb8d-4266-8a4e-d5366b519407 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:16.860743 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-25670b84-cb8d-4266-8a4e-d5366b519407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:16.870660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-c4834eff-58ea-4e59-a87c-737c710e0673 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:16.872110 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-c4834eff-58ea-4e59-a87c-737c710e0673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:16.889891 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25670b84-cb8d-4266-8a4e-d5366b519407 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:16.892196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1038/2072] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:16.896633 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4834eff-58ea-4e59-a87c-737c710e0673 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:16.898550 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1deb09f-2475-4281-9c3b-70f12f3376da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:16.899480 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1deb09f-2475-4281-9c3b-70f12f3376da admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:16.899757 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1deb09f-2475-4281-9c3b-70f12f3376da admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:16.900027 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1deb09f-2475-4281-9c3b-70f12f3376da admin admin] PATH_INFO: `/v3/projects/1aa81e18984548f489ad1efd07f0999e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:16.901322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1deb09f-2475-4281-9c3b-70f12f3376da admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aa81e18984548f489ad1efd07f0999e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:16.903286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1deb09f-2475-4281-9c3b-70f12f3376da admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:16.907441 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4834eff-58ea-4e59-a87c-737c710e0673 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:16.916547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3b13e-0157-495b-98e1-7232b0131a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:16.917443 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3b13e-0157-495b-98e1-7232b0131a03 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:16.917724 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3b13e-0157-495b-98e1-7232b0131a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:16.918139 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3b13e-0157-495b-98e1-7232b0131a03 admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:16.918789 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3b13e-0157-495b-98e1-7232b0131a03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:00:16.919093 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3b13e-0157-495b-98e1-7232b0131a03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:16.920709 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3b13e-0157-495b-98e1-7232b0131a03 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:16.934006 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1039/2073] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:00:16.938393 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3b13e-0157-495b-98e1-7232b0131a03 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:16.949517 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3b13e-0157-495b-98e1-7232b0131a03 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:16.954145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ec9bc-21c0-4b06-8015-18e422b2e8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:16.954744 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ec9bc-21c0-4b06-8015-18e422b2e8e4 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:16.955017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ec9bc-21c0-4b06-8015-18e422b2e8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:16.955283 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ec9bc-21c0-4b06-8015-18e422b2e8e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:16.955923 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ec9bc-21c0-4b06-8015-18e422b2e8e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:16.959724 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ec9bc-21c0-4b06-8015-18e422b2e8e4 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:17.063985 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-b1deb09f-2475-4281-9c3b-70f12f3376da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aa81e18984548f489ad1efd07f0999e', 'request_id': 'req-b1deb09f-2475-4281-9c3b-70f12f3376da'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:17.077688 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-b1deb09f-2475-4281-9c3b-70f12f3376da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aa81e18984548f489ad1efd07f0999e', 'request_id': 'req-b1deb09f-2475-4281-9c3b-70f12f3376da'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:17.084000 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-b1deb09f-2475-4281-9c3b-70f12f3376da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aa81e18984548f489ad1efd07f0999e', 'request_id': 'req-b1deb09f-2475-4281-9c3b-70f12f3376da'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:17.086866 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1040/2074] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:00:16 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:17.091025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ec9bc-21c0-4b06-8015-18e422b2e8e4 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:17.203999 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-b1deb09f-2475-4281-9c3b-70f12f3376da admin admin] The token cache is being invalidate because project 1aa81e18984548f489ad1efd07f0999e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:00:17.204383 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-b1deb09f-2475-4281-9c3b-70f12f3376da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:17.205148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-b1deb09f-2475-4281-9c3b-70f12f3376da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:17.207824 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1035/2075] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:00:16 2022] DELETE /identity/v3/projects/1aa81e18984548f489ad1efd07f0999e => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:17.211724 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1deb09f-2475-4281-9c3b-70f12f3376da admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:17.213477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-b1deb09f-2475-4281-9c3b-70f12f3376da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:17.225443 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ec9bc-21c0-4b06-8015-18e422b2e8e4 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:17.230688 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081e9d1-90ba-4aeb-b04a-a4bd11b63a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:17.231300 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081e9d1-90ba-4aeb-b04a-a4bd11b63a49 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:17.231580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081e9d1-90ba-4aeb-b04a-a4bd11b63a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:17.231851 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081e9d1-90ba-4aeb-b04a-a4bd11b63a49 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:17.232514 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081e9d1-90ba-4aeb-b04a-a4bd11b63a49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:17.234487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081e9d1-90ba-4aeb-b04a-a4bd11b63a49 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:17.269996 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:17.290948 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1deb09f-2475-4281-9c3b-70f12f3376da admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:17.298491 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d7872-c7e2-41c8-9bac-fcacc4785576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:17.299204 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d7872-c7e2-41c8-9bac-fcacc4785576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:17.299495 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d7872-c7e2-41c8-9bac-fcacc4785576 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:17.299768 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d7872-c7e2-41c8-9bac-fcacc4785576 admin admin] PATH_INFO: `/v3/users/ff25c8509d6a400fa522f7064a439266` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:17.301241 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d7872-c7e2-41c8-9bac-fcacc4785576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff25c8509d6a400fa522f7064a439266)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:17.305091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d7872-c7e2-41c8-9bac-fcacc4785576 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:17.340890 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1041/2076] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:00:17 2022] POST /identity/v3/users => generated 287 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:00:17.342614 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081e9d1-90ba-4aeb-b04a-a4bd11b63a49 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:17.344913 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-1081e9d1-90ba-4aeb-b04a-a4bd11b63a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:17.359271 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081e9d1-90ba-4aeb-b04a-a4bd11b63a49 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:17.364373 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edf2e1-0a96-4a1b-ad69-68f89b47a0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:17.365203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edf2e1-0a96-4a1b-ad69-68f89b47a0fa admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:17.365572 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edf2e1-0a96-4a1b-ad69-68f89b47a0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:17.365972 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edf2e1-0a96-4a1b-ad69-68f89b47a0fa admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:17.366717 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02edf2e1-0a96-4a1b-ad69-68f89b47a0fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:17.369069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02edf2e1-0a96-4a1b-ad69-68f89b47a0fa admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:17.381327 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1042/2077] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:17.385330 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edf2e1-0a96-4a1b-ad69-68f89b47a0fa admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:17.402293 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edf2e1-0a96-4a1b-ad69-68f89b47a0fa admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:17.409388 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96215104-c158-4f9c-8a5b-f1a0549ff2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:17.410116 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96215104-c158-4f9c-8a5b-f1a0549ff2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:17.410403 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96215104-c158-4f9c-8a5b-f1a0549ff2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:17.410713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96215104-c158-4f9c-8a5b-f1a0549ff2d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:17.411369 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96215104-c158-4f9c-8a5b-f1a0549ff2d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:17.413114 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96215104-c158-4f9c-8a5b-f1a0549ff2d7 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:17.425563 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1043/2078] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:17.429496 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96215104-c158-4f9c-8a5b-f1a0549ff2d7 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:17.445830 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96215104-c158-4f9c-8a5b-f1a0549ff2d7 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:17.451448 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af496774-43a3-495d-9c4c-cfd0f9889192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:17.452152 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af496774-43a3-495d-9c4c-cfd0f9889192 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:17.452431 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af496774-43a3-495d-9c4c-cfd0f9889192 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:17.461542 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af496774-43a3-495d-9c4c-cfd0f9889192 admin admin] PATH_INFO: `/v3/projects/d9e49df255204ee3936cd7777874aa7f/users/7fba5dda2a4e4e2185eba3fd3c18dd56/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:17.470797 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af496774-43a3-495d-9c4c-cfd0f9889192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e49df255204ee3936cd7777874aa7f, user_id=7fba5dda2a4e4e2185eba3fd3c18dd56, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:17.473921 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af496774-43a3-495d-9c4c-cfd0f9889192 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:17.527216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-431d7872-c7e2-41c8-9bac-fcacc4785576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff25c8509d6a400fa522f7064a439266'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:17.543848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-431d7872-c7e2-41c8-9bac-fcacc4785576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff25c8509d6a400fa522f7064a439266'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:17.544583 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-431d7872-c7e2-41c8-9bac-fcacc4785576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff25c8509d6a400fa522f7064a439266'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:17.558453 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1044/2079] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:17 2022] PUT /identity/v3/projects/d9e49df255204ee3936cd7777874aa7f/users/7fba5dda2a4e4e2185eba3fd3c18dd56/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:00:17.560108 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-431d7872-c7e2-41c8-9bac-fcacc4785576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff25c8509d6a400fa522f7064a439266'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:17.568854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fff99-7cba-454f-8a4f-47f2a461f77c None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:17.569697 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fff99-7cba-454f-8a4f-47f2a461f77c None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:17.570145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fff99-7cba-454f-8a4f-47f2a461f77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:17.627313 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-f11fff99-7cba-454f-8a4f-47f2a461f77c None None] MFA Rules not processed for user `7fba5dda2a4e4e2185eba3fd3c18dd56`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:17.629444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-f11fff99-7cba-454f-8a4f-47f2a461f77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:17.631610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-431d7872-c7e2-41c8-9bac-fcacc4785576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff25c8509d6a400fa522f7064a439266'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:17.651233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1036/2080] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:00:17 2022] DELETE /identity/v3/users/ff25c8509d6a400fa522f7064a439266 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:17.750693 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1045/2081] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:00:17.756218 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d7872-c7e2-41c8-9bac-fcacc4785576 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:17.757923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-431d7872-c7e2-41c8-9bac-fcacc4785576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:17.793025 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:17.905310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d7872-c7e2-41c8-9bac-fcacc4785576 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:17.916372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47d74f-39bf-4c90-aa5e-9a3d65a131ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:17.917414 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47d74f-39bf-4c90-aa5e-9a3d65a131ca admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:17.917932 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47d74f-39bf-4c90-aa5e-9a3d65a131ca admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:17.918457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47d74f-39bf-4c90-aa5e-9a3d65a131ca admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:17.919289 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47d74f-39bf-4c90-aa5e-9a3d65a131ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:17.921581 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47d74f-39bf-4c90-aa5e-9a3d65a131ca admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:18.034220 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1037/2082] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:00:17 2022] POST /identity/v3/projects => generated 375 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:18.037679 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fff99-7cba-454f-8a4f-47f2a461f77c None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:18.127596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fff99-7cba-454f-8a4f-47f2a461f77c None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:18.229383 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f83aa-2935-4c36-a9c1-decb74c45b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:18.230504 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f83aa-2935-4c36-a9c1-decb74c45b43 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:18.232559 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f83aa-2935-4c36-a9c1-decb74c45b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:18.232835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f83aa-2935-4c36-a9c1-decb74c45b43 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:18.234127 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f83aa-2935-4c36-a9c1-decb74c45b43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:18.236167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f83aa-2935-4c36-a9c1-decb74c45b43 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:18.342901 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1046/2083] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:00:18 2022] POST /identity/v3/users => generated 294 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:18.344558 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47d74f-39bf-4c90-aa5e-9a3d65a131ca admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:18.361617 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47d74f-39bf-4c90-aa5e-9a3d65a131ca admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:18.378046 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577d76c-68e1-42ec-892a-5ba4ceff4d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:18.381271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577d76c-68e1-42ec-892a-5ba4ceff4d63 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:18.381554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577d76c-68e1-42ec-892a-5ba4ceff4d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:18.381831 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577d76c-68e1-42ec-892a-5ba4ceff4d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:18.382637 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577d76c-68e1-42ec-892a-5ba4ceff4d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:18.384191 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577d76c-68e1-42ec-892a-5ba4ceff4d63 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:18.401822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1038/2084] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:18.405100 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f83aa-2935-4c36-a9c1-decb74c45b43 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:18.417965 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f83aa-2935-4c36-a9c1-decb74c45b43 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:18.423452 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373040b-e346-4383-864a-3ba313a9cd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:18.424148 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373040b-e346-4383-864a-3ba313a9cd79 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:18.424614 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373040b-e346-4383-864a-3ba313a9cd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:18.424915 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373040b-e346-4383-864a-3ba313a9cd79 admin admin] PATH_INFO: `/v3/projects/b62098ec087144ae9a17f57fe41c6b0f/users/74ab68da436b46768595d03d98b9e9e7/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:18.445182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373040b-e346-4383-864a-3ba313a9cd79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b62098ec087144ae9a17f57fe41c6b0f, user_id=74ab68da436b46768595d03d98b9e9e7, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:18.447944 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373040b-e346-4383-864a-3ba313a9cd79 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:18.499942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8bfc9-89c0-4fba-ac5b-e6674a71ad51 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:18.500221 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8bfc9-89c0-4fba-ac5b-e6674a71ad51 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:18.500494 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8bfc9-89c0-4fba-ac5b-e6674a71ad51 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:18.503962 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1039/2085] 10.222.0.13 () {54 vars in 921 bytes} [Thu Aug 11 10:00:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:00:18.530044 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1047/2086] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:18 2022] PUT /identity/v3/projects/b62098ec087144ae9a17f57fe41c6b0f/users/74ab68da436b46768595d03d98b9e9e7/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:18.534319 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8bfc9-89c0-4fba-ac5b-e6674a71ad51 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:18.544716 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc22ad-dcc3-4909-96be-7de3d462469b None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:18.545346 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc22ad-dcc3-4909-96be-7de3d462469b None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:18.545766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc22ad-dcc3-4909-96be-7de3d462469b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:18.571487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-d7fc22ad-dcc3-4909-96be-7de3d462469b None None] MFA Rules not processed for user `0061ce46df224f4491599ed10548b2ae`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:18.572720 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-d7fc22ad-dcc3-4909-96be-7de3d462469b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:18.615568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8bfc9-89c0-4fba-ac5b-e6674a71ad51 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:18.621106 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cf4b4-ae95-44a4-a97e-453958293912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:18.621732 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cf4b4-ae95-44a4-a97e-453958293912 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:18.622009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cf4b4-ae95-44a4-a97e-453958293912 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:18.622327 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cf4b4-ae95-44a4-a97e-453958293912 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:18.622974 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cf4b4-ae95-44a4-a97e-453958293912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:18.624788 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cf4b4-ae95-44a4-a97e-453958293912 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:18.652683 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1040/2087] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:00:18.652683 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cf4b4-ae95-44a4-a97e-453958293912 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:18.654268 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-079cf4b4-ae95-44a4-a97e-453958293912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:18.661722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1048/2088] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Aug 11 10:00:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:18.662650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc22ad-dcc3-4909-96be-7de3d462469b None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:18.664094 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-d7fc22ad-dcc3-4909-96be-7de3d462469b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:18.669028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cf4b4-ae95-44a4-a97e-453958293912 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:18.681938 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc22ad-dcc3-4909-96be-7de3d462469b None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:18.687767 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d664a66-3657-44e7-bdf2-5c4ea0097651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:18.688278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d664a66-3657-44e7-bdf2-5c4ea0097651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:18.688629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d664a66-3657-44e7-bdf2-5c4ea0097651 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:18.688983 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d664a66-3657-44e7-bdf2-5c4ea0097651 admin admin] PATH_INFO: `/v3/users/55c67b8ae8fb42f5b45e58d38e985507` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:18.690252 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d664a66-3657-44e7-bdf2-5c4ea0097651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55c67b8ae8fb42f5b45e58d38e985507)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:18.690439 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8e99d-b5f8-42d7-83fe-5d1cf0d21d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:18.691831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8e99d-b5f8-42d7-83fe-5d1cf0d21d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:18.692291 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8e99d-b5f8-42d7-83fe-5d1cf0d21d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:18.692855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8e99d-b5f8-42d7-83fe-5d1cf0d21d8b admin admin] PATH_INFO: `/v3/projects/e031b391c6e344afb267b9e047e767b8` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:18.693292 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d664a66-3657-44e7-bdf2-5c4ea0097651 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:18.694577 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8e99d-b5f8-42d7-83fe-5d1cf0d21d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e031b391c6e344afb267b9e047e767b8)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:18.696682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8e99d-b5f8-42d7-83fe-5d1cf0d21d8b admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:18.953396 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-c0f8e99d-b5f8-42d7-83fe-5d1cf0d21d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e031b391c6e344afb267b9e047e767b8', 'request_id': 'req-c0f8e99d-b5f8-42d7-83fe-5d1cf0d21d8b'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:18.955477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-0d664a66-3657-44e7-bdf2-5c4ea0097651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55c67b8ae8fb42f5b45e58d38e985507'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:18.962757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-c0f8e99d-b5f8-42d7-83fe-5d1cf0d21d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e031b391c6e344afb267b9e047e767b8', 'request_id': 'req-c0f8e99d-b5f8-42d7-83fe-5d1cf0d21d8b'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:18.969904 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-0d664a66-3657-44e7-bdf2-5c4ea0097651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55c67b8ae8fb42f5b45e58d38e985507'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:18.970681 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-0d664a66-3657-44e7-bdf2-5c4ea0097651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55c67b8ae8fb42f5b45e58d38e985507'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:18.977957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-0d664a66-3657-44e7-bdf2-5c4ea0097651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55c67b8ae8fb42f5b45e58d38e985507'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:19.050874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-c0f8e99d-b5f8-42d7-83fe-5d1cf0d21d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e031b391c6e344afb267b9e047e767b8', 'request_id': 'req-c0f8e99d-b5f8-42d7-83fe-5d1cf0d21d8b'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:19.063917 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-c0f8e99d-b5f8-42d7-83fe-5d1cf0d21d8b admin admin] The token cache is being invalidate because project e031b391c6e344afb267b9e047e767b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:00:19.064209 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-c0f8e99d-b5f8-42d7-83fe-5d1cf0d21d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:19.064856 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-c0f8e99d-b5f8-42d7-83fe-5d1cf0d21d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:19.066406 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1049/2089] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:00:18 2022] DELETE /identity/v3/projects/e031b391c6e344afb267b9e047e767b8 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:19.067973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8e99d-b5f8-42d7-83fe-5d1cf0d21d8b admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:19.069523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-c0f8e99d-b5f8-42d7-83fe-5d1cf0d21d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:19.131608 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-0d664a66-3657-44e7-bdf2-5c4ea0097651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55c67b8ae8fb42f5b45e58d38e985507'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:19.137826 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1041/2090] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:00:18 2022] DELETE /identity/v3/users/55c67b8ae8fb42f5b45e58d38e985507 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:19.139379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d664a66-3657-44e7-bdf2-5c4ea0097651 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:19.144478 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-0d664a66-3657-44e7-bdf2-5c4ea0097651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:19.147227 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8e99d-b5f8-42d7-83fe-5d1cf0d21d8b admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:19.177633 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:19.228787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709849d6-1aef-43f0-9e26-065188738450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:19.229459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709849d6-1aef-43f0-9e26-065188738450 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:19.229735 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709849d6-1aef-43f0-9e26-065188738450 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:19.230006 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709849d6-1aef-43f0-9e26-065188738450 admin admin] PATH_INFO: `/v3/projects/b62098ec087144ae9a17f57fe41c6b0f/users/74ab68da436b46768595d03d98b9e9e7/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:19.232132 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709849d6-1aef-43f0-9e26-065188738450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b62098ec087144ae9a17f57fe41c6b0f, user_id=74ab68da436b46768595d03d98b9e9e7, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:19.234835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709849d6-1aef-43f0-9e26-065188738450 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:19.247940 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1050/2091] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:19 2022] PUT /identity/v3/projects/b62098ec087144ae9a17f57fe41c6b0f/users/74ab68da436b46768595d03d98b9e9e7/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:19.249317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba688a4e-8828-4e8e-baee-3e08051bb8b0 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:19.249664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba688a4e-8828-4e8e-baee-3e08051bb8b0 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:19.249937 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba688a4e-8828-4e8e-baee-3e08051bb8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:19.273954 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-ba688a4e-8828-4e8e-baee-3e08051bb8b0 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:19.275252 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ba688a4e-8828-4e8e-baee-3e08051bb8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:19.280660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d664a66-3657-44e7-bdf2-5c4ea0097651 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:19.370970 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1051/2092] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:19.372926 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4240ac0-fd6f-408b-9a2f-756313902e97 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:19.373238 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4240ac0-fd6f-408b-9a2f-756313902e97 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:19.373521 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4240ac0-fd6f-408b-9a2f-756313902e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:19.406547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:19.419925 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15904013-1fff-4d3e-8d44-e691083d621c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0061ce46df224f4491599ed10548b2ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:19.420552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15904013-1fff-4d3e-8d44-e691083d621c service placement] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:19.420823 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15904013-1fff-4d3e-8d44-e691083d621c service placement] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:19.421092 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15904013-1fff-4d3e-8d44-e691083d621c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:19.424682 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-15904013-1fff-4d3e-8d44-e691083d621c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:19.428732 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-e4240ac0-fd6f-408b-9a2f-756313902e97 None None] MFA Rules not processed for user `74ab68da436b46768595d03d98b9e9e7`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:19.430540 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-e4240ac0-fd6f-408b-9a2f-756313902e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:19.442539 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15904013-1fff-4d3e-8d44-e691083d621c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:19.444185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15904013-1fff-4d3e-8d44-e691083d621c service placement] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:19.459915 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1042/2093] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:00:19.461389 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ce672-a427-4004-bea6-53a475beddba None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:19.461769 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ce672-a427-4004-bea6-53a475beddba None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:19.462114 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ce672-a427-4004-bea6-53a475beddba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:19.488921 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-394ce672-a427-4004-bea6-53a475beddba None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:19.490508 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-394ce672-a427-4004-bea6-53a475beddba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:19.502322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1043/2094] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:19.506796 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ce672-a427-4004-bea6-53a475beddba None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:19.516190 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ce672-a427-4004-bea6-53a475beddba None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:19.524685 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c186aa-918d-4568-8b9b-01d2897255f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:19.525482 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c186aa-918d-4568-8b9b-01d2897255f8 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:19.525601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c186aa-918d-4568-8b9b-01d2897255f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:19.526201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c186aa-918d-4568-8b9b-01d2897255f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:19.526581 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c186aa-918d-4568-8b9b-01d2897255f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:00:19.526826 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c186aa-918d-4568-8b9b-01d2897255f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:19.528491 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c186aa-918d-4568-8b9b-01d2897255f8 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:19.545525 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1044/2095] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:00:19.549848 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1052/2096] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:19.549993 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c186aa-918d-4568-8b9b-01d2897255f8 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:19.550635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4240ac0-fd6f-408b-9a2f-756313902e97 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:19.551894 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-14c186aa-918d-4568-8b9b-01d2897255f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:19.564515 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4240ac0-fd6f-408b-9a2f-756313902e97 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:19.568923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c186aa-918d-4568-8b9b-01d2897255f8 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:19.570672 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394b5fa-2a06-4809-ad87-01b52fea76cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:19.571370 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394b5fa-2a06-4809-ad87-01b52fea76cd admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:19.571651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394b5fa-2a06-4809-ad87-01b52fea76cd admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:19.572185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394b5fa-2a06-4809-ad87-01b52fea76cd admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:19.573192 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394b5fa-2a06-4809-ad87-01b52fea76cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:19.575648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394b5fa-2a06-4809-ad87-01b52fea76cd admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:19.578652 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638e7b0-b798-4475-b31d-37f6aa5a0262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:19.579515 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638e7b0-b798-4475-b31d-37f6aa5a0262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:19.579864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638e7b0-b798-4475-b31d-37f6aa5a0262 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:19.580248 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638e7b0-b798-4475-b31d-37f6aa5a0262 admin admin] PATH_INFO: `/v3/projects/37723d4b6fc749e4969def02d826fca1` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:19.581971 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638e7b0-b798-4475-b31d-37f6aa5a0262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37723d4b6fc749e4969def02d826fca1)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:19.584554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638e7b0-b798-4475-b31d-37f6aa5a0262 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:19.681882 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1053/2097] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:00:19 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:19.681882 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394b5fa-2a06-4809-ad87-01b52fea76cd admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:19.681882 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-7394b5fa-2a06-4809-ad87-01b52fea76cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:19.714988 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-2638e7b0-b798-4475-b31d-37f6aa5a0262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37723d4b6fc749e4969def02d826fca1', 'request_id': 'req-2638e7b0-b798-4475-b31d-37f6aa5a0262'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:19.720440 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-2638e7b0-b798-4475-b31d-37f6aa5a0262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37723d4b6fc749e4969def02d826fca1', 'request_id': 'req-2638e7b0-b798-4475-b31d-37f6aa5a0262'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:19.727232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-2638e7b0-b798-4475-b31d-37f6aa5a0262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37723d4b6fc749e4969def02d826fca1', 'request_id': 'req-2638e7b0-b798-4475-b31d-37f6aa5a0262'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:19.744721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394b5fa-2a06-4809-ad87-01b52fea76cd admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:19.798545 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d25bd8-c757-4cd5-aaca-13507023f21b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:19.799296 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d25bd8-c757-4cd5-aaca-13507023f21b service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:19.799569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d25bd8-c757-4cd5-aaca-13507023f21b service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:19.799896 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d25bd8-c757-4cd5-aaca-13507023f21b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:19.802233 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-90d25bd8-c757-4cd5-aaca-13507023f21b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:19.803564 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-2638e7b0-b798-4475-b31d-37f6aa5a0262 admin admin] The token cache is being invalidate because project 37723d4b6fc749e4969def02d826fca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:00:19.804043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-2638e7b0-b798-4475-b31d-37f6aa5a0262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:19.804861 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-2638e7b0-b798-4475-b31d-37f6aa5a0262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:19.807211 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1045/2098] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:00:19 2022] DELETE /identity/v3/projects/37723d4b6fc749e4969def02d826fca1 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:19.812287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638e7b0-b798-4475-b31d-37f6aa5a0262 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:19.812287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-2638e7b0-b798-4475-b31d-37f6aa5a0262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:19.871852 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:19.877243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d25bd8-c757-4cd5-aaca-13507023f21b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:19.878720 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d25bd8-c757-4cd5-aaca-13507023f21b service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:19.890261 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1054/2099] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:00:19.892674 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4fd2a-a393-4093-9d98-af450289fcaa None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:19.894354 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4fd2a-a393-4093-9d98-af450289fcaa None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:19.896697 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4fd2a-a393-4093-9d98-af450289fcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:19.910982 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638e7b0-b798-4475-b31d-37f6aa5a0262 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:19.916738 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5d4f5-6668-4b67-bf97-2684b46fed91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:19.918465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5d4f5-6668-4b67-bf97-2684b46fed91 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:19.922849 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5d4f5-6668-4b67-bf97-2684b46fed91 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:19.922849 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5d4f5-6668-4b67-bf97-2684b46fed91 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:19.923075 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-47f4fd2a-a393-4093-9d98-af450289fcaa None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:19.923175 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5d4f5-6668-4b67-bf97-2684b46fed91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:19.923273 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-47f4fd2a-a393-4093-9d98-af450289fcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:19.923361 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5d4f5-6668-4b67-bf97-2684b46fed91 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:19.929486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1055/2100] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:19.938497 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56218a0-0431-455b-96e3-b3e8f306db7e None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:19.938780 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56218a0-0431-455b-96e3-b3e8f306db7e None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:19.939049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56218a0-0431-455b-96e3-b3e8f306db7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:19.959573 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-b56218a0-0431-455b-96e3-b3e8f306db7e None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:19.960631 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-b56218a0-0431-455b-96e3-b3e8f306db7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:19.969822 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1056/2101] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:00:19.973851 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56218a0-0431-455b-96e3-b3e8f306db7e None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:19.982968 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56218a0-0431-455b-96e3-b3e8f306db7e None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:19.987977 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bb097-5b13-49a8-ae16-fe73c10a179b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:19.992724 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bb097-5b13-49a8-ae16-fe73c10a179b admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:19.992724 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bb097-5b13-49a8-ae16-fe73c10a179b admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:19.992724 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bb097-5b13-49a8-ae16-fe73c10a179b admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:19.992724 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5bb097-5b13-49a8-ae16-fe73c10a179b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:00:19.992724 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5bb097-5b13-49a8-ae16-fe73c10a179b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:19.992724 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5bb097-5b13-49a8-ae16-fe73c10a179b admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:20.007839 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1057/2102] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:00:20.008884 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bb097-5b13-49a8-ae16-fe73c10a179b admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:20.018685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bb097-5b13-49a8-ae16-fe73c10a179b admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:20.024535 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbff409-f240-4c07-a7fa-64575d092f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:20.025949 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbff409-f240-4c07-a7fa-64575d092f4d admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:20.026278 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbff409-f240-4c07-a7fa-64575d092f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:20.026569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbff409-f240-4c07-a7fa-64575d092f4d admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:20.027180 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbff409-f240-4c07-a7fa-64575d092f4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:20.029129 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbff409-f240-4c07-a7fa-64575d092f4d admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:20.093248 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1046/2103] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:00:19 2022] POST /identity/v3/users => generated 287 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:20.097435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5d4f5-6668-4b67-bf97-2684b46fed91 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:20.109244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5d4f5-6668-4b67-bf97-2684b46fed91 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:20.116774 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea2fb5-210c-4f7e-8487-2fb61272280b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:20.117718 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea2fb5-210c-4f7e-8487-2fb61272280b admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:20.118300 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea2fb5-210c-4f7e-8487-2fb61272280b admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:20.119008 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea2fb5-210c-4f7e-8487-2fb61272280b admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:20.120126 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea2fb5-210c-4f7e-8487-2fb61272280b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:20.122025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea2fb5-210c-4f7e-8487-2fb61272280b admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:20.133528 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1047/2104] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:00:20.147169 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea2fb5-210c-4f7e-8487-2fb61272280b admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:20.158257 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea2fb5-210c-4f7e-8487-2fb61272280b admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:20.164675 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10906b1b-3820-4fbf-9026-5eb317306a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:20.165503 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10906b1b-3820-4fbf-9026-5eb317306a83 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:20.166194 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10906b1b-3820-4fbf-9026-5eb317306a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:20.166576 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10906b1b-3820-4fbf-9026-5eb317306a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:20.167589 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10906b1b-3820-4fbf-9026-5eb317306a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:20.169328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10906b1b-3820-4fbf-9026-5eb317306a83 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:20.188028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1058/2105] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:00:20 2022] POST /identity/v3/projects => generated 375 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:20.191877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1048/2106] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:20.192003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbff409-f240-4c07-a7fa-64575d092f4d admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:20.196004 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10906b1b-3820-4fbf-9026-5eb317306a83 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:20.210453 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10906b1b-3820-4fbf-9026-5eb317306a83 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:20.272182 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbff409-f240-4c07-a7fa-64575d092f4d admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:20.281258 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a0fa5-d883-4631-a0fd-36a35a659cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:20.281884 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a0fa5-d883-4631-a0fd-36a35a659cbb admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:20.282194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a0fa5-d883-4631-a0fd-36a35a659cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:20.282466 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a0fa5-d883-4631-a0fd-36a35a659cbb admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:20.283100 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a0fa5-d883-4631-a0fd-36a35a659cbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:20.286458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a0fa5-d883-4631-a0fd-36a35a659cbb admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:20.292899 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd1d67-36ca-4722-b644-bc0cdeb5afbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:20.293574 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd1d67-36ca-4722-b644-bc0cdeb5afbd admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:20.293851 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd1d67-36ca-4722-b644-bc0cdeb5afbd admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:20.294155 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd1d67-36ca-4722-b644-bc0cdeb5afbd admin admin] PATH_INFO: `/v3/projects/d4716f3d997145df8be1250bcab52502/users/99512829ebe04974a0e4981cf2800514/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:20.312173 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd1d67-36ca-4722-b644-bc0cdeb5afbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4716f3d997145df8be1250bcab52502, user_id=99512829ebe04974a0e4981cf2800514, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:20.314829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd1d67-36ca-4722-b644-bc0cdeb5afbd admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:20.386476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1059/2107] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:00:20 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:00:20.394319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a0fa5-d883-4631-a0fd-36a35a659cbb admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:20.412632 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a0fa5-d883-4631-a0fd-36a35a659cbb admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:20.417940 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba075f20-1cd9-4ecd-b9ab-855f809ec7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:20.418657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba075f20-1cd9-4ecd-b9ab-855f809ec7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:20.418934 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba075f20-1cd9-4ecd-b9ab-855f809ec7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:20.419200 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba075f20-1cd9-4ecd-b9ab-855f809ec7f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:20.419832 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba075f20-1cd9-4ecd-b9ab-855f809ec7f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:20.421461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba075f20-1cd9-4ecd-b9ab-855f809ec7f6 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:20.431902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1060/2108] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:00:20.435619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba075f20-1cd9-4ecd-b9ab-855f809ec7f6 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:20.447471 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba075f20-1cd9-4ecd-b9ab-855f809ec7f6 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:20.452407 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38864ff-c18c-4950-a570-131af783dead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:20.454479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38864ff-c18c-4950-a570-131af783dead admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:20.455188 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38864ff-c18c-4950-a570-131af783dead admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:20.455188 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38864ff-c18c-4950-a570-131af783dead admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:20.455838 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38864ff-c18c-4950-a570-131af783dead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:20.458306 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38864ff-c18c-4950-a570-131af783dead admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:20.461402 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1049/2109] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:20 2022] PUT /identity/v3/projects/d4716f3d997145df8be1250bcab52502/users/99512829ebe04974a0e4981cf2800514/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:20.472210 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1061/2110] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:00:20.474057 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd1d67-36ca-4722-b644-bc0cdeb5afbd admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:20.479191 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58166261-f7d9-47e4-aa9d-067bdbf8f377 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:20.479475 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58166261-f7d9-47e4-aa9d-067bdbf8f377 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:20.479751 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58166261-f7d9-47e4-aa9d-067bdbf8f377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:20.509731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-58166261-f7d9-47e4-aa9d-067bdbf8f377 None None] MFA Rules not processed for user `99512829ebe04974a0e4981cf2800514`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:20.511004 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-58166261-f7d9-47e4-aa9d-067bdbf8f377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:20.545284 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd1d67-36ca-4722-b644-bc0cdeb5afbd admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:20.553671 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2926f-0dfe-4ddb-8fd2-3d4fc2595955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:20.555481 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2926f-0dfe-4ddb-8fd2-3d4fc2595955 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:20.555958 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2926f-0dfe-4ddb-8fd2-3d4fc2595955 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:20.556658 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2926f-0dfe-4ddb-8fd2-3d4fc2595955 admin admin] PATH_INFO: `/v3/projects/bea3dff977df4f8782199d1084bbd808/users/211b0ba5012f4e0f8ab1c850d4ebdfaf/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:20.576672 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2926f-0dfe-4ddb-8fd2-3d4fc2595955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea3dff977df4f8782199d1084bbd808, user_id=211b0ba5012f4e0f8ab1c850d4ebdfaf, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:20.579896 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2926f-0dfe-4ddb-8fd2-3d4fc2595955 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:20.586698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1062/2111] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:00:20.599317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58166261-f7d9-47e4-aa9d-067bdbf8f377 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:20.600708 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-58166261-f7d9-47e4-aa9d-067bdbf8f377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:20.667557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58166261-f7d9-47e4-aa9d-067bdbf8f377 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:20.673797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1050/2112] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:20 2022] PUT /identity/v3/projects/bea3dff977df4f8782199d1084bbd808/users/211b0ba5012f4e0f8ab1c850d4ebdfaf/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:00:20.679196 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bc596-b3f1-49d5-9411-fcdb1a4e3151 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:20.681956 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bc596-b3f1-49d5-9411-fcdb1a4e3151 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:20.681956 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bc596-b3f1-49d5-9411-fcdb1a4e3151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:20.716526 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-8a0bc596-b3f1-49d5-9411-fcdb1a4e3151 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:20.716644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-8a0bc596-b3f1-49d5-9411-fcdb1a4e3151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:20.750869 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753bd93-f52a-4754-a303-cf5664572f9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:20.751729 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753bd93-f52a-4754-a303-cf5664572f9f service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:20.752171 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753bd93-f52a-4754-a303-cf5664572f9f service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:20.752645 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753bd93-f52a-4754-a303-cf5664572f9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:20.799610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:20.819427 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1051/2113] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:20.830642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bc596-b3f1-49d5-9411-fcdb1a4e3151 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:20.832865 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-8a0bc596-b3f1-49d5-9411-fcdb1a4e3151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:20.837284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753bd93-f52a-4754-a303-cf5664572f9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:20.839026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753bd93-f52a-4754-a303-cf5664572f9f service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:20.848963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1063/2114] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:00:20.882434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753bd93-f52a-4754-a303-cf5664572f9f service cinder] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:20.900536 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753bd93-f52a-4754-a303-cf5664572f9f service cinder] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:20.903946 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bc596-b3f1-49d5-9411-fcdb1a4e3151 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:20.907020 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9e3d3-5f80-4406-89c8-ca542e705c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:20.907612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9e3d3-5f80-4406-89c8-ca542e705c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:20.907889 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9e3d3-5f80-4406-89c8-ca542e705c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:20.908156 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9e3d3-5f80-4406-89c8-ca542e705c1c admin admin] PATH_INFO: `/v3/users/99512829ebe04974a0e4981cf2800514` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:20.908428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98351577-bc3b-47bf-adc2-9ea2ba7ecca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:20.909047 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98351577-bc3b-47bf-adc2-9ea2ba7ecca3 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:20.909369 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9e3d3-5f80-4406-89c8-ca542e705c1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=99512829ebe04974a0e4981cf2800514)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:20.909469 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98351577-bc3b-47bf-adc2-9ea2ba7ecca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:20.909745 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98351577-bc3b-47bf-adc2-9ea2ba7ecca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:20.911375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9e3d3-5f80-4406-89c8-ca542e705c1c admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:20.920860 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98351577-bc3b-47bf-adc2-9ea2ba7ecca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:20.922275 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98351577-bc3b-47bf-adc2-9ea2ba7ecca3 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:20.930785 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:20.936979 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1052/2115] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:00:21.104297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-06b9e3d3-5f80-4406-89c8-ca542e705c1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99512829ebe04974a0e4981cf2800514'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:21.122334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-06b9e3d3-5f80-4406-89c8-ca542e705c1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99512829ebe04974a0e4981cf2800514'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:21.123477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-06b9e3d3-5f80-4406-89c8-ca542e705c1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99512829ebe04974a0e4981cf2800514'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:21.124106 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-06b9e3d3-5f80-4406-89c8-ca542e705c1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99512829ebe04974a0e4981cf2800514'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:21.133076 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-06b9e3d3-5f80-4406-89c8-ca542e705c1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99512829ebe04974a0e4981cf2800514'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:21.220303 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1064/2116] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:00:20 2022] DELETE /identity/v3/users/99512829ebe04974a0e4981cf2800514 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:00:21.227648 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b945a27-680e-4832-ac1e-9e892677a601 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:21.228159 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b945a27-680e-4832-ac1e-9e892677a601 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:21.228641 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b945a27-680e-4832-ac1e-9e892677a601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:21.249418 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-3b945a27-680e-4832-ac1e-9e892677a601 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:21.250812 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-3b945a27-680e-4832-ac1e-9e892677a601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:21.327094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1053/2117] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:21.344203 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9e3d3-5f80-4406-89c8-ca542e705c1c admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:21.345699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-06b9e3d3-5f80-4406-89c8-ca542e705c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:21.431453 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9e3d3-5f80-4406-89c8-ca542e705c1c admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:21.455832 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba198a-cb3c-4e94-9735-51263f6725b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:21.456477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba198a-cb3c-4e94-9735-51263f6725b6 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:21.456811 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba198a-cb3c-4e94-9735-51263f6725b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:21.457119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba198a-cb3c-4e94-9735-51263f6725b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:21.470500 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba198a-cb3c-4e94-9735-51263f6725b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:21.472456 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba198a-cb3c-4e94-9735-51263f6725b6 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:21.486048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1065/2118] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:00:22.067943 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b945a27-680e-4832-ac1e-9e892677a601 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:22.070579 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-3b945a27-680e-4832-ac1e-9e892677a601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:22.085678 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b945a27-680e-4832-ac1e-9e892677a601 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:22.090587 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23dab1-d8e4-4f99-a9c3-3b63d324375b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:22.091419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23dab1-d8e4-4f99-a9c3-3b63d324375b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:22.091683 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23dab1-d8e4-4f99-a9c3-3b63d324375b admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:22.091952 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23dab1-d8e4-4f99-a9c3-3b63d324375b admin admin] PATH_INFO: `/v3/projects/d4716f3d997145df8be1250bcab52502` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:22.093570 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23dab1-d8e4-4f99-a9c3-3b63d324375b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4716f3d997145df8be1250bcab52502)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:22.095463 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23dab1-d8e4-4f99-a9c3-3b63d324375b admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:22.164915 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:22.198704 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7b23dab1-d8e4-4f99-a9c3-3b63d324375b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4716f3d997145df8be1250bcab52502', 'request_id': 'req-7b23dab1-d8e4-4f99-a9c3-3b63d324375b'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:22.204359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7b23dab1-d8e4-4f99-a9c3-3b63d324375b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4716f3d997145df8be1250bcab52502', 'request_id': 'req-7b23dab1-d8e4-4f99-a9c3-3b63d324375b'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:22.211583 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7b23dab1-d8e4-4f99-a9c3-3b63d324375b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4716f3d997145df8be1250bcab52502', 'request_id': 'req-7b23dab1-d8e4-4f99-a9c3-3b63d324375b'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:22.256307 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:22.283578 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7b23dab1-d8e4-4f99-a9c3-3b63d324375b admin admin] The token cache is being invalidate because project d4716f3d997145df8be1250bcab52502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:00:22.283734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7b23dab1-d8e4-4f99-a9c3-3b63d324375b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:22.284420 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7b23dab1-d8e4-4f99-a9c3-3b63d324375b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:22.287403 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1054/2119] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:00:22 2022] DELETE /identity/v3/projects/d4716f3d997145df8be1250bcab52502 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:22.292570 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77834d9a-eea5-4c42-b856-9502caa2edcf None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:22.293768 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77834d9a-eea5-4c42-b856-9502caa2edcf None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:22.294211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77834d9a-eea5-4c42-b856-9502caa2edcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:22.317567 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-77834d9a-eea5-4c42-b856-9502caa2edcf None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:22.318875 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-77834d9a-eea5-4c42-b856-9502caa2edcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:22.396512 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1066/2120] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:22.405496 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976ba0c-89c8-4f97-a797-fdadcc68a5c2 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:22.410683 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976ba0c-89c8-4f97-a797-fdadcc68a5c2 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:22.410965 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976ba0c-89c8-4f97-a797-fdadcc68a5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:22.437602 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-8976ba0c-89c8-4f97-a797-fdadcc68a5c2 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:22.438910 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-8976ba0c-89c8-4f97-a797-fdadcc68a5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:22.448040 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1055/2121] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:22.455239 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77834d9a-eea5-4c42-b856-9502caa2edcf None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:22.465763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77834d9a-eea5-4c42-b856-9502caa2edcf None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:22.471687 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c3885-50cb-475a-ba1e-e79e4a0b0648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:22.472401 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c3885-50cb-475a-ba1e-e79e4a0b0648 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:22.472680 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c3885-50cb-475a-ba1e-e79e4a0b0648 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:22.472949 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c3885-50cb-475a-ba1e-e79e4a0b0648 admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:22.473624 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c3885-50cb-475a-ba1e-e79e4a0b0648 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:00:22.473926 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c3885-50cb-475a-ba1e-e79e4a0b0648 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:22.475612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c3885-50cb-475a-ba1e-e79e4a0b0648 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:22.487265 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1067/2122] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:00:22.492409 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976ba0c-89c8-4f97-a797-fdadcc68a5c2 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:22.501786 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976ba0c-89c8-4f97-a797-fdadcc68a5c2 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:22.508059 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde401af-3535-4385-bcad-9f82d7ceaa31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:22.509566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde401af-3535-4385-bcad-9f82d7ceaa31 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:22.509566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde401af-3535-4385-bcad-9f82d7ceaa31 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:22.509566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde401af-3535-4385-bcad-9f82d7ceaa31 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:22.510328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde401af-3535-4385-bcad-9f82d7ceaa31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:22.512298 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde401af-3535-4385-bcad-9f82d7ceaa31 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:22.610571 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1056/2123] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:00:22 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:00:22.619444 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c3885-50cb-475a-ba1e-e79e4a0b0648 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:22.626091 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c3885-50cb-475a-ba1e-e79e4a0b0648 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:22.655989 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:22.712190 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c38fbc-13e7-46b9-8c64-7803917b2e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:22.712941 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c38fbc-13e7-46b9-8c64-7803917b2e23 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:22.713318 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c38fbc-13e7-46b9-8c64-7803917b2e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:22.714043 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c38fbc-13e7-46b9-8c64-7803917b2e23 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:22.714594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c38fbc-13e7-46b9-8c64-7803917b2e23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:22.716643 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c38fbc-13e7-46b9-8c64-7803917b2e23 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:22.794067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1068/2124] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:00:22 2022] POST /identity/v3/users => generated 288 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:00:22.798426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde401af-3535-4385-bcad-9f82d7ceaa31 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:22.809847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde401af-3535-4385-bcad-9f82d7ceaa31 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:22.815278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d2c7c-2caa-4787-9f54-0515429f3d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:22.815884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d2c7c-2caa-4787-9f54-0515429f3d7b admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:22.816162 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d2c7c-2caa-4787-9f54-0515429f3d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:22.816993 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d2c7c-2caa-4787-9f54-0515429f3d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:22.817676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d2c7c-2caa-4787-9f54-0515429f3d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:22.819504 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d2c7c-2caa-4787-9f54-0515429f3d7b admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:22.833494 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1057/2125] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:22.836053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c38fbc-13e7-46b9-8c64-7803917b2e23 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:22.846934 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c38fbc-13e7-46b9-8c64-7803917b2e23 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:22.851532 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88185a76-d86f-47d4-8f79-043cc0985adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:22.852285 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88185a76-d86f-47d4-8f79-043cc0985adb admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:22.852573 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88185a76-d86f-47d4-8f79-043cc0985adb admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:22.852846 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88185a76-d86f-47d4-8f79-043cc0985adb admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:22.853489 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88185a76-d86f-47d4-8f79-043cc0985adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:22.855917 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88185a76-d86f-47d4-8f79-043cc0985adb admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:22.872422 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1069/2126] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:00:22.876358 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d2c7c-2caa-4787-9f54-0515429f3d7b admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:22.889819 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d2c7c-2caa-4787-9f54-0515429f3d7b admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:22.895836 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c12620-15c0-419c-ab65-16ccdb1ce55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:22.896508 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c12620-15c0-419c-ab65-16ccdb1ce55f admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:22.896786 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c12620-15c0-419c-ab65-16ccdb1ce55f admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:22.897087 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c12620-15c0-419c-ab65-16ccdb1ce55f admin admin] PATH_INFO: `/v3/projects/5c1447caa3f34de7985f38f6a0254df6/users/cad422bf8e2d488eab8c8ea0c1f1794d/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:22.923628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c12620-15c0-419c-ab65-16ccdb1ce55f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c1447caa3f34de7985f38f6a0254df6, user_id=cad422bf8e2d488eab8c8ea0c1f1794d, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:22.927078 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c12620-15c0-419c-ab65-16ccdb1ce55f admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:23.039056 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1058/2127] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:22 2022] PUT /identity/v3/projects/5c1447caa3f34de7985f38f6a0254df6/users/cad422bf8e2d488eab8c8ea0c1f1794d/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:23.049315 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22423b-4ff9-484e-9b27-1ee7cdf5b499 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:23.049603 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22423b-4ff9-484e-9b27-1ee7cdf5b499 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:23.049866 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22423b-4ff9-484e-9b27-1ee7cdf5b499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:23.078664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-3b22423b-4ff9-484e-9b27-1ee7cdf5b499 None None] MFA Rules not processed for user `cad422bf8e2d488eab8c8ea0c1f1794d`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:23.079881 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-3b22423b-4ff9-484e-9b27-1ee7cdf5b499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:23.167477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1070/2128] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:23.184042 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c12620-15c0-419c-ab65-16ccdb1ce55f admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:23.184042 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-d6c12620-15c0-419c-ab65-16ccdb1ce55f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:23.200653 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22423b-4ff9-484e-9b27-1ee7cdf5b499 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:23.202786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-3b22423b-4ff9-484e-9b27-1ee7cdf5b499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:23.256764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:23.273187 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c12620-15c0-419c-ab65-16ccdb1ce55f admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:23.278226 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6806ba7-a821-4e07-a5c5-ece0999d548d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:23.278852 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6806ba7-a821-4e07-a5c5-ece0999d548d service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:23.279195 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6806ba7-a821-4e07-a5c5-ece0999d548d service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:23.279489 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6806ba7-a821-4e07-a5c5-ece0999d548d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:23.298907 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6806ba7-a821-4e07-a5c5-ece0999d548d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:23.301390 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6806ba7-a821-4e07-a5c5-ece0999d548d service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:23.309133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22423b-4ff9-484e-9b27-1ee7cdf5b499 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:23.312763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1059/2129] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:00:23.314734 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed918caa-84a8-4c13-88f0-0812e70393d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:23.315379 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed918caa-84a8-4c13-88f0-0812e70393d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:23.315654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed918caa-84a8-4c13-88f0-0812e70393d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:23.315921 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed918caa-84a8-4c13-88f0-0812e70393d1 admin admin] PATH_INFO: `/v3/users/7fba5dda2a4e4e2185eba3fd3c18dd56` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:23.317275 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed918caa-84a8-4c13-88f0-0812e70393d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fba5dda2a4e4e2185eba3fd3c18dd56)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:23.319264 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed918caa-84a8-4c13-88f0-0812e70393d1 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:23.625484 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ed918caa-84a8-4c13-88f0-0812e70393d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fba5dda2a4e4e2185eba3fd3c18dd56'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:23.637441 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ed918caa-84a8-4c13-88f0-0812e70393d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fba5dda2a4e4e2185eba3fd3c18dd56'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:23.638278 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ed918caa-84a8-4c13-88f0-0812e70393d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fba5dda2a4e4e2185eba3fd3c18dd56'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:23.639129 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ed918caa-84a8-4c13-88f0-0812e70393d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fba5dda2a4e4e2185eba3fd3c18dd56'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:23.647631 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ed918caa-84a8-4c13-88f0-0812e70393d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fba5dda2a4e4e2185eba3fd3c18dd56'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:23.774531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1071/2130] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:00:23 2022] DELETE /identity/v3/users/7fba5dda2a4e4e2185eba3fd3c18dd56 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:23.779528 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582816b-b547-4fc9-91de-3c891eb2eb47 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:23.779787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582816b-b547-4fc9-91de-3c891eb2eb47 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:23.780064 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582816b-b547-4fc9-91de-3c891eb2eb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:23.800272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-e582816b-b547-4fc9-91de-3c891eb2eb47 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:23.806535 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-e582816b-b547-4fc9-91de-3c891eb2eb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:23.873363 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1060/2131] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:00:23.877953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:23.884036 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed918caa-84a8-4c13-88f0-0812e70393d1 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:23.887793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ed918caa-84a8-4c13-88f0-0812e70393d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:23.959469 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed918caa-84a8-4c13-88f0-0812e70393d1 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:23.963409 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e304ad-7451-4725-8abc-ea759da0da71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:23.964126 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e304ad-7451-4725-8abc-ea759da0da71 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:23.964466 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e304ad-7451-4725-8abc-ea759da0da71 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:23.964806 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e304ad-7451-4725-8abc-ea759da0da71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:23.976233 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e304ad-7451-4725-8abc-ea759da0da71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:23.977851 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e304ad-7451-4725-8abc-ea759da0da71 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:23.990282 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1072/2132] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:00:24.654435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582816b-b547-4fc9-91de-3c891eb2eb47 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:24.656678 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-e582816b-b547-4fc9-91de-3c891eb2eb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:24.680824 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582816b-b547-4fc9-91de-3c891eb2eb47 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:24.690597 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5ff35-7c94-4a45-8b92-bd89cb3ca3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:24.691943 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5ff35-7c94-4a45-8b92-bd89cb3ca3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:24.692099 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5ff35-7c94-4a45-8b92-bd89cb3ca3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:24.692472 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5ff35-7c94-4a45-8b92-bd89cb3ca3ae admin admin] PATH_INFO: `/v3/projects/d9e49df255204ee3936cd7777874aa7f` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:24.693484 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5ff35-7c94-4a45-8b92-bd89cb3ca3ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9e49df255204ee3936cd7777874aa7f)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:24.695756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5ff35-7c94-4a45-8b92-bd89cb3ca3ae admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:24.709757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:24.865581 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-61f5ff35-7c94-4a45-8b92-bd89cb3ca3ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9e49df255204ee3936cd7777874aa7f', 'request_id': 'req-61f5ff35-7c94-4a45-8b92-bd89cb3ca3ae'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:24.873522 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-61f5ff35-7c94-4a45-8b92-bd89cb3ca3ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9e49df255204ee3936cd7777874aa7f', 'request_id': 'req-61f5ff35-7c94-4a45-8b92-bd89cb3ca3ae'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:24.881519 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-61f5ff35-7c94-4a45-8b92-bd89cb3ca3ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9e49df255204ee3936cd7777874aa7f', 'request_id': 'req-61f5ff35-7c94-4a45-8b92-bd89cb3ca3ae'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:24.953686 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-61f5ff35-7c94-4a45-8b92-bd89cb3ca3ae admin admin] The token cache is being invalidate because project d9e49df255204ee3936cd7777874aa7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:00:24.953978 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-61f5ff35-7c94-4a45-8b92-bd89cb3ca3ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:24.954675 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-61f5ff35-7c94-4a45-8b92-bd89cb3ca3ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:24.956494 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1061/2133] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:00:24 2022] DELETE /identity/v3/projects/d9e49df255204ee3936cd7777874aa7f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:24.960726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e304ad-7451-4725-8abc-ea759da0da71 service neutron] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:24.971089 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e304ad-7451-4725-8abc-ea759da0da71 service neutron] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:25.033196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82da658-ddc2-40a5-b942-a555fb928224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:25.033835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82da658-ddc2-40a5-b942-a555fb928224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:25.034183 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82da658-ddc2-40a5-b942-a555fb928224 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:25.034400 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82da658-ddc2-40a5-b942-a555fb928224 admin admin] PATH_INFO: `/v3/users/74ab68da436b46768595d03d98b9e9e7` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:25.035526 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82da658-ddc2-40a5-b942-a555fb928224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74ab68da436b46768595d03d98b9e9e7)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:25.037580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82da658-ddc2-40a5-b942-a555fb928224 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:25.268754 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94bce5-3128-456a-97b7-7d2094979775 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:25.268754 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94bce5-3128-456a-97b7-7d2094979775 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:25.268754 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94bce5-3128-456a-97b7-7d2094979775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:25.281844 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-c82da658-ddc2-40a5-b942-a555fb928224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74ab68da436b46768595d03d98b9e9e7'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:25.297699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-c82da658-ddc2-40a5-b942-a555fb928224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74ab68da436b46768595d03d98b9e9e7'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:25.299058 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-c82da658-ddc2-40a5-b942-a555fb928224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74ab68da436b46768595d03d98b9e9e7'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:25.299683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-c82da658-ddc2-40a5-b942-a555fb928224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74ab68da436b46768595d03d98b9e9e7'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:25.311073 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-c82da658-ddc2-40a5-b942-a555fb928224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74ab68da436b46768595d03d98b9e9e7'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:25.321213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-ad94bce5-3128-456a-97b7-7d2094979775 None None] MFA Rules not processed for user `cad422bf8e2d488eab8c8ea0c1f1794d`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:25.326865 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-ad94bce5-3128-456a-97b7-7d2094979775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:25.391523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1073/2134] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:00:24 2022] DELETE /identity/v3/users/74ab68da436b46768595d03d98b9e9e7 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:25.458768 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1062/2135] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:00:25.525511 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:26.279323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82da658-ddc2-40a5-b942-a555fb928224 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:26.281508 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-c82da658-ddc2-40a5-b942-a555fb928224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:26.487451 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82da658-ddc2-40a5-b942-a555fb928224 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:26.506804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940a1bb-2335-4ffe-94d0-010277b7afd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:26.506804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940a1bb-2335-4ffe-94d0-010277b7afd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:26.506804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940a1bb-2335-4ffe-94d0-010277b7afd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:26.506804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940a1bb-2335-4ffe-94d0-010277b7afd4 admin admin] PATH_INFO: `/v3/projects/b62098ec087144ae9a17f57fe41c6b0f` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:26.507992 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940a1bb-2335-4ffe-94d0-010277b7afd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b62098ec087144ae9a17f57fe41c6b0f)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:26.510925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940a1bb-2335-4ffe-94d0-010277b7afd4 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:26.610732 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-8940a1bb-2335-4ffe-94d0-010277b7afd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b62098ec087144ae9a17f57fe41c6b0f', 'request_id': 'req-8940a1bb-2335-4ffe-94d0-010277b7afd4'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:26.617832 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-8940a1bb-2335-4ffe-94d0-010277b7afd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b62098ec087144ae9a17f57fe41c6b0f', 'request_id': 'req-8940a1bb-2335-4ffe-94d0-010277b7afd4'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:26.707847 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-8940a1bb-2335-4ffe-94d0-010277b7afd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b62098ec087144ae9a17f57fe41c6b0f', 'request_id': 'req-8940a1bb-2335-4ffe-94d0-010277b7afd4'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:26.723071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-8940a1bb-2335-4ffe-94d0-010277b7afd4 admin admin] The token cache is being invalidate because project b62098ec087144ae9a17f57fe41c6b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:00:26.723727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-8940a1bb-2335-4ffe-94d0-010277b7afd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:26.725023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-8940a1bb-2335-4ffe-94d0-010277b7afd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:26.727019 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1074/2136] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:00:26 2022] DELETE /identity/v3/projects/b62098ec087144ae9a17f57fe41c6b0f => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:26.731766 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433f8f9-f871-44aa-b8a5-cd2e2daa3c62 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:26.732261 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433f8f9-f871-44aa-b8a5-cd2e2daa3c62 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:26.732372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433f8f9-f871-44aa-b8a5-cd2e2daa3c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:26.754902 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-5433f8f9-f871-44aa-b8a5-cd2e2daa3c62 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:26.756139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-5433f8f9-f871-44aa-b8a5-cd2e2daa3c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:26.884931 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17371de4-2ced-41e3-ad69-3e61c454e496 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:26.885554 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17371de4-2ced-41e3-ad69-3e61c454e496 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:26.885828 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17371de4-2ced-41e3-ad69-3e61c454e496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:26.889923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1063/2137] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:26.911645 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-17371de4-2ced-41e3-ad69-3e61c454e496 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:26.911645 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-17371de4-2ced-41e3-ad69-3e61c454e496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:26.927119 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433f8f9-f871-44aa-b8a5-cd2e2daa3c62 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:26.954456 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1075/2138] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:26.957435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433f8f9-f871-44aa-b8a5-cd2e2daa3c62 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:26.963423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:26.965695 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e77a9a-65b4-4136-a945-a8f85be7e85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:26.965954 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e77a9a-65b4-4136-a945-a8f85be7e85b admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:26.966397 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e77a9a-65b4-4136-a945-a8f85be7e85b admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:26.966808 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e77a9a-65b4-4136-a945-a8f85be7e85b admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:26.967998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e77a9a-65b4-4136-a945-a8f85be7e85b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:00:26.968621 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e77a9a-65b4-4136-a945-a8f85be7e85b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:26.970875 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e77a9a-65b4-4136-a945-a8f85be7e85b admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:26.991092 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1064/2139] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:00:26.991706 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17371de4-2ced-41e3-ad69-3e61c454e496 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:27.002530 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17371de4-2ced-41e3-ad69-3e61c454e496 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:27.010739 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680603e-7b85-4901-af56-1791107c8787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:27.011363 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680603e-7b85-4901-af56-1791107c8787 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:27.011637 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680603e-7b85-4901-af56-1791107c8787 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:27.012088 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680603e-7b85-4901-af56-1791107c8787 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:27.012723 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680603e-7b85-4901-af56-1791107c8787 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:27.014687 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680603e-7b85-4901-af56-1791107c8787 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:27.143480 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1076/2140] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:00:26 2022] POST /identity/v3/projects => generated 369 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:00:27.145382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e77a9a-65b4-4136-a945-a8f85be7e85b admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:27.165780 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e77a9a-65b4-4136-a945-a8f85be7e85b admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:27.241107 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa8535-f396-41c5-9476-bd5ee282092b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:27.242248 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa8535-f396-41c5-9476-bd5ee282092b admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:27.242808 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa8535-f396-41c5-9476-bd5ee282092b admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:27.242960 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa8535-f396-41c5-9476-bd5ee282092b admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:27.243597 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa8535-f396-41c5-9476-bd5ee282092b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:27.245529 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa8535-f396-41c5-9476-bd5ee282092b admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:27.307855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e51e6-89c1-495a-97d5-423b82efec96 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:27.308370 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e51e6-89c1-495a-97d5-423b82efec96 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:27.308370 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e51e6-89c1-495a-97d5-423b82efec96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:27.352825 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-990e51e6-89c1-495a-97d5-423b82efec96 None None] MFA Rules not processed for user `211b0ba5012f4e0f8ab1c850d4ebdfaf`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:27.354141 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-990e51e6-89c1-495a-97d5-423b82efec96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:27.417251 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1065/2141] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:00:27 2022] POST /identity/v3/users => generated 285 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:27.420952 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa8535-f396-41c5-9476-bd5ee282092b admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:27.456199 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1077/2142] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:27.467622 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa8535-f396-41c5-9476-bd5ee282092b admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:27.476520 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e51e6-89c1-495a-97d5-423b82efec96 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:27.478199 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-990e51e6-89c1-495a-97d5-423b82efec96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:27.495197 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23860be0-face-47ba-bcf7-aebd470429eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:27.495197 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23860be0-face-47ba-bcf7-aebd470429eb admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:27.495197 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23860be0-face-47ba-bcf7-aebd470429eb admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:27.495197 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23860be0-face-47ba-bcf7-aebd470429eb admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:27.495850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23860be0-face-47ba-bcf7-aebd470429eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:27.496722 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23860be0-face-47ba-bcf7-aebd470429eb admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:27.526024 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1066/2143] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:27.527867 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23860be0-face-47ba-bcf7-aebd470429eb admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:27.541064 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23860be0-face-47ba-bcf7-aebd470429eb admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:27.547052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a2ae1-6744-4e56-a982-f9b9903dc29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:27.547821 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a2ae1-6744-4e56-a982-f9b9903dc29f admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:27.548103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a2ae1-6744-4e56-a982-f9b9903dc29f admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:27.548376 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a2ae1-6744-4e56-a982-f9b9903dc29f admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:27.549278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a2ae1-6744-4e56-a982-f9b9903dc29f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:27.550739 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a2ae1-6744-4e56-a982-f9b9903dc29f admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:27.564058 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1067/2144] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:27.568432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a2ae1-6744-4e56-a982-f9b9903dc29f admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:27.588387 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a2ae1-6744-4e56-a982-f9b9903dc29f admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:27.591370 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e51e6-89c1-495a-97d5-423b82efec96 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:27.599932 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7daa3a-17d1-4bb6-8206-52552fd5ba8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:27.600603 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7daa3a-17d1-4bb6-8206-52552fd5ba8a admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:27.600878 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7daa3a-17d1-4bb6-8206-52552fd5ba8a admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:27.601145 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7daa3a-17d1-4bb6-8206-52552fd5ba8a admin admin] PATH_INFO: `/v3/projects/fb49697364684e5db06c31e637d82e13/users/157aac0270684589997f7f8db870997f/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:27.605678 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed83f7-7c7f-4633-abf6-386f20ea09cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:27.606325 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed83f7-7c7f-4633-abf6-386f20ea09cc service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:27.606600 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed83f7-7c7f-4633-abf6-386f20ea09cc service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:27.606865 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed83f7-7c7f-4633-abf6-386f20ea09cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:27.620873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7daa3a-17d1-4bb6-8206-52552fd5ba8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb49697364684e5db06c31e637d82e13, user_id=157aac0270684589997f7f8db870997f, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:27.622347 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed83f7-7c7f-4633-abf6-386f20ea09cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:27.624483 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed83f7-7c7f-4633-abf6-386f20ea09cc service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:27.626503 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7daa3a-17d1-4bb6-8206-52552fd5ba8a admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:27.639478 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1078/2145] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:00:27.752568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1068/2146] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:27 2022] PUT /identity/v3/projects/fb49697364684e5db06c31e637d82e13/users/157aac0270684589997f7f8db870997f/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:00:27.764693 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99265193-a57e-4440-be0c-3cb05a690334 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:27.765283 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99265193-a57e-4440-be0c-3cb05a690334 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:27.765447 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99265193-a57e-4440-be0c-3cb05a690334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:27.800980 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-99265193-a57e-4440-be0c-3cb05a690334 None None] MFA Rules not processed for user `157aac0270684589997f7f8db870997f`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:27.802262 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-99265193-a57e-4440-be0c-3cb05a690334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:27.889938 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1079/2147] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:00:27.899936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7daa3a-17d1-4bb6-8206-52552fd5ba8a admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:27.902867 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-db7daa3a-17d1-4bb6-8206-52552fd5ba8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:28.033227 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7daa3a-17d1-4bb6-8206-52552fd5ba8a admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:28.041502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e4cf4-da83-4dc9-a659-5ca8a58f88bd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7791be968594cea9c32b51a7b3454b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:28.042545 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e4cf4-da83-4dc9-a659-5ca8a58f88bd service glance] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:28.042906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e4cf4-da83-4dc9-a659-5ca8a58f88bd service glance] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:28.043270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e4cf4-da83-4dc9-a659-5ca8a58f88bd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:28.068059 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e4cf4-da83-4dc9-a659-5ca8a58f88bd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:28.069911 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e4cf4-da83-4dc9-a659-5ca8a58f88bd service glance] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:28.085400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1069/2148] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:00:28.323197 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:30.376222 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:30.661797 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff986eaa-b659-4639-aeae-f100f77b3e99 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:30.663235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff986eaa-b659-4639-aeae-f100f77b3e99 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:30.663522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff986eaa-b659-4639-aeae-f100f77b3e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:30.690511 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-ff986eaa-b659-4639-aeae-f100f77b3e99 None None] MFA Rules not processed for user `211b0ba5012f4e0f8ab1c850d4ebdfaf`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:30.695284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ff986eaa-b659-4639-aeae-f100f77b3e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:30.787322 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1080/2149] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:30.841407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e4cf4-da83-4dc9-a659-5ca8a58f88bd service glance] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:30.843800 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-9b5e4cf4-da83-4dc9-a659-5ca8a58f88bd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:30.947058 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e4cf4-da83-4dc9-a659-5ca8a58f88bd service glance] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:30.964554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb00fd-7273-47cd-984e-dd35a62ad3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:30.965364 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb00fd-7273-47cd-984e-dd35a62ad3d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:30.965522 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb00fd-7273-47cd-984e-dd35a62ad3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:30.965804 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb00fd-7273-47cd-984e-dd35a62ad3d5 admin admin] PATH_INFO: `/v3/users/bda470ade8254d66a7b4475de1c13e46` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:30.968102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb00fd-7273-47cd-984e-dd35a62ad3d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bda470ade8254d66a7b4475de1c13e46)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:30.970136 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb00fd-7273-47cd-984e-dd35a62ad3d5 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:31.202813 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-72fb00fd-7273-47cd-984e-dd35a62ad3d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bda470ade8254d66a7b4475de1c13e46'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:31.219143 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-72fb00fd-7273-47cd-984e-dd35a62ad3d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bda470ade8254d66a7b4475de1c13e46'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:31.219995 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-72fb00fd-7273-47cd-984e-dd35a62ad3d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bda470ade8254d66a7b4475de1c13e46'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:31.232897 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-72fb00fd-7273-47cd-984e-dd35a62ad3d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bda470ade8254d66a7b4475de1c13e46'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:31.339119 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-72fb00fd-7273-47cd-984e-dd35a62ad3d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bda470ade8254d66a7b4475de1c13e46'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:31.350279 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1070/2150] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:00:30 2022] DELETE /identity/v3/users/bda470ade8254d66a7b4475de1c13e46 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:31.352447 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55ae53-10f1-414a-8ac0-27f91328f571 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:31.353000 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55ae53-10f1-414a-8ac0-27f91328f571 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:31.353287 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55ae53-10f1-414a-8ac0-27f91328f571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:31.382972 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-3e55ae53-10f1-414a-8ac0-27f91328f571 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:31.389435 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-3e55ae53-10f1-414a-8ac0-27f91328f571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:31.455941 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:31.543487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1081/2151] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:31.562252 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb00fd-7273-47cd-984e-dd35a62ad3d5 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:31.562252 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-72fb00fd-7273-47cd-984e-dd35a62ad3d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:31.677120 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb00fd-7273-47cd-984e-dd35a62ad3d5 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:31.681535 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77d869-4ab4-443e-8ad1-ee3d3510b00a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:31.682204 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77d869-4ab4-443e-8ad1-ee3d3510b00a service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:31.682482 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77d869-4ab4-443e-8ad1-ee3d3510b00a service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:31.682759 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77d869-4ab4-443e-8ad1-ee3d3510b00a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:31.702449 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77d869-4ab4-443e-8ad1-ee3d3510b00a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:31.706979 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77d869-4ab4-443e-8ad1-ee3d3510b00a service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:31.729945 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1071/2152] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:00:32.375886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:32.422265 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55ae53-10f1-414a-8ac0-27f91328f571 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:32.425162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-3e55ae53-10f1-414a-8ac0-27f91328f571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:32.456130 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55ae53-10f1-414a-8ac0-27f91328f571 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:32.480734 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5260cd-6110-4d2b-a32c-5f801d6bc007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:32.481575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5260cd-6110-4d2b-a32c-5f801d6bc007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:32.481864 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5260cd-6110-4d2b-a32c-5f801d6bc007 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:32.482184 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5260cd-6110-4d2b-a32c-5f801d6bc007 admin admin] PATH_INFO: `/v3/projects/50cb5ebbf5a84e63a8f536e23ebfa92f` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:32.483551 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5260cd-6110-4d2b-a32c-5f801d6bc007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50cb5ebbf5a84e63a8f536e23ebfa92f)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:32.485656 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5260cd-6110-4d2b-a32c-5f801d6bc007 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:32.637964 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-cd5260cd-6110-4d2b-a32c-5f801d6bc007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50cb5ebbf5a84e63a8f536e23ebfa92f', 'request_id': 'req-cd5260cd-6110-4d2b-a32c-5f801d6bc007'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:32.654153 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-cd5260cd-6110-4d2b-a32c-5f801d6bc007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50cb5ebbf5a84e63a8f536e23ebfa92f', 'request_id': 'req-cd5260cd-6110-4d2b-a32c-5f801d6bc007'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:32.734938 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-cd5260cd-6110-4d2b-a32c-5f801d6bc007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50cb5ebbf5a84e63a8f536e23ebfa92f', 'request_id': 'req-cd5260cd-6110-4d2b-a32c-5f801d6bc007'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:32.748211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-cd5260cd-6110-4d2b-a32c-5f801d6bc007 admin admin] The token cache is being invalidate because project 50cb5ebbf5a84e63a8f536e23ebfa92f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:00:32.748587 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-cd5260cd-6110-4d2b-a32c-5f801d6bc007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:32.749348 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-cd5260cd-6110-4d2b-a32c-5f801d6bc007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:32.751464 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1082/2153] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:00:32 2022] DELETE /identity/v3/projects/50cb5ebbf5a84e63a8f536e23ebfa92f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:32.756488 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e4ccc-5ff6-4aa4-bc62-7b62671cb08e None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:32.756949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e4ccc-5ff6-4aa4-bc62-7b62671cb08e None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:32.757187 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e4ccc-5ff6-4aa4-bc62-7b62671cb08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:32.778328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-9c8e4ccc-5ff6-4aa4-bc62-7b62671cb08e None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:32.779625 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-9c8e4ccc-5ff6-4aa4-bc62-7b62671cb08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:32.851469 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1072/2154] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:00:32.857868 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fdebc-1969-424a-87e7-b2ff90fad74a None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:32.858502 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fdebc-1969-424a-87e7-b2ff90fad74a None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:32.859454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fdebc-1969-424a-87e7-b2ff90fad74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:32.897605 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-a05fdebc-1969-424a-87e7-b2ff90fad74a None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:32.898887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-a05fdebc-1969-424a-87e7-b2ff90fad74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:32.908660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1083/2155] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:00:32.913069 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e4ccc-5ff6-4aa4-bc62-7b62671cb08e None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:32.923120 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e4ccc-5ff6-4aa4-bc62-7b62671cb08e None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:32.928374 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0824ca6-a0e4-4a52-8276-2be414dbe81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:32.928964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0824ca6-a0e4-4a52-8276-2be414dbe81d admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:32.929242 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0824ca6-a0e4-4a52-8276-2be414dbe81d admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:32.929514 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0824ca6-a0e4-4a52-8276-2be414dbe81d admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:32.931372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0824ca6-a0e4-4a52-8276-2be414dbe81d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:00:32.931372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0824ca6-a0e4-4a52-8276-2be414dbe81d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:32.932079 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0824ca6-a0e4-4a52-8276-2be414dbe81d admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:32.944387 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1073/2156] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:00:32.954324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fdebc-1969-424a-87e7-b2ff90fad74a None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:32.958980 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fdebc-1969-424a-87e7-b2ff90fad74a None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:32.963887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0baef-bcf9-4f3e-b113-892905370b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:32.964606 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0baef-bcf9-4f3e-b113-892905370b8d admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:32.964947 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0baef-bcf9-4f3e-b113-892905370b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:32.965496 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0baef-bcf9-4f3e-b113-892905370b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:32.966401 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0baef-bcf9-4f3e-b113-892905370b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:32.968312 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0baef-bcf9-4f3e-b113-892905370b8d admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:33.062123 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1084/2157] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:00:32 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:33.065028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0824ca6-a0e4-4a52-8276-2be414dbe81d admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:33.076003 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0824ca6-a0e4-4a52-8276-2be414dbe81d admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:33.143205 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b3891-5326-4c45-9173-1fe82a683a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:33.143770 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b3891-5326-4c45-9173-1fe82a683a16 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:33.144065 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b3891-5326-4c45-9173-1fe82a683a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:33.147941 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b3891-5326-4c45-9173-1fe82a683a16 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:33.147941 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b3891-5326-4c45-9173-1fe82a683a16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:33.147941 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b3891-5326-4c45-9173-1fe82a683a16 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:33.254843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1074/2158] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:00:33 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:33.259153 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0baef-bcf9-4f3e-b113-892905370b8d admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:33.273890 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0baef-bcf9-4f3e-b113-892905370b8d admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:33.283726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82970d-698e-40fe-9099-7f0e12e58e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:33.284419 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82970d-698e-40fe-9099-7f0e12e58e72 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:33.284760 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82970d-698e-40fe-9099-7f0e12e58e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:33.285254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82970d-698e-40fe-9099-7f0e12e58e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:33.285981 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82970d-698e-40fe-9099-7f0e12e58e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:33.287792 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82970d-698e-40fe-9099-7f0e12e58e72 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:33.303921 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1085/2159] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:00:33.307639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b3891-5326-4c45-9173-1fe82a683a16 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:33.319708 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b3891-5326-4c45-9173-1fe82a683a16 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:33.325958 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba0928-ce0d-49b0-bd96-863d78a09fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:33.326324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba0928-ce0d-49b0-bd96-863d78a09fbb admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:33.326750 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba0928-ce0d-49b0-bd96-863d78a09fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:33.327032 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba0928-ce0d-49b0-bd96-863d78a09fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:33.327672 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba0928-ce0d-49b0-bd96-863d78a09fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:33.329875 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba0928-ce0d-49b0-bd96-863d78a09fbb admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:33.342677 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1075/2160] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:00:33.346401 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82970d-698e-40fe-9099-7f0e12e58e72 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:33.363399 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82970d-698e-40fe-9099-7f0e12e58e72 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:33.369159 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e7937-4140-4ed0-bf5c-11f1a53b0058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:33.370009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e7937-4140-4ed0-bf5c-11f1a53b0058 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:33.370432 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e7937-4140-4ed0-bf5c-11f1a53b0058 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:33.370832 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e7937-4140-4ed0-bf5c-11f1a53b0058 admin admin] PATH_INFO: `/v3/projects/e7d0972d6ea94b7bbb5f626716a56650/users/ea946a66d10742f8ac66f5c794e16a70/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:33.406941 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e7937-4140-4ed0-bf5c-11f1a53b0058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7d0972d6ea94b7bbb5f626716a56650, user_id=ea946a66d10742f8ac66f5c794e16a70, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:33.413156 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e7937-4140-4ed0-bf5c-11f1a53b0058 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:33.559040 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1086/2161] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:33 2022] PUT /identity/v3/projects/e7d0972d6ea94b7bbb5f626716a56650/users/ea946a66d10742f8ac66f5c794e16a70/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:33.570720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85206ef-2c54-4042-895a-6e936a371fea None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:33.570991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85206ef-2c54-4042-895a-6e936a371fea None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:33.571455 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85206ef-2c54-4042-895a-6e936a371fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:33.607728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-a85206ef-2c54-4042-895a-6e936a371fea None None] MFA Rules not processed for user `ea946a66d10742f8ac66f5c794e16a70`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:33.609263 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-a85206ef-2c54-4042-895a-6e936a371fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:33.714579 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:33.714911 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e7937-4140-4ed0-bf5c-11f1a53b0058 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:33.715330 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1076/2162] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:33.783906 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e7937-4140-4ed0-bf5c-11f1a53b0058 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:33.788817 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c8dcb-87dd-4c1a-b1c4-c9ac6b04758e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:33.789417 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c8dcb-87dd-4c1a-b1c4-c9ac6b04758e admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:33.789695 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c8dcb-87dd-4c1a-b1c4-c9ac6b04758e admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:33.789967 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c8dcb-87dd-4c1a-b1c4-c9ac6b04758e admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:33.790639 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c8dcb-87dd-4c1a-b1c4-c9ac6b04758e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:33.792816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c8dcb-87dd-4c1a-b1c4-c9ac6b04758e admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:33.917994 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1087/2163] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:00:33 2022] POST /identity/v3/projects => generated 375 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:00:33.922223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85206ef-2c54-4042-895a-6e936a371fea None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:33.936435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85206ef-2c54-4042-895a-6e936a371fea None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:34.011968 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8f60d-2a0d-40e8-bc19-b03fd2953394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:34.022987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8f60d-2a0d-40e8-bc19-b03fd2953394 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:34.022987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8f60d-2a0d-40e8-bc19-b03fd2953394 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:34.022987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8f60d-2a0d-40e8-bc19-b03fd2953394 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:34.022987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8f60d-2a0d-40e8-bc19-b03fd2953394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:34.022987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8f60d-2a0d-40e8-bc19-b03fd2953394 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:34.173094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1077/2164] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:00:33 2022] POST /identity/v3/users => generated 288 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:34.174303 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c8dcb-87dd-4c1a-b1c4-c9ac6b04758e admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:34.184988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c8dcb-87dd-4c1a-b1c4-c9ac6b04758e admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:34.189548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f1e0a-a0c3-479f-9cb3-2b2d903fbe2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:34.190173 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f1e0a-a0c3-479f-9cb3-2b2d903fbe2b admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:34.190449 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f1e0a-a0c3-479f-9cb3-2b2d903fbe2b admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:34.191282 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f1e0a-a0c3-479f-9cb3-2b2d903fbe2b admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:34.192015 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f1e0a-a0c3-479f-9cb3-2b2d903fbe2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:34.197409 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f1e0a-a0c3-479f-9cb3-2b2d903fbe2b admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:34.212121 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1088/2165] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:00:34.217226 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8f60d-2a0d-40e8-bc19-b03fd2953394 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:34.232767 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8f60d-2a0d-40e8-bc19-b03fd2953394 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:34.247419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca87913-6371-462c-a176-11f0ef039eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:34.248236 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca87913-6371-462c-a176-11f0ef039eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:34.248517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca87913-6371-462c-a176-11f0ef039eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:34.248786 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca87913-6371-462c-a176-11f0ef039eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:34.249430 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca87913-6371-462c-a176-11f0ef039eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:34.251053 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca87913-6371-462c-a176-11f0ef039eb2 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:34.264287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1078/2166] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:34.268814 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f1e0a-a0c3-479f-9cb3-2b2d903fbe2b admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:34.279133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f1e0a-a0c3-479f-9cb3-2b2d903fbe2b admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:34.284145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fc6ce-9761-4876-8e31-17d86313fee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:34.285409 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fc6ce-9761-4876-8e31-17d86313fee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:34.285949 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fc6ce-9761-4876-8e31-17d86313fee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:34.286573 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fc6ce-9761-4876-8e31-17d86313fee4 admin admin] PATH_INFO: `/v3/projects/a68a4ee0c7634a17a3f477b472e42430/users/ac8e5856cabd4612969bb035c6a7022f/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:34.309984 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fc6ce-9761-4876-8e31-17d86313fee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a68a4ee0c7634a17a3f477b472e42430, user_id=ac8e5856cabd4612969bb035c6a7022f, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:34.312721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fc6ce-9761-4876-8e31-17d86313fee4 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:34.390307 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca87913-6371-462c-a176-11f0ef039eb2 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:34.392145 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-0ca87913-6371-462c-a176-11f0ef039eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:34.420485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1089/2167] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:34 2022] PUT /identity/v3/projects/a68a4ee0c7634a17a3f477b472e42430/users/ac8e5856cabd4612969bb035c6a7022f/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:00:34.436627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cacbb-6f68-4f52-91c0-4d79c43568bf None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:34.436627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cacbb-6f68-4f52-91c0-4d79c43568bf None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:34.437640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cacbb-6f68-4f52-91c0-4d79c43568bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:34.507734 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-385cacbb-6f68-4f52-91c0-4d79c43568bf None None] MFA Rules not processed for user `ac8e5856cabd4612969bb035c6a7022f`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:34.509036 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-385cacbb-6f68-4f52-91c0-4d79c43568bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:34.509929 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca87913-6371-462c-a176-11f0ef039eb2 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:34.577225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:34.578570 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2167fbf-bc1f-469d-a472-d43ef112046e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:34.579442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2167fbf-bc1f-469d-a472-d43ef112046e service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:34.579442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2167fbf-bc1f-469d-a472-d43ef112046e service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:34.579705 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2167fbf-bc1f-469d-a472-d43ef112046e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:34.581727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-f2167fbf-bc1f-469d-a472-d43ef112046e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:34.634909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1090/2168] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:34.640303 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cacbb-6f68-4f52-91c0-4d79c43568bf None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:34.676713 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2167fbf-bc1f-469d-a472-d43ef112046e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:34.678193 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2167fbf-bc1f-469d-a472-d43ef112046e service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:34.702157 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1079/2169] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:00:34.718036 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cacbb-6f68-4f52-91c0-4d79c43568bf None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:34.732823 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542c094-994d-4023-aa12-2a08fe2df357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:34.733825 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542c094-994d-4023-aa12-2a08fe2df357 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:34.733825 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542c094-994d-4023-aa12-2a08fe2df357 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:34.734001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542c094-994d-4023-aa12-2a08fe2df357 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:34.734697 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542c094-994d-4023-aa12-2a08fe2df357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:34.736589 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542c094-994d-4023-aa12-2a08fe2df357 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:34.861781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1091/2170] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:00:34 2022] POST /identity/v3/projects => generated 375 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:34.865666 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2167fbf-bc1f-469d-a472-d43ef112046e service cinder] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:34.878138 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2167fbf-bc1f-469d-a472-d43ef112046e service cinder] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:34.952696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bf437-da01-4d74-b6d3-e289a322fc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:34.955024 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bf437-da01-4d74-b6d3-e289a322fc0d admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:34.955462 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bf437-da01-4d74-b6d3-e289a322fc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:34.955885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bf437-da01-4d74-b6d3-e289a322fc0d admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:34.957497 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bf437-da01-4d74-b6d3-e289a322fc0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:34.959691 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bf437-da01-4d74-b6d3-e289a322fc0d admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:35.082205 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1080/2171] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:00:34 2022] POST /identity/v3/users => generated 294 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:35.084439 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542c094-994d-4023-aa12-2a08fe2df357 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:35.094633 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542c094-994d-4023-aa12-2a08fe2df357 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:35.099226 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c054bf4-5ff6-474d-918a-066efbe9e77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:35.099877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c054bf4-5ff6-474d-918a-066efbe9e77a admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:35.100155 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c054bf4-5ff6-474d-918a-066efbe9e77a admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:35.100423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c054bf4-5ff6-474d-918a-066efbe9e77a admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:35.101057 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c054bf4-5ff6-474d-918a-066efbe9e77a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:35.102743 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c054bf4-5ff6-474d-918a-066efbe9e77a admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:35.112737 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1092/2172] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:35.118215 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bf437-da01-4d74-b6d3-e289a322fc0d admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:35.126828 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bf437-da01-4d74-b6d3-e289a322fc0d admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:35.132201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8309fa-ccc1-4116-8e63-6fcf90e3f79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:35.132883 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8309fa-ccc1-4116-8e63-6fcf90e3f79e admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:35.133166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8309fa-ccc1-4116-8e63-6fcf90e3f79e admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:35.133437 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8309fa-ccc1-4116-8e63-6fcf90e3f79e admin admin] PATH_INFO: `/v3/projects/225dfb9fdf1e4cce8e1c034d4f50c90b/users/92ee7b1250134acd9c4a96ae742b8518/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:35.150458 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8309fa-ccc1-4116-8e63-6fcf90e3f79e admin admin] RBAC: Authorizing `identity:create_grant(project_id=225dfb9fdf1e4cce8e1c034d4f50c90b, user_id=92ee7b1250134acd9c4a96ae742b8518, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:35.153237 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8309fa-ccc1-4116-8e63-6fcf90e3f79e admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:35.241645 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1081/2173] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:35 2022] PUT /identity/v3/projects/225dfb9fdf1e4cce8e1c034d4f50c90b/users/92ee7b1250134acd9c4a96ae742b8518/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:35.245797 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c054bf4-5ff6-474d-918a-066efbe9e77a admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:35.256152 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c054bf4-5ff6-474d-918a-066efbe9e77a admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:35.310432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:35.311938 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53282ceb-80d1-4f26-b281-b8a13545d308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:35.312543 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53282ceb-80d1-4f26-b281-b8a13545d308 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:35.312820 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53282ceb-80d1-4f26-b281-b8a13545d308 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:35.313089 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53282ceb-80d1-4f26-b281-b8a13545d308 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:35.313720 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53282ceb-80d1-4f26-b281-b8a13545d308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:35.315403 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53282ceb-80d1-4f26-b281-b8a13545d308 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:35.325510 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1093/2174] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:00:35.329722 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8309fa-ccc1-4116-8e63-6fcf90e3f79e admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:35.341775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8309fa-ccc1-4116-8e63-6fcf90e3f79e admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:35.346775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2ac99-fbbf-43f1-987a-a987eb2d2af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:35.347431 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2ac99-fbbf-43f1-987a-a987eb2d2af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:35.347704 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2ac99-fbbf-43f1-987a-a987eb2d2af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:35.347969 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2ac99-fbbf-43f1-987a-a987eb2d2af6 admin admin] PATH_INFO: `/v3/projects/225dfb9fdf1e4cce8e1c034d4f50c90b/users/92ee7b1250134acd9c4a96ae742b8518/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:35.349882 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2ac99-fbbf-43f1-987a-a987eb2d2af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=225dfb9fdf1e4cce8e1c034d4f50c90b, user_id=92ee7b1250134acd9c4a96ae742b8518, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:35.352673 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2ac99-fbbf-43f1-987a-a987eb2d2af6 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:35.364241 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1082/2175] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:35 2022] PUT /identity/v3/projects/225dfb9fdf1e4cce8e1c034d4f50c90b/users/92ee7b1250134acd9c4a96ae742b8518/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:35.381929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71fe57-27c1-4b3a-b117-a1b8e18aa26b None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:35.381929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71fe57-27c1-4b3a-b117-a1b8e18aa26b None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:35.381929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71fe57-27c1-4b3a-b117-a1b8e18aa26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:35.406820 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-da71fe57-27c1-4b3a-b117-a1b8e18aa26b None None] MFA Rules not processed for user `92ee7b1250134acd9c4a96ae742b8518`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:35.408041 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-da71fe57-27c1-4b3a-b117-a1b8e18aa26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:35.492642 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1094/2176] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:35.504809 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2ac99-fbbf-43f1-987a-a987eb2d2af6 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:35.505294 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:35.557915 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2ac99-fbbf-43f1-987a-a987eb2d2af6 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:35.561569 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b4850-092b-4f92-b380-27ba0e67fc38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:35.562188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b4850-092b-4f92-b380-27ba0e67fc38 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:35.562469 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b4850-092b-4f92-b380-27ba0e67fc38 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:35.562733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b4850-092b-4f92-b380-27ba0e67fc38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:35.618748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b4850-092b-4f92-b380-27ba0e67fc38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:35.620363 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b4850-092b-4f92-b380-27ba0e67fc38 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:35.631785 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1083/2177] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:00:35.959468 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:36.621512 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:36.856081 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:36.984449 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:37.636377 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71fe57-27c1-4b3a-b117-a1b8e18aa26b None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:37.646210 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71fe57-27c1-4b3a-b117-a1b8e18aa26b None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:37.649697 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1367be4-0b1e-4a70-95cb-603695ad6622 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:37.650326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1367be4-0b1e-4a70-95cb-603695ad6622 service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:37.650600 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1367be4-0b1e-4a70-95cb-603695ad6622 service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:37.650863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1367be4-0b1e-4a70-95cb-603695ad6622 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:37.682257 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:DELETE=13,keystone:SELECT=83,keystone:INSERT=4 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:37.707991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1367be4-0b1e-4a70-95cb-603695ad6622 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:37.709435 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1367be4-0b1e-4a70-95cb-603695ad6622 service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:37.718580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1095/2178] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:00:37.750386 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:38.873248 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:39.088539 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:39.226498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b4850-092b-4f92-b380-27ba0e67fc38 service cinder] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:39.234801 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b4850-092b-4f92-b380-27ba0e67fc38 service cinder] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:39.244384 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776939d5-b4d6-492f-a488-744d5acc11b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:39.245231 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776939d5-b4d6-492f-a488-744d5acc11b3 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:39.245839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776939d5-b4d6-492f-a488-744d5acc11b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:39.248974 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776939d5-b4d6-492f-a488-744d5acc11b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:39.259829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776939d5-b4d6-492f-a488-744d5acc11b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:39.261880 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776939d5-b4d6-492f-a488-744d5acc11b3 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:39.274067 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1084/2179] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:00:39.977178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:40.104466 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:40.665634 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:41.004132 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:41.130494 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:41.721599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:42.181628 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:42.499704 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:43.523828 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:43.658623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:44.637038 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1367be4-0b1e-4a70-95cb-603695ad6622 service cinder] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:44.706155 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1367be4-0b1e-4a70-95cb-603695ad6622 service cinder] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:44.711455 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b7893-5345-45f2-95f0-b740747e4752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:44.712103 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b7893-5345-45f2-95f0-b740747e4752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:44.712384 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b7893-5345-45f2-95f0-b740747e4752 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:44.712656 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b7893-5345-45f2-95f0-b740747e4752 admin admin] PATH_INFO: `/v3/users/ea946a66d10742f8ac66f5c794e16a70` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:44.713835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b7893-5345-45f2-95f0-b740747e4752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea946a66d10742f8ac66f5c794e16a70)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:44.715845 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b7893-5345-45f2-95f0-b740747e4752 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:44.924261 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-7b7b7893-5345-45f2-95f0-b740747e4752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea946a66d10742f8ac66f5c794e16a70'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:44.942490 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-7b7b7893-5345-45f2-95f0-b740747e4752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea946a66d10742f8ac66f5c794e16a70'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:44.943201 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-7b7b7893-5345-45f2-95f0-b740747e4752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea946a66d10742f8ac66f5c794e16a70'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:44.943800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-7b7b7893-5345-45f2-95f0-b740747e4752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea946a66d10742f8ac66f5c794e16a70'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:44.950956 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-7b7b7893-5345-45f2-95f0-b740747e4752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea946a66d10742f8ac66f5c794e16a70'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:45.037933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1096/2180] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:00:44 2022] DELETE /identity/v3/users/ea946a66d10742f8ac66f5c794e16a70 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:45.043047 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542ecb9-15fd-4239-a645-ad94cdeefe59 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:45.043523 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542ecb9-15fd-4239-a645-ad94cdeefe59 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:45.043646 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542ecb9-15fd-4239-a645-ad94cdeefe59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:45.066728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-a542ecb9-15fd-4239-a645-ad94cdeefe59 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:45.068473 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-a542ecb9-15fd-4239-a645-ad94cdeefe59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:45.123857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:45.126433 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1085/2181] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:00:45.136759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b7893-5345-45f2-95f0-b740747e4752 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:45.138184 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-7b7b7893-5345-45f2-95f0-b740747e4752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:45.207334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b7893-5345-45f2-95f0-b740747e4752 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:45.210028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:45.211542 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa5deb-f1b9-4398-8b94-997be048c7ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:45.212280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa5deb-f1b9-4398-8b94-997be048c7ed service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:45.212561 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa5deb-f1b9-4398-8b94-997be048c7ed service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:45.212833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa5deb-f1b9-4398-8b94-997be048c7ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:45.223336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa5deb-f1b9-4398-8b94-997be048c7ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:45.224829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa5deb-f1b9-4398-8b94-997be048c7ed service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:45.234537 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1097/2182] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:00:45.746549 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:45.756777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542ecb9-15fd-4239-a645-ad94cdeefe59 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:45.775563 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-a542ecb9-15fd-4239-a645-ad94cdeefe59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:45.793945 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542ecb9-15fd-4239-a645-ad94cdeefe59 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:45.799252 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12235a0f-8f47-4af5-a109-a2704a1d69eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:45.799878 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12235a0f-8f47-4af5-a109-a2704a1d69eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:45.800152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12235a0f-8f47-4af5-a109-a2704a1d69eb admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:45.800565 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12235a0f-8f47-4af5-a109-a2704a1d69eb admin admin] PATH_INFO: `/v3/projects/e7d0972d6ea94b7bbb5f626716a56650` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:45.805073 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12235a0f-8f47-4af5-a109-a2704a1d69eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7d0972d6ea94b7bbb5f626716a56650)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:45.805073 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12235a0f-8f47-4af5-a109-a2704a1d69eb admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:45.849193 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:45.967542 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-12235a0f-8f47-4af5-a109-a2704a1d69eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7d0972d6ea94b7bbb5f626716a56650', 'request_id': 'req-12235a0f-8f47-4af5-a109-a2704a1d69eb'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:45.984754 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-12235a0f-8f47-4af5-a109-a2704a1d69eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7d0972d6ea94b7bbb5f626716a56650', 'request_id': 'req-12235a0f-8f47-4af5-a109-a2704a1d69eb'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:45.991906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-12235a0f-8f47-4af5-a109-a2704a1d69eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7d0972d6ea94b7bbb5f626716a56650', 'request_id': 'req-12235a0f-8f47-4af5-a109-a2704a1d69eb'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:46.106392 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-12235a0f-8f47-4af5-a109-a2704a1d69eb admin admin] The token cache is being invalidate because project e7d0972d6ea94b7bbb5f626716a56650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:00:46.110148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-12235a0f-8f47-4af5-a109-a2704a1d69eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:46.110148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-12235a0f-8f47-4af5-a109-a2704a1d69eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:46.110743 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1086/2183] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:00:45 2022] DELETE /identity/v3/projects/e7d0972d6ea94b7bbb5f626716a56650 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:46.115166 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa5deb-f1b9-4398-8b94-997be048c7ed service neutron] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:46.129541 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa5deb-f1b9-4398-8b94-997be048c7ed service neutron] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:46.189490 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7d561-f4f2-4208-b1ab-7b19711c05c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:46.190216 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7d561-f4f2-4208-b1ab-7b19711c05c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:46.190809 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7d561-f4f2-4208-b1ab-7b19711c05c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:46.191233 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7d561-f4f2-4208-b1ab-7b19711c05c6 admin admin] PATH_INFO: `/v3/users/ac8e5856cabd4612969bb035c6a7022f` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:46.193351 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7d561-f4f2-4208-b1ab-7b19711c05c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac8e5856cabd4612969bb035c6a7022f)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:46.195323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7d561-f4f2-4208-b1ab-7b19711c05c6 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:46.396146 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:46.399945 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-99e7d561-f4f2-4208-b1ab-7b19711c05c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac8e5856cabd4612969bb035c6a7022f'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:46.419206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:46.420452 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-99e7d561-f4f2-4208-b1ab-7b19711c05c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac8e5856cabd4612969bb035c6a7022f'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:46.421534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-99e7d561-f4f2-4208-b1ab-7b19711c05c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac8e5856cabd4612969bb035c6a7022f'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:46.422707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-99e7d561-f4f2-4208-b1ab-7b19711c05c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac8e5856cabd4612969bb035c6a7022f'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:46.440763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-99e7d561-f4f2-4208-b1ab-7b19711c05c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac8e5856cabd4612969bb035c6a7022f'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:46.513501 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1098/2184] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:00:46 2022] DELETE /identity/v3/users/ac8e5856cabd4612969bb035c6a7022f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:47.107659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12235a0f-8f47-4af5-a109-a2704a1d69eb admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:47.109120 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-12235a0f-8f47-4af5-a109-a2704a1d69eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:47.125720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12235a0f-8f47-4af5-a109-a2704a1d69eb admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:47.186719 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8358e2f-c784-48bd-9e93-7930fffafd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:47.187354 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8358e2f-c784-48bd-9e93-7930fffafd04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:47.187890 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8358e2f-c784-48bd-9e93-7930fffafd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:47.188166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8358e2f-c784-48bd-9e93-7930fffafd04 admin admin] PATH_INFO: `/v3/projects/a68a4ee0c7634a17a3f477b472e42430` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:47.189380 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8358e2f-c784-48bd-9e93-7930fffafd04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a68a4ee0c7634a17a3f477b472e42430)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:47.191370 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8358e2f-c784-48bd-9e93-7930fffafd04 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:47.316498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:47.334252 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-f8358e2f-c784-48bd-9e93-7930fffafd04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a68a4ee0c7634a17a3f477b472e42430', 'request_id': 'req-f8358e2f-c784-48bd-9e93-7930fffafd04'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:47.339630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-f8358e2f-c784-48bd-9e93-7930fffafd04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a68a4ee0c7634a17a3f477b472e42430', 'request_id': 'req-f8358e2f-c784-48bd-9e93-7930fffafd04'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:47.345691 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-f8358e2f-c784-48bd-9e93-7930fffafd04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a68a4ee0c7634a17a3f477b472e42430', 'request_id': 'req-f8358e2f-c784-48bd-9e93-7930fffafd04'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:47.424302 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:47.429432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-f8358e2f-c784-48bd-9e93-7930fffafd04 admin admin] The token cache is being invalidate because project a68a4ee0c7634a17a3f477b472e42430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:00:47.429728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-f8358e2f-c784-48bd-9e93-7930fffafd04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:47.430394 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-f8358e2f-c784-48bd-9e93-7930fffafd04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:47.432020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1087/2185] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:00:47 2022] DELETE /identity/v3/projects/a68a4ee0c7634a17a3f477b472e42430 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:47.436012 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7d561-f4f2-4208-b1ab-7b19711c05c6 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:47.437502 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-99e7d561-f4f2-4208-b1ab-7b19711c05c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:47.450571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7d561-f4f2-4208-b1ab-7b19711c05c6 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:47.506353 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8e25d-53de-43f3-99a6-c06f75272e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:47.506980 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8e25d-53de-43f3-99a6-c06f75272e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:47.507257 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8e25d-53de-43f3-99a6-c06f75272e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:47.507526 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8e25d-53de-43f3-99a6-c06f75272e4f admin admin] PATH_INFO: `/v3/users/92ee7b1250134acd9c4a96ae742b8518` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:47.508799 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8e25d-53de-43f3-99a6-c06f75272e4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=92ee7b1250134acd9c4a96ae742b8518)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:47.510863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8e25d-53de-43f3-99a6-c06f75272e4f admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:47.697392 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-efd8e25d-53de-43f3-99a6-c06f75272e4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92ee7b1250134acd9c4a96ae742b8518'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:47.710906 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-efd8e25d-53de-43f3-99a6-c06f75272e4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92ee7b1250134acd9c4a96ae742b8518'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:47.711758 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-efd8e25d-53de-43f3-99a6-c06f75272e4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92ee7b1250134acd9c4a96ae742b8518'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:47.712372 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-efd8e25d-53de-43f3-99a6-c06f75272e4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92ee7b1250134acd9c4a96ae742b8518'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:47.720244 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-efd8e25d-53de-43f3-99a6-c06f75272e4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92ee7b1250134acd9c4a96ae742b8518'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:47.793437 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1099/2186] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:00:47 2022] DELETE /identity/v3/users/92ee7b1250134acd9c4a96ae742b8518 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:00:47.795433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:48.032089 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:48.215343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:48.443990 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:48.501272 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:48.608900 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8358e2f-c784-48bd-9e93-7930fffafd04 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:48.610429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-f8358e2f-c784-48bd-9e93-7930fffafd04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:48.626812 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8358e2f-c784-48bd-9e93-7930fffafd04 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:48.688018 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb54dfd-03ac-4e9f-998d-8d8b14a50e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:48.688668 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb54dfd-03ac-4e9f-998d-8d8b14a50e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:48.688942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb54dfd-03ac-4e9f-998d-8d8b14a50e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:48.689208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb54dfd-03ac-4e9f-998d-8d8b14a50e7e admin admin] PATH_INFO: `/v3/projects/225dfb9fdf1e4cce8e1c034d4f50c90b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:48.690430 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb54dfd-03ac-4e9f-998d-8d8b14a50e7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=225dfb9fdf1e4cce8e1c034d4f50c90b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:48.692903 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb54dfd-03ac-4e9f-998d-8d8b14a50e7e admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:48.795979 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-fbb54dfd-03ac-4e9f-998d-8d8b14a50e7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '225dfb9fdf1e4cce8e1c034d4f50c90b', 'request_id': 'req-fbb54dfd-03ac-4e9f-998d-8d8b14a50e7e'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:48.801251 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-fbb54dfd-03ac-4e9f-998d-8d8b14a50e7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '225dfb9fdf1e4cce8e1c034d4f50c90b', 'request_id': 'req-fbb54dfd-03ac-4e9f-998d-8d8b14a50e7e'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:48.807510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-fbb54dfd-03ac-4e9f-998d-8d8b14a50e7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '225dfb9fdf1e4cce8e1c034d4f50c90b', 'request_id': 'req-fbb54dfd-03ac-4e9f-998d-8d8b14a50e7e'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:48.872275 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:48.909538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-fbb54dfd-03ac-4e9f-998d-8d8b14a50e7e admin admin] The token cache is being invalidate because project 225dfb9fdf1e4cce8e1c034d4f50c90b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:00:48.909834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-fbb54dfd-03ac-4e9f-998d-8d8b14a50e7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:48.910500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-fbb54dfd-03ac-4e9f-998d-8d8b14a50e7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:00:48.911998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1088/2187] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:00:48 2022] DELETE /identity/v3/projects/225dfb9fdf1e4cce8e1c034d4f50c90b => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:48.915548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:48.917422 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81a383-f1d3-49a6-b58d-9b2c9abbbd9f None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:48.920980 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81a383-f1d3-49a6-b58d-9b2c9abbbd9f None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:48.920980 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81a383-f1d3-49a6-b58d-9b2c9abbbd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:48.940517 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-fc81a383-f1d3-49a6-b58d-9b2c9abbbd9f None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:48.942476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-fc81a383-f1d3-49a6-b58d-9b2c9abbbd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:49.011032 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1100/2188] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:49.012702 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe427bf4-8a3e-4a4a-9f18-2438ec64cfad None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:49.012988 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe427bf4-8a3e-4a4a-9f18-2438ec64cfad None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:49.013259 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe427bf4-8a3e-4a4a-9f18-2438ec64cfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:49.036493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-fe427bf4-8a3e-4a4a-9f18-2438ec64cfad None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:49.037586 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-fe427bf4-8a3e-4a4a-9f18-2438ec64cfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:49.053531 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1089/2189] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:49.054639 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81a383-f1d3-49a6-b58d-9b2c9abbbd9f None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:49.065265 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81a383-f1d3-49a6-b58d-9b2c9abbbd9f None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:49.070665 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3463263-42e6-4c15-86bf-02d1a5665e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:49.071279 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3463263-42e6-4c15-86bf-02d1a5665e4b admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:49.071548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3463263-42e6-4c15-86bf-02d1a5665e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:49.072478 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3463263-42e6-4c15-86bf-02d1a5665e4b admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:49.072478 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3463263-42e6-4c15-86bf-02d1a5665e4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:00:49.072777 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3463263-42e6-4c15-86bf-02d1a5665e4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:49.074526 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3463263-42e6-4c15-86bf-02d1a5665e4b admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:49.088039 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1101/2190] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:00:49.092456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe427bf4-8a3e-4a4a-9f18-2438ec64cfad None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:49.102048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe427bf4-8a3e-4a4a-9f18-2438ec64cfad None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:49.106870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baed242-04b1-4a66-860e-b6b835f38313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:49.107470 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baed242-04b1-4a66-860e-b6b835f38313 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:49.107743 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baed242-04b1-4a66-860e-b6b835f38313 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:49.108295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baed242-04b1-4a66-860e-b6b835f38313 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:49.108873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baed242-04b1-4a66-860e-b6b835f38313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:49.110860 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baed242-04b1-4a66-860e-b6b835f38313 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:49.276946 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1090/2191] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:00:49 2022] POST /identity/v3/projects => generated 363 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:49.281998 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3463263-42e6-4c15-86bf-02d1a5665e4b admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:49.293146 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3463263-42e6-4c15-86bf-02d1a5665e4b admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:49.310963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:49.362958 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cec9c0-d066-4c68-949e-ce75f99ee320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:49.364394 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cec9c0-d066-4c68-949e-ce75f99ee320 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:49.364982 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cec9c0-d066-4c68-949e-ce75f99ee320 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:49.365255 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cec9c0-d066-4c68-949e-ce75f99ee320 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:49.365876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cec9c0-d066-4c68-949e-ce75f99ee320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:49.367829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cec9c0-d066-4c68-949e-ce75f99ee320 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:49.494676 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1102/2192] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:00:49 2022] POST /identity/v3/users => generated 282 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:00:49.498992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baed242-04b1-4a66-860e-b6b835f38313 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:49.509764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baed242-04b1-4a66-860e-b6b835f38313 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:49.513689 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:49.516406 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69dadf-14ed-40b5-b4a0-82480a02dda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:49.517017 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69dadf-14ed-40b5-b4a0-82480a02dda7 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:49.520398 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69dadf-14ed-40b5-b4a0-82480a02dda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:49.520398 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69dadf-14ed-40b5-b4a0-82480a02dda7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:49.520398 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69dadf-14ed-40b5-b4a0-82480a02dda7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:49.520398 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69dadf-14ed-40b5-b4a0-82480a02dda7 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:49.536806 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1091/2193] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:00:49.538485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cec9c0-d066-4c68-949e-ce75f99ee320 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:49.550950 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cec9c0-d066-4c68-949e-ce75f99ee320 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:49.556565 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f23bb-c38f-40d7-983e-a6f11c3a8cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:49.557214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f23bb-c38f-40d7-983e-a6f11c3a8cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:49.557677 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f23bb-c38f-40d7-983e-a6f11c3a8cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:49.557982 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f23bb-c38f-40d7-983e-a6f11c3a8cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:49.558660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f23bb-c38f-40d7-983e-a6f11c3a8cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:49.560573 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f23bb-c38f-40d7-983e-a6f11c3a8cf3 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:49.580533 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1103/2194] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:00:49.580993 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69dadf-14ed-40b5-b4a0-82480a02dda7 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:49.595259 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69dadf-14ed-40b5-b4a0-82480a02dda7 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:49.598335 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4162f-3b82-4de1-8836-71dc16371ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:49.598999 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4162f-3b82-4de1-8836-71dc16371ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:49.599275 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4162f-3b82-4de1-8836-71dc16371ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:49.599548 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4162f-3b82-4de1-8836-71dc16371ee4 admin admin] PATH_INFO: `/v3/projects/0eeb3223eae54feaa62684e974e303f1/users/53ec37bb89744b32bbc047cc4ab0e6b6/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:49.618654 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d4162f-3b82-4de1-8836-71dc16371ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eeb3223eae54feaa62684e974e303f1, user_id=53ec37bb89744b32bbc047cc4ab0e6b6, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:49.627827 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d4162f-3b82-4de1-8836-71dc16371ee4 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:49.715993 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1092/2195] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:00:49 2022] PUT /identity/v3/projects/0eeb3223eae54feaa62684e974e303f1/users/53ec37bb89744b32bbc047cc4ab0e6b6/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:00:49.726894 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234bba6-ea9c-4856-8ea3-676c180272c8 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:49.727179 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234bba6-ea9c-4856-8ea3-676c180272c8 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:49.727803 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234bba6-ea9c-4856-8ea3-676c180272c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:49.759854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-1234bba6-ea9c-4856-8ea3-676c180272c8 None None] MFA Rules not processed for user `53ec37bb89744b32bbc047cc4ab0e6b6`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:49.762106 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-1234bba6-ea9c-4856-8ea3-676c180272c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:49.918561 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1104/2196] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:49.931361 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4162f-3b82-4de1-8836-71dc16371ee4 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:49.933764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-29d4162f-3b82-4de1-8836-71dc16371ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:49.995074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4162f-3b82-4de1-8836-71dc16371ee4 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:49.998918 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f6940-69a5-46ef-b1ee-1c3aa2ef7024 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:49.999517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f6940-69a5-46ef-b1ee-1c3aa2ef7024 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:49.999814 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f6940-69a5-46ef-b1ee-1c3aa2ef7024 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:50.000074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f6940-69a5-46ef-b1ee-1c3aa2ef7024 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:50.008487 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f6940-69a5-46ef-b1ee-1c3aa2ef7024 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:50.009969 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f6940-69a5-46ef-b1ee-1c3aa2ef7024 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:50.018458 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1093/2197] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:00:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:00:50.515542 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:50.833075 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:51.901800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:52.102819 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:53.174633 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f80e08-e332-4d27-b86a-2e0bfce99ce5 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:53.175127 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f80e08-e332-4d27-b86a-2e0bfce99ce5 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:53.175205 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f80e08-e332-4d27-b86a-2e0bfce99ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:53.217974 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-c5f80e08-e332-4d27-b86a-2e0bfce99ce5 None None] MFA Rules not processed for user `d392c30328a3491bb186bd7b55f4d99c`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:53.219611 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-c5f80e08-e332-4d27-b86a-2e0bfce99ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:53.238917 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:53.282491 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1105/2198] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Aug 11 10:00:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:53.338029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f6940-69a5-46ef-b1ee-1c3aa2ef7024 service cinder] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:53.343885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-7a7f6940-69a5-46ef-b1ee-1c3aa2ef7024 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:53.462951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f6940-69a5-46ef-b1ee-1c3aa2ef7024 service cinder] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:53.472092 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad79555-c490-4f66-8f2e-228811d21f12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e3b1c5aec94673b391210ae51d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:53.474691 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad79555-c490-4f66-8f2e-228811d21f12 service swift] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:53.474825 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad79555-c490-4f66-8f2e-228811d21f12 service swift] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:53.475014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad79555-c490-4f66-8f2e-228811d21f12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:53.494278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad79555-c490-4f66-8f2e-228811d21f12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:53.497263 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad79555-c490-4f66-8f2e-228811d21f12 service swift] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:53.509987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1094/2199] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Aug 11 10:00:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 10:00:53.561075 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:55.127757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cfcd7-be5e-4ec2-8093-5ea318d0b081 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:55.128366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cfcd7-be5e-4ec2-8093-5ea318d0b081 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:55.128366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cfcd7-be5e-4ec2-8093-5ea318d0b081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:55.148193 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-8f8cfcd7-be5e-4ec2-8093-5ea318d0b081 None None] MFA Rules not processed for user `d392c30328a3491bb186bd7b55f4d99c`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:55.149386 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-8f8cfcd7-be5e-4ec2-8093-5ea318d0b081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:55.157611 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1106/2200] 10.222.0.13 () {58 vars in 967 bytes} [Thu Aug 11 10:00:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:00:55.174730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad79555-c490-4f66-8f2e-228811d21f12 service swift] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:55.189030 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad79555-c490-4f66-8f2e-228811d21f12 service swift] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:55.194537 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c880f0d-c313-4d44-aa70-16238c00ee0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e3b1c5aec94673b391210ae51d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:55.195556 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c880f0d-c313-4d44-aa70-16238c00ee0e service swift] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:55.195832 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c880f0d-c313-4d44-aa70-16238c00ee0e service swift] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:55.196513 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c880f0d-c313-4d44-aa70-16238c00ee0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:55.205527 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c880f0d-c313-4d44-aa70-16238c00ee0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:55.207931 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c880f0d-c313-4d44-aa70-16238c00ee0e service swift] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:55.217227 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1095/2201] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Aug 11 10:00:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 10:00:55.230064 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:55.459314 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:55.975235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2359f-4c39-463e-952b-28d6a4a4cf50 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:55.975540 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2359f-4c39-463e-952b-28d6a4a4cf50 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:55.975791 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2359f-4c39-463e-952b-28d6a4a4cf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:55.997054 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-c1a2359f-4c39-463e-952b-28d6a4a4cf50 None None] MFA Rules not processed for user `d392c30328a3491bb186bd7b55f4d99c`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:55.998474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-c1a2359f-4c39-463e-952b-28d6a4a4cf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:56.005737 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1107/2202] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Aug 11 10:00:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:56.018240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c880f0d-c313-4d44-aa70-16238c00ee0e service swift] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:56.028856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c880f0d-c313-4d44-aa70-16238c00ee0e service swift] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:56.033894 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369ea1b-e296-44ec-8fe8-cbb62a00b518 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e3b1c5aec94673b391210ae51d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:56.034516 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369ea1b-e296-44ec-8fe8-cbb62a00b518 service swift] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:56.034791 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369ea1b-e296-44ec-8fe8-cbb62a00b518 service swift] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:56.035609 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369ea1b-e296-44ec-8fe8-cbb62a00b518 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:56.044054 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369ea1b-e296-44ec-8fe8-cbb62a00b518 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:56.045660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369ea1b-e296-44ec-8fe8-cbb62a00b518 service swift] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:56.054209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1096/2203] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Aug 11 10:00:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 10:00:56.694701 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:56.804833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb5dfb-e675-4570-943a-081042504443 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:56.806770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb5dfb-e675-4570-943a-081042504443 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:56.806770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb5dfb-e675-4570-943a-081042504443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:56.824462 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-00fb5dfb-e675-4570-943a-081042504443 None None] MFA Rules not processed for user `d392c30328a3491bb186bd7b55f4d99c`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:56.825687 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-00fb5dfb-e675-4570-943a-081042504443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:56.832914 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1108/2204] 10.222.0.13 () {58 vars in 967 bytes} [Thu Aug 11 10:00:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:56.844930 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369ea1b-e296-44ec-8fe8-cbb62a00b518 service swift] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:56.856072 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369ea1b-e296-44ec-8fe8-cbb62a00b518 service swift] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:56.864178 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcfe2e-ac2a-4bc3-9d33-b22ffdd06edf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e3b1c5aec94673b391210ae51d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:56.864178 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcfe2e-ac2a-4bc3-9d33-b22ffdd06edf service swift] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:56.864178 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcfe2e-ac2a-4bc3-9d33-b22ffdd06edf service swift] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:56.864178 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcfe2e-ac2a-4bc3-9d33-b22ffdd06edf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:56.870949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcfe2e-ac2a-4bc3-9d33-b22ffdd06edf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:56.872515 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcfe2e-ac2a-4bc3-9d33-b22ffdd06edf service swift] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:00:56.880729 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1097/2205] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Aug 11 10:00:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 10:00:57.037548 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:57.719659 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:58.076670 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:58.754863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:59.243968 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c7098-1312-494b-bf2a-a1adc4336946 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:59.244250 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c7098-1312-494b-bf2a-a1adc4336946 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:59.244697 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c7098-1312-494b-bf2a-a1adc4336946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:59.264655 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-b10c7098-1312-494b-bf2a-a1adc4336946 None None] MFA Rules not processed for user `20bf487c5b8e490da15060ea798a83ca`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:00:59.269809 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-b10c7098-1312-494b-bf2a-a1adc4336946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:59.320905 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1109/2206] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:00:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:00:59.329589 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:00:59.882015 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcfe2e-ac2a-4bc3-9d33-b22ffdd06edf service swift] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:00:59.883619 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-3ebcfe2e-ac2a-4bc3-9d33-b22ffdd06edf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:00:59.949891 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcfe2e-ac2a-4bc3-9d33-b22ffdd06edf service swift] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:00:59.954458 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405f9fe-43d2-4078-85f8-9466b847bf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:00:59.955085 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405f9fe-43d2-4078-85f8-9466b847bf96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:00:59.955361 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405f9fe-43d2-4078-85f8-9466b847bf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:00:59.955638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405f9fe-43d2-4078-85f8-9466b847bf96 admin admin] PATH_INFO: `/v3/users/cad422bf8e2d488eab8c8ea0c1f1794d` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:00:59.957002 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405f9fe-43d2-4078-85f8-9466b847bf96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cad422bf8e2d488eab8c8ea0c1f1794d)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:00:59.958993 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405f9fe-43d2-4078-85f8-9466b847bf96 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:00.211993 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a405f9fe-43d2-4078-85f8-9466b847bf96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cad422bf8e2d488eab8c8ea0c1f1794d'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:00.221141 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:00.238109 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a405f9fe-43d2-4078-85f8-9466b847bf96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cad422bf8e2d488eab8c8ea0c1f1794d'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:00.238109 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a405f9fe-43d2-4078-85f8-9466b847bf96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cad422bf8e2d488eab8c8ea0c1f1794d'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:00.238109 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a405f9fe-43d2-4078-85f8-9466b847bf96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cad422bf8e2d488eab8c8ea0c1f1794d'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:00.322708 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a405f9fe-43d2-4078-85f8-9466b847bf96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cad422bf8e2d488eab8c8ea0c1f1794d'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:00.329512 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1098/2207] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:00:59 2022] DELETE /identity/v3/users/cad422bf8e2d488eab8c8ea0c1f1794d => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:01:00.334574 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79727de5-cea5-4af1-968b-610911a091a2 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:00.344659 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79727de5-cea5-4af1-968b-610911a091a2 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:00.344659 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79727de5-cea5-4af1-968b-610911a091a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:00.355112 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-79727de5-cea5-4af1-968b-610911a091a2 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:00.356314 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-79727de5-cea5-4af1-968b-610911a091a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:00.417239 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1110/2208] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:00.432678 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405f9fe-43d2-4078-85f8-9466b847bf96 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:00.434334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-a405f9fe-43d2-4078-85f8-9466b847bf96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:00.504407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405f9fe-43d2-4078-85f8-9466b847bf96 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:00.507934 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407b396-8660-4cbf-9a7d-f95f6f10b6c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:00.508696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407b396-8660-4cbf-9a7d-f95f6f10b6c7 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:00.508974 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407b396-8660-4cbf-9a7d-f95f6f10b6c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:00.509243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407b396-8660-4cbf-9a7d-f95f6f10b6c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:00.517914 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407b396-8660-4cbf-9a7d-f95f6f10b6c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:00.520058 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407b396-8660-4cbf-9a7d-f95f6f10b6c7 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:00.529492 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1099/2209] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:01:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:01:00.530805 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:00.872788 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79727de5-cea5-4af1-968b-610911a091a2 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:00.874234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-79727de5-cea5-4af1-968b-610911a091a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:00.887177 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79727de5-cea5-4af1-968b-610911a091a2 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:00.891996 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e2132-2bf8-4daf-8a87-050abc3b55cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:00.892669 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e2132-2bf8-4daf-8a87-050abc3b55cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:00.892952 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e2132-2bf8-4daf-8a87-050abc3b55cc admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:00.898062 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e2132-2bf8-4daf-8a87-050abc3b55cc admin admin] PATH_INFO: `/v3/projects/5c1447caa3f34de7985f38f6a0254df6` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:00.898062 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e2132-2bf8-4daf-8a87-050abc3b55cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c1447caa3f34de7985f38f6a0254df6)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:00.898062 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e2132-2bf8-4daf-8a87-050abc3b55cc admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:01.092844 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f73e2132-2bf8-4daf-8a87-050abc3b55cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c1447caa3f34de7985f38f6a0254df6', 'request_id': 'req-f73e2132-2bf8-4daf-8a87-050abc3b55cc'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:01.098861 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f73e2132-2bf8-4daf-8a87-050abc3b55cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c1447caa3f34de7985f38f6a0254df6', 'request_id': 'req-f73e2132-2bf8-4daf-8a87-050abc3b55cc'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:01.194350 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f73e2132-2bf8-4daf-8a87-050abc3b55cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c1447caa3f34de7985f38f6a0254df6', 'request_id': 'req-f73e2132-2bf8-4daf-8a87-050abc3b55cc'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:01.208926 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f73e2132-2bf8-4daf-8a87-050abc3b55cc admin admin] The token cache is being invalidate because project 5c1447caa3f34de7985f38f6a0254df6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:01:01.209213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f73e2132-2bf8-4daf-8a87-050abc3b55cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:01.210001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f73e2132-2bf8-4daf-8a87-050abc3b55cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:01.211769 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1111/2210] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:01:00 2022] DELETE /identity/v3/projects/5c1447caa3f34de7985f38f6a0254df6 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:01:01.483111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:01.686287 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:01.781435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407b396-8660-4cbf-9a7d-f95f6f10b6c7 service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:01.783125 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-e407b396-8660-4cbf-9a7d-f95f6f10b6c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:01.796668 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407b396-8660-4cbf-9a7d-f95f6f10b6c7 service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:01.856748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafbc17-0c0a-43e3-a5b1-3fbb3c91c07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:01.856748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafbc17-0c0a-43e3-a5b1-3fbb3c91c07c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:01.856748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafbc17-0c0a-43e3-a5b1-3fbb3c91c07c admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:01.856748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafbc17-0c0a-43e3-a5b1-3fbb3c91c07c admin admin] PATH_INFO: `/v3/users/157aac0270684589997f7f8db870997f` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:01.857175 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafbc17-0c0a-43e3-a5b1-3fbb3c91c07c admin admin] RBAC: Authorizing `identity:delete_user(user_id=157aac0270684589997f7f8db870997f)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:01.858556 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafbc17-0c0a-43e3-a5b1-3fbb3c91c07c admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:02.061785 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:02.075054 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-6aafbc17-0c0a-43e3-a5b1-3fbb3c91c07c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '157aac0270684589997f7f8db870997f'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:02.087568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-6aafbc17-0c0a-43e3-a5b1-3fbb3c91c07c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '157aac0270684589997f7f8db870997f'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:02.088235 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-6aafbc17-0c0a-43e3-a5b1-3fbb3c91c07c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '157aac0270684589997f7f8db870997f'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:02.094949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-6aafbc17-0c0a-43e3-a5b1-3fbb3c91c07c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '157aac0270684589997f7f8db870997f'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:02.162389 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-6aafbc17-0c0a-43e3-a5b1-3fbb3c91c07c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '157aac0270684589997f7f8db870997f'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:02.168679 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1100/2211] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:01:01 2022] DELETE /identity/v3/users/157aac0270684589997f7f8db870997f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:01:02.173372 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e94f38-056d-4236-864d-05bf6ec0c491 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:02.173929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e94f38-056d-4236-864d-05bf6ec0c491 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:02.174403 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e94f38-056d-4236-864d-05bf6ec0c491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:02.183049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:02.195236 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-64e94f38-056d-4236-864d-05bf6ec0c491 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:02.196446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-64e94f38-056d-4236-864d-05bf6ec0c491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:02.255363 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1112/2212] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:02.266044 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafbc17-0c0a-43e3-a5b1-3fbb3c91c07c admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:02.267829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-6aafbc17-0c0a-43e3-a5b1-3fbb3c91c07c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:02.337666 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafbc17-0c0a-43e3-a5b1-3fbb3c91c07c admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:02.341179 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becfe06-a0cf-4bda-bd80-41c07a294a09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:02.341791 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becfe06-a0cf-4bda-bd80-41c07a294a09 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:02.342063 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becfe06-a0cf-4bda-bd80-41c07a294a09 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:02.342355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becfe06-a0cf-4bda-bd80-41c07a294a09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:02.351389 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becfe06-a0cf-4bda-bd80-41c07a294a09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:02.352806 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becfe06-a0cf-4bda-bd80-41c07a294a09 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:02.362392 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1101/2213] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:01:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:01:02.831476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:02.924463 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e94f38-056d-4236-864d-05bf6ec0c491 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:02.926750 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-64e94f38-056d-4236-864d-05bf6ec0c491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:02.939823 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e94f38-056d-4236-864d-05bf6ec0c491 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:02.945364 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179814d-372c-469c-9d5d-4d266373828f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:02.948022 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179814d-372c-469c-9d5d-4d266373828f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:02.948022 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179814d-372c-469c-9d5d-4d266373828f admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:02.948022 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179814d-372c-469c-9d5d-4d266373828f admin admin] PATH_INFO: `/v3/projects/fb49697364684e5db06c31e637d82e13` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:02.949087 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179814d-372c-469c-9d5d-4d266373828f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb49697364684e5db06c31e637d82e13)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:02.951038 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179814d-372c-469c-9d5d-4d266373828f admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:03.120423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-5179814d-372c-469c-9d5d-4d266373828f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb49697364684e5db06c31e637d82e13', 'request_id': 'req-5179814d-372c-469c-9d5d-4d266373828f'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:03.130616 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-5179814d-372c-469c-9d5d-4d266373828f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb49697364684e5db06c31e637d82e13', 'request_id': 'req-5179814d-372c-469c-9d5d-4d266373828f'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:03.224106 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-5179814d-372c-469c-9d5d-4d266373828f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb49697364684e5db06c31e637d82e13', 'request_id': 'req-5179814d-372c-469c-9d5d-4d266373828f'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:03.238741 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-5179814d-372c-469c-9d5d-4d266373828f admin admin] The token cache is being invalidate because project fb49697364684e5db06c31e637d82e13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:01:03.239244 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-5179814d-372c-469c-9d5d-4d266373828f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:03.239976 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-5179814d-372c-469c-9d5d-4d266373828f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:03.241591 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1113/2214] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:01:02 2022] DELETE /identity/v3/projects/fb49697364684e5db06c31e637d82e13 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:01:03.246473 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8c02a-8197-4e8e-ba35-a24ee7e79329 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:03.246760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8c02a-8197-4e8e-ba35-a24ee7e79329 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:03.247205 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8c02a-8197-4e8e-ba35-a24ee7e79329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:03.268331 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-7da8c02a-8197-4e8e-ba35-a24ee7e79329 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:03.270466 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-7da8c02a-8197-4e8e-ba35-a24ee7e79329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:03.366430 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1102/2215] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:01:03.368189 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856ac9e-9793-4db8-9c9a-9723b56a1150 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:03.368483 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856ac9e-9793-4db8-9c9a-9723b56a1150 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:03.368746 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856ac9e-9793-4db8-9c9a-9723b56a1150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:03.390327 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-e856ac9e-9793-4db8-9c9a-9723b56a1150 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:03.391652 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-e856ac9e-9793-4db8-9c9a-9723b56a1150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:03.400401 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1114/2216] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:03.404677 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8c02a-8197-4e8e-ba35-a24ee7e79329 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:03.414713 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8c02a-8197-4e8e-ba35-a24ee7e79329 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:03.419690 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c8066-519b-431b-8f1a-5dc1ec0d7e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:03.420287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c8066-519b-431b-8f1a-5dc1ec0d7e7b admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:03.420565 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c8066-519b-431b-8f1a-5dc1ec0d7e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:03.420837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c8066-519b-431b-8f1a-5dc1ec0d7e7b admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:03.421482 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c8066-519b-431b-8f1a-5dc1ec0d7e7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:01:03.421780 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c8066-519b-431b-8f1a-5dc1ec0d7e7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:03.423449 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c8066-519b-431b-8f1a-5dc1ec0d7e7b admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:03.435247 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1103/2217] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:01:03.439767 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856ac9e-9793-4db8-9c9a-9723b56a1150 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:03.449846 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856ac9e-9793-4db8-9c9a-9723b56a1150 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:03.454666 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4eb266-0030-4c61-8816-71511ed13df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:03.455274 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4eb266-0030-4c61-8816-71511ed13df1 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:03.455546 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4eb266-0030-4c61-8816-71511ed13df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:03.455815 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4eb266-0030-4c61-8816-71511ed13df1 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:03.458222 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4eb266-0030-4c61-8816-71511ed13df1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:03.460151 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4eb266-0030-4c61-8816-71511ed13df1 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:03.565146 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1115/2218] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:01:03 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:01:03.567163 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c8066-519b-431b-8f1a-5dc1ec0d7e7b admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:03.582391 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c8066-519b-431b-8f1a-5dc1ec0d7e7b admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:03.656236 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77046fe9-0c18-48a8-b177-96931e7c2e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:03.656860 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77046fe9-0c18-48a8-b177-96931e7c2e5b admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:03.657140 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77046fe9-0c18-48a8-b177-96931e7c2e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:03.657443 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77046fe9-0c18-48a8-b177-96931e7c2e5b admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:03.658403 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77046fe9-0c18-48a8-b177-96931e7c2e5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:03.660384 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77046fe9-0c18-48a8-b177-96931e7c2e5b admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:03.781135 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1104/2219] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:01:03 2022] POST /identity/v3/users => generated 288 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:01:03.782074 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4eb266-0030-4c61-8816-71511ed13df1 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:03.795750 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4eb266-0030-4c61-8816-71511ed13df1 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:03.803372 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609de89-caeb-42c2-b200-b0f4537df665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:03.804116 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609de89-caeb-42c2-b200-b0f4537df665 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:03.804448 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609de89-caeb-42c2-b200-b0f4537df665 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:03.804771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609de89-caeb-42c2-b200-b0f4537df665 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:03.805488 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609de89-caeb-42c2-b200-b0f4537df665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:03.807433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609de89-caeb-42c2-b200-b0f4537df665 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:03.819597 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1116/2220] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:01:03.823815 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77046fe9-0c18-48a8-b177-96931e7c2e5b admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:03.838343 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77046fe9-0c18-48a8-b177-96931e7c2e5b admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:03.844044 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84169f-dc0d-450f-86c9-7f885e806179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:03.844965 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84169f-dc0d-450f-86c9-7f885e806179 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:03.845937 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84169f-dc0d-450f-86c9-7f885e806179 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:03.846310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84169f-dc0d-450f-86c9-7f885e806179 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:03.847467 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84169f-dc0d-450f-86c9-7f885e806179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:03.850211 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84169f-dc0d-450f-86c9-7f885e806179 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:03.863737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1105/2221] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:01:03.868152 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609de89-caeb-42c2-b200-b0f4537df665 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:03.880052 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609de89-caeb-42c2-b200-b0f4537df665 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:03.885108 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698536bc-d38a-49a0-bc3b-ca719121cb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:03.885772 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698536bc-d38a-49a0-bc3b-ca719121cb0f admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:03.886166 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698536bc-d38a-49a0-bc3b-ca719121cb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:03.888848 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698536bc-d38a-49a0-bc3b-ca719121cb0f admin admin] PATH_INFO: `/v3/projects/2124ee054d82404b86eca20e03170bee/users/79bdfb035311411a87b9c2f01435ba6d/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:03.903143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698536bc-d38a-49a0-bc3b-ca719121cb0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2124ee054d82404b86eca20e03170bee, user_id=79bdfb035311411a87b9c2f01435ba6d, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:03.905846 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698536bc-d38a-49a0-bc3b-ca719121cb0f admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:04.034490 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1117/2222] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:01:03 2022] PUT /identity/v3/projects/2124ee054d82404b86eca20e03170bee/users/79bdfb035311411a87b9c2f01435ba6d/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:01:04.043066 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f3582-e123-41b7-ad53-f8c47e56885c None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:04.043347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f3582-e123-41b7-ad53-f8c47e56885c None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:04.043617 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f3582-e123-41b7-ad53-f8c47e56885c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:04.072460 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-af0f3582-e123-41b7-ad53-f8c47e56885c None None] MFA Rules not processed for user `79bdfb035311411a87b9c2f01435ba6d`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:04.073672 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-af0f3582-e123-41b7-ad53-f8c47e56885c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:04.139119 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1106/2223] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:04.150288 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698536bc-d38a-49a0-bc3b-ca719121cb0f admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:04.151992 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-698536bc-d38a-49a0-bc3b-ca719121cb0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:04.166286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:04.180333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:04.211137 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698536bc-d38a-49a0-bc3b-ca719121cb0f admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:04.215232 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea075fbe-d7b5-4d1e-b726-d6c83d42b934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:04.215848 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea075fbe-d7b5-4d1e-b726-d6c83d42b934 service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:04.222477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea075fbe-d7b5-4d1e-b726-d6c83d42b934 service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:04.222477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea075fbe-d7b5-4d1e-b726-d6c83d42b934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:04.225340 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea075fbe-d7b5-4d1e-b726-d6c83d42b934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:04.226818 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea075fbe-d7b5-4d1e-b726-d6c83d42b934 service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:04.235519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1118/2224] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:01:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:01:05.140454 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:06.126185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:07.632635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71e3f7-4c2a-4597-911e-0b3cd9681908 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:07.633217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71e3f7-4c2a-4597-911e-0b3cd9681908 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:07.633217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71e3f7-4c2a-4597-911e-0b3cd9681908 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:07.634594 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1107/2225] 10.222.0.13 () {54 vars in 921 bytes} [Thu Aug 11 10:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:01:07.669850 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caab097-8d31-4b92-90ef-4045ed2e0ab1 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:07.670377 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caab097-8d31-4b92-90ef-4045ed2e0ab1 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:07.670581 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caab097-8d31-4b92-90ef-4045ed2e0ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:07.707062 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-0caab097-8d31-4b92-90ef-4045ed2e0ab1 None None] MFA Rules not processed for user `0061ce46df224f4491599ed10548b2ae`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:07.707062 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-0caab097-8d31-4b92-90ef-4045ed2e0ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:07.789320 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1119/2226] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Aug 11 10:01:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:07.802272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71e3f7-4c2a-4597-911e-0b3cd9681908 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:07.804228 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-aa71e3f7-4c2a-4597-911e-0b3cd9681908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:07.811924 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caab097-8d31-4b92-90ef-4045ed2e0ab1 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:07.813797 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-0caab097-8d31-4b92-90ef-4045ed2e0ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:07.833501 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caab097-8d31-4b92-90ef-4045ed2e0ab1 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:07.840690 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d6090-a83d-42b5-b8ce-242701ab4419 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0061ce46df224f4491599ed10548b2ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:07.841704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d6090-a83d-42b5-b8ce-242701ab4419 service placement] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:07.842278 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d6090-a83d-42b5-b8ce-242701ab4419 service placement] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:07.843561 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d6090-a83d-42b5-b8ce-242701ab4419 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:07.859745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d6090-a83d-42b5-b8ce-242701ab4419 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:07.861349 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d6090-a83d-42b5-b8ce-242701ab4419 service placement] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:07.876875 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1120/2227] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:01:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:01:07.902820 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:07.939788 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71e3f7-4c2a-4597-911e-0b3cd9681908 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:07.945515 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a696fd-ba7c-4ee8-b525-1f1802b3f4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:07.946395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a696fd-ba7c-4ee8-b525-1f1802b3f4d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:07.947447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a696fd-ba7c-4ee8-b525-1f1802b3f4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:07.948141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a696fd-ba7c-4ee8-b525-1f1802b3f4d3 admin admin] PATH_INFO: `/v3/users/ad1378dc8de24356ac591e49759f3b75` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:07.949841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a696fd-ba7c-4ee8-b525-1f1802b3f4d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad1378dc8de24356ac591e49759f3b75)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:07.952083 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a696fd-ba7c-4ee8-b525-1f1802b3f4d3 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:08.216963 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-05a696fd-ba7c-4ee8-b525-1f1802b3f4d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad1378dc8de24356ac591e49759f3b75'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:08.229620 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-05a696fd-ba7c-4ee8-b525-1f1802b3f4d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad1378dc8de24356ac591e49759f3b75'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:08.230358 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-05a696fd-ba7c-4ee8-b525-1f1802b3f4d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad1378dc8de24356ac591e49759f3b75'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:08.237348 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-05a696fd-ba7c-4ee8-b525-1f1802b3f4d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad1378dc8de24356ac591e49759f3b75'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:08.316857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-05a696fd-ba7c-4ee8-b525-1f1802b3f4d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad1378dc8de24356ac591e49759f3b75'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:08.323237 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1108/2228] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:01:07 2022] DELETE /identity/v3/users/ad1378dc8de24356ac591e49759f3b75 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:01:08.576315 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d6090-a83d-42b5-b8ce-242701ab4419 service placement] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:08.591702 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d6090-a83d-42b5-b8ce-242701ab4419 service placement] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:08.715805 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba1be6-6a2b-41ac-aa45-dff3c4ff7d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:08.716419 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba1be6-6a2b-41ac-aa45-dff3c4ff7d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:08.716695 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba1be6-6a2b-41ac-aa45-dff3c4ff7d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:08.716964 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba1be6-6a2b-41ac-aa45-dff3c4ff7d04 admin admin] PATH_INFO: `/v3/projects/5bae0bece8044690ac87610fe730bb95` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:08.718071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba1be6-6a2b-41ac-aa45-dff3c4ff7d04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bae0bece8044690ac87610fe730bb95)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:08.719999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba1be6-6a2b-41ac-aa45-dff3c4ff7d04 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:08.878864 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-32ba1be6-6a2b-41ac-aa45-dff3c4ff7d04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bae0bece8044690ac87610fe730bb95', 'request_id': 'req-32ba1be6-6a2b-41ac-aa45-dff3c4ff7d04'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:08.880205 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:08.885851 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-32ba1be6-6a2b-41ac-aa45-dff3c4ff7d04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bae0bece8044690ac87610fe730bb95', 'request_id': 'req-32ba1be6-6a2b-41ac-aa45-dff3c4ff7d04'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:09.013235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-32ba1be6-6a2b-41ac-aa45-dff3c4ff7d04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bae0bece8044690ac87610fe730bb95', 'request_id': 'req-32ba1be6-6a2b-41ac-aa45-dff3c4ff7d04'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:09.024991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-32ba1be6-6a2b-41ac-aa45-dff3c4ff7d04 admin admin] The token cache is being invalidate because project 5bae0bece8044690ac87610fe730bb95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:01:09.025344 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-32ba1be6-6a2b-41ac-aa45-dff3c4ff7d04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:09.026022 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-32ba1be6-6a2b-41ac-aa45-dff3c4ff7d04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:09.027710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1121/2229] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:01:08 2022] DELETE /identity/v3/projects/5bae0bece8044690ac87610fe730bb95 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:01:09.031639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a696fd-ba7c-4ee8-b525-1f1802b3f4d3 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:09.033050 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-05a696fd-ba7c-4ee8-b525-1f1802b3f4d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:09.052501 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a696fd-ba7c-4ee8-b525-1f1802b3f4d3 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:09.129175 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec14f3b-aca1-4361-88ff-f671241b456d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:09.129818 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec14f3b-aca1-4361-88ff-f671241b456d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:09.130264 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec14f3b-aca1-4361-88ff-f671241b456d admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:09.130540 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec14f3b-aca1-4361-88ff-f671241b456d admin admin] PATH_INFO: `/v3/users/f8b03f5aaa1c4463adc55bb55d5a10eb` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:09.131682 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec14f3b-aca1-4361-88ff-f671241b456d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8b03f5aaa1c4463adc55bb55d5a10eb)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:09.133766 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec14f3b-aca1-4361-88ff-f671241b456d admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:09.290273 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-bec14f3b-aca1-4361-88ff-f671241b456d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8b03f5aaa1c4463adc55bb55d5a10eb'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:09.303085 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-bec14f3b-aca1-4361-88ff-f671241b456d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8b03f5aaa1c4463adc55bb55d5a10eb'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:09.303797 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-bec14f3b-aca1-4361-88ff-f671241b456d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8b03f5aaa1c4463adc55bb55d5a10eb'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:09.308114 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:09.312560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-bec14f3b-aca1-4361-88ff-f671241b456d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8b03f5aaa1c4463adc55bb55d5a10eb'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:09.396141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-bec14f3b-aca1-4361-88ff-f671241b456d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8b03f5aaa1c4463adc55bb55d5a10eb'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:09.402716 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1109/2230] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:01:09 2022] DELETE /identity/v3/users/f8b03f5aaa1c4463adc55bb55d5a10eb => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:01:09.634052 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba1be6-6a2b-41ac-aa45-dff3c4ff7d04 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:09.636151 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-32ba1be6-6a2b-41ac-aa45-dff3c4ff7d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:09.656472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba1be6-6a2b-41ac-aa45-dff3c4ff7d04 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:09.721837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d28f6d-3a94-4002-8ff8-43dbd5868491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:09.722791 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d28f6d-3a94-4002-8ff8-43dbd5868491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:09.723174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d28f6d-3a94-4002-8ff8-43dbd5868491 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:09.723571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d28f6d-3a94-4002-8ff8-43dbd5868491 admin admin] PATH_INFO: `/v3/projects/7d5d8ffe92084b4d9a808cb6c19949fc` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:09.725042 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d28f6d-3a94-4002-8ff8-43dbd5868491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d5d8ffe92084b4d9a808cb6c19949fc)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:09.727159 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d28f6d-3a94-4002-8ff8-43dbd5868491 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:09.842996 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-d9d28f6d-3a94-4002-8ff8-43dbd5868491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d5d8ffe92084b4d9a808cb6c19949fc', 'request_id': 'req-d9d28f6d-3a94-4002-8ff8-43dbd5868491'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:09.848704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-d9d28f6d-3a94-4002-8ff8-43dbd5868491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d5d8ffe92084b4d9a808cb6c19949fc', 'request_id': 'req-d9d28f6d-3a94-4002-8ff8-43dbd5868491'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:09.951010 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-d9d28f6d-3a94-4002-8ff8-43dbd5868491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d5d8ffe92084b4d9a808cb6c19949fc', 'request_id': 'req-d9d28f6d-3a94-4002-8ff8-43dbd5868491'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:09.964810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-d9d28f6d-3a94-4002-8ff8-43dbd5868491 admin admin] The token cache is being invalidate because project 7d5d8ffe92084b4d9a808cb6c19949fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:01:09.965154 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-d9d28f6d-3a94-4002-8ff8-43dbd5868491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:09.965872 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-d9d28f6d-3a94-4002-8ff8-43dbd5868491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:09.967377 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1122/2231] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:01:09 2022] DELETE /identity/v3/projects/7d5d8ffe92084b4d9a808cb6c19949fc => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:01:09.972324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52c41d-e291-47a3-bdd7-7c5042229c4b None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:09.972888 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52c41d-e291-47a3-bdd7-7c5042229c4b None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:09.973585 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52c41d-e291-47a3-bdd7-7c5042229c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:09.996614 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-3b52c41d-e291-47a3-bdd7-7c5042229c4b None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:09.997834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-3b52c41d-e291-47a3-bdd7-7c5042229c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:10.067907 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1110/2232] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:10.075455 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bc2e2-c69d-42ff-b4cc-1cb4dbf73180 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:10.075780 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bc2e2-c69d-42ff-b4cc-1cb4dbf73180 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:10.076015 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bc2e2-c69d-42ff-b4cc-1cb4dbf73180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:10.098856 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-3c0bc2e2-c69d-42ff-b4cc-1cb4dbf73180 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:10.100078 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-3c0bc2e2-c69d-42ff-b4cc-1cb4dbf73180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:10.108067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1123/2233] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:10.112821 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52c41d-e291-47a3-bdd7-7c5042229c4b None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:10.122296 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52c41d-e291-47a3-bdd7-7c5042229c4b None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:10.127014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125926b-3c68-41cc-96da-fb2f7b984552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:10.127584 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125926b-3c68-41cc-96da-fb2f7b984552 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:10.128480 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125926b-3c68-41cc-96da-fb2f7b984552 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:10.128748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125926b-3c68-41cc-96da-fb2f7b984552 admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:10.129388 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125926b-3c68-41cc-96da-fb2f7b984552 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:01:10.129685 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125926b-3c68-41cc-96da-fb2f7b984552 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:10.131318 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125926b-3c68-41cc-96da-fb2f7b984552 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:10.147517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1111/2234] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:01:10.150899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bc2e2-c69d-42ff-b4cc-1cb4dbf73180 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:10.160701 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bc2e2-c69d-42ff-b4cc-1cb4dbf73180 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:10.165762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e9ca6-cc18-41d3-9ac1-ca6c44012b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:10.166301 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e9ca6-cc18-41d3-9ac1-ca6c44012b79 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:10.166652 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e9ca6-cc18-41d3-9ac1-ca6c44012b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:10.166832 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e9ca6-cc18-41d3-9ac1-ca6c44012b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:10.167515 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e9ca6-cc18-41d3-9ac1-ca6c44012b79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:10.169519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e9ca6-cc18-41d3-9ac1-ca6c44012b79 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:10.270122 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1124/2235] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:01:10 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:01:10.271861 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125926b-3c68-41cc-96da-fb2f7b984552 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:10.290172 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125926b-3c68-41cc-96da-fb2f7b984552 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:10.386113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7554f6-757f-4dc1-81aa-b2545380c47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:10.386854 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7554f6-757f-4dc1-81aa-b2545380c47a admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:10.387156 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7554f6-757f-4dc1-81aa-b2545380c47a admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:10.387430 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7554f6-757f-4dc1-81aa-b2545380c47a admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:10.388196 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7554f6-757f-4dc1-81aa-b2545380c47a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:10.390272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7554f6-757f-4dc1-81aa-b2545380c47a admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:10.477081 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1112/2236] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:01:10 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:01:10.478007 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e9ca6-cc18-41d3-9ac1-ca6c44012b79 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:10.503140 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e9ca6-cc18-41d3-9ac1-ca6c44012b79 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:10.531046 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbb517-ff54-47e6-9fbe-39af5af85f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:10.532108 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbb517-ff54-47e6-9fbe-39af5af85f7f admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:10.532390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbb517-ff54-47e6-9fbe-39af5af85f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:10.534799 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbb517-ff54-47e6-9fbe-39af5af85f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:10.535513 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbb517-ff54-47e6-9fbe-39af5af85f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:10.538826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbb517-ff54-47e6-9fbe-39af5af85f7f admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:10.565387 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1125/2237] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:01:10.570739 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7554f6-757f-4dc1-81aa-b2545380c47a admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:10.581588 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7554f6-757f-4dc1-81aa-b2545380c47a admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:10.586683 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1a81e-8376-4255-bf7c-f46c69e84363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:10.587200 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1a81e-8376-4255-bf7c-f46c69e84363 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:10.587472 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1a81e-8376-4255-bf7c-f46c69e84363 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:10.587741 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1a81e-8376-4255-bf7c-f46c69e84363 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:10.588376 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1a81e-8376-4255-bf7c-f46c69e84363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:10.590437 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1a81e-8376-4255-bf7c-f46c69e84363 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:10.623023 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1113/2238] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:01:10.629439 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbb517-ff54-47e6-9fbe-39af5af85f7f admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:10.653785 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbb517-ff54-47e6-9fbe-39af5af85f7f admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:10.668292 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b00593-0614-4587-9efe-4c1c62156ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:10.668987 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b00593-0614-4587-9efe-4c1c62156ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:10.669263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b00593-0614-4587-9efe-4c1c62156ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:10.669556 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b00593-0614-4587-9efe-4c1c62156ddc admin admin] PATH_INFO: `/v3/projects/8e454e0c1e3a405ba27286c490a77c7c/users/e4e0ad102e9a405281f76e28fd2a893e/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:10.719110 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b00593-0614-4587-9efe-4c1c62156ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e454e0c1e3a405ba27286c490a77c7c, user_id=e4e0ad102e9a405281f76e28fd2a893e, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:10.722818 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b00593-0614-4587-9efe-4c1c62156ddc admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:10.831328 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1126/2239] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:01:10 2022] PUT /identity/v3/projects/8e454e0c1e3a405ba27286c490a77c7c/users/e4e0ad102e9a405281f76e28fd2a893e/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:01:10.841669 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f22b85-697d-4cf6-9ee4-ada2704a97d3 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:10.842061 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f22b85-697d-4cf6-9ee4-ada2704a97d3 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:10.842624 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f22b85-697d-4cf6-9ee4-ada2704a97d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:10.872157 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-c2f22b85-697d-4cf6-9ee4-ada2704a97d3 None None] MFA Rules not processed for user `e4e0ad102e9a405281f76e28fd2a893e`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:10.873313 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-c2f22b85-697d-4cf6-9ee4-ada2704a97d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:10.926636 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:10.954777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1114/2240] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:10.966225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b00593-0614-4587-9efe-4c1c62156ddc admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:10.968024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-28b00593-0614-4587-9efe-4c1c62156ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:10.974563 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:11.028897 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b00593-0614-4587-9efe-4c1c62156ddc admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:11.034351 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef4f4e-5179-43f3-86fd-5b79fa40d5c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:11.035442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef4f4e-5179-43f3-86fd-5b79fa40d5c2 service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:11.035812 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef4f4e-5179-43f3-86fd-5b79fa40d5c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:11.036222 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef4f4e-5179-43f3-86fd-5b79fa40d5c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:11.045663 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef4f4e-5179-43f3-86fd-5b79fa40d5c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:11.048056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef4f4e-5179-43f3-86fd-5b79fa40d5c2 service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:11.058207 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1127/2241] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:01:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:01:15.135129 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f22b85-697d-4cf6-9ee4-ada2704a97d3 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:15.215674 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f22b85-697d-4cf6-9ee4-ada2704a97d3 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:15.221186 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c58e5-4944-4a0e-ab01-acacbfd4abc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:15.222457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c58e5-4944-4a0e-ab01-acacbfd4abc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:15.223383 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c58e5-4944-4a0e-ab01-acacbfd4abc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:15.223646 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c58e5-4944-4a0e-ab01-acacbfd4abc3 admin admin] PATH_INFO: `/v3/users/e4e0ad102e9a405281f76e28fd2a893e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:15.225620 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c58e5-4944-4a0e-ab01-acacbfd4abc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4e0ad102e9a405281f76e28fd2a893e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:15.227846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c58e5-4944-4a0e-ab01-acacbfd4abc3 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:15.422058 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-b25c58e5-4944-4a0e-ab01-acacbfd4abc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4e0ad102e9a405281f76e28fd2a893e'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:15.444961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-b25c58e5-4944-4a0e-ab01-acacbfd4abc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4e0ad102e9a405281f76e28fd2a893e'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:15.445697 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-b25c58e5-4944-4a0e-ab01-acacbfd4abc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4e0ad102e9a405281f76e28fd2a893e'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:15.453875 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-b25c58e5-4944-4a0e-ab01-acacbfd4abc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4e0ad102e9a405281f76e28fd2a893e'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:15.551394 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-b25c58e5-4944-4a0e-ab01-acacbfd4abc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4e0ad102e9a405281f76e28fd2a893e'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:15.558240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1115/2242] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:01:15 2022] DELETE /identity/v3/users/e4e0ad102e9a405281f76e28fd2a893e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:01:15.569324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0be17b-cef6-4ea5-bc19-6c524895f48e None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:15.569796 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0be17b-cef6-4ea5-bc19-6c524895f48e None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:15.569906 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0be17b-cef6-4ea5-bc19-6c524895f48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:15.590325 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-2c0be17b-cef6-4ea5-bc19-6c524895f48e None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:15.593989 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-2c0be17b-cef6-4ea5-bc19-6c524895f48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:15.663544 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1128/2243] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:15.674715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c58e5-4944-4a0e-ab01-acacbfd4abc3 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:15.676424 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-b25c58e5-4944-4a0e-ab01-acacbfd4abc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:15.734890 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c58e5-4944-4a0e-ab01-acacbfd4abc3 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:15.740519 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72573f-7f52-4358-b2c3-53e352e25b1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:15.741196 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72573f-7f52-4358-b2c3-53e352e25b1c service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:15.743838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72573f-7f52-4358-b2c3-53e352e25b1c service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:15.743838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72573f-7f52-4358-b2c3-53e352e25b1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:15.754869 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72573f-7f52-4358-b2c3-53e352e25b1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:15.756283 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72573f-7f52-4358-b2c3-53e352e25b1c service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:15.761426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:15.766432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1116/2244] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:01:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:01:16.184357 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0be17b-cef6-4ea5-bc19-6c524895f48e None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:16.185796 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-2c0be17b-cef6-4ea5-bc19-6c524895f48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:16.197632 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0be17b-cef6-4ea5-bc19-6c524895f48e None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:16.202356 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abc9a9-2030-4b1b-b65f-deb9e19078f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:16.203047 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abc9a9-2030-4b1b-b65f-deb9e19078f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:16.203327 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abc9a9-2030-4b1b-b65f-deb9e19078f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:16.203597 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abc9a9-2030-4b1b-b65f-deb9e19078f8 admin admin] PATH_INFO: `/v3/users/79bdfb035311411a87b9c2f01435ba6d` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:16.204770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4abc9a9-2030-4b1b-b65f-deb9e19078f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79bdfb035311411a87b9c2f01435ba6d)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:16.206828 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4abc9a9-2030-4b1b-b65f-deb9e19078f8 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:16.215089 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72573f-7f52-4358-b2c3-53e352e25b1c service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:16.216461 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-8f72573f-7f52-4358-b2c3-53e352e25b1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:16.231953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72573f-7f52-4358-b2c3-53e352e25b1c service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:16.236774 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a541552-914c-4025-8e59-dc4a6f852f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:16.237400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a541552-914c-4025-8e59-dc4a6f852f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:16.238061 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a541552-914c-4025-8e59-dc4a6f852f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:16.238386 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a541552-914c-4025-8e59-dc4a6f852f82 admin admin] PATH_INFO: `/v3/projects/8e454e0c1e3a405ba27286c490a77c7c` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:16.240339 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a541552-914c-4025-8e59-dc4a6f852f82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e454e0c1e3a405ba27286c490a77c7c)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:16.242482 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a541552-914c-4025-8e59-dc4a6f852f82 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:16.388576 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-1a541552-914c-4025-8e59-dc4a6f852f82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e454e0c1e3a405ba27286c490a77c7c', 'request_id': 'req-1a541552-914c-4025-8e59-dc4a6f852f82'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:16.390232 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e4abc9a9-2030-4b1b-b65f-deb9e19078f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79bdfb035311411a87b9c2f01435ba6d'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:16.395391 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-1a541552-914c-4025-8e59-dc4a6f852f82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e454e0c1e3a405ba27286c490a77c7c', 'request_id': 'req-1a541552-914c-4025-8e59-dc4a6f852f82'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:16.403882 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-1a541552-914c-4025-8e59-dc4a6f852f82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e454e0c1e3a405ba27286c490a77c7c', 'request_id': 'req-1a541552-914c-4025-8e59-dc4a6f852f82'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:16.407268 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e4abc9a9-2030-4b1b-b65f-deb9e19078f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79bdfb035311411a87b9c2f01435ba6d'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:16.408121 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e4abc9a9-2030-4b1b-b65f-deb9e19078f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79bdfb035311411a87b9c2f01435ba6d'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:16.409109 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e4abc9a9-2030-4b1b-b65f-deb9e19078f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79bdfb035311411a87b9c2f01435ba6d'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:16.417284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e4abc9a9-2030-4b1b-b65f-deb9e19078f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79bdfb035311411a87b9c2f01435ba6d'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:16.493662 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-1a541552-914c-4025-8e59-dc4a6f852f82 admin admin] The token cache is being invalidate because project 8e454e0c1e3a405ba27286c490a77c7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:01:16.493873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-1a541552-914c-4025-8e59-dc4a6f852f82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:16.494506 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-1a541552-914c-4025-8e59-dc4a6f852f82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:16.496014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1117/2245] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:01:16 2022] DELETE /identity/v3/projects/8e454e0c1e3a405ba27286c490a77c7c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:01:16.500798 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f39789-8e45-4a53-bbdc-5ab5aa12ab38 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:16.501154 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f39789-8e45-4a53-bbdc-5ab5aa12ab38 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:16.501422 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f39789-8e45-4a53-bbdc-5ab5aa12ab38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:16.520676 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-f7f39789-8e45-4a53-bbdc-5ab5aa12ab38 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:16.521942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-f7f39789-8e45-4a53-bbdc-5ab5aa12ab38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:16.585425 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1129/2246] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:01:16 2022] DELETE /identity/v3/users/79bdfb035311411a87b9c2f01435ba6d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:01:16.587595 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6b522-6ea1-4310-8491-dbf30bfb9e7b None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:16.588039 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6b522-6ea1-4310-8491-dbf30bfb9e7b None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:16.588320 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6b522-6ea1-4310-8491-dbf30bfb9e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:16.626683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-2cc6b522-6ea1-4310-8491-dbf30bfb9e7b None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:16.632003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-2cc6b522-6ea1-4310-8491-dbf30bfb9e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:16.643055 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1118/2247] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:01:16.653593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aba665-bd90-4dc5-bee9-8e0396ee33e4 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:16.657802 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aba665-bd90-4dc5-bee9-8e0396ee33e4 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:16.659266 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aba665-bd90-4dc5-bee9-8e0396ee33e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:16.661979 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:16.693327 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-70aba665-bd90-4dc5-bee9-8e0396ee33e4 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:16.694714 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-70aba665-bd90-4dc5-bee9-8e0396ee33e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:16.718531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1130/2248] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:16.729272 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6b522-6ea1-4310-8491-dbf30bfb9e7b None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:16.744981 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-2cc6b522-6ea1-4310-8491-dbf30bfb9e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:16.804773 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1119/2249] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:16.811114 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aba665-bd90-4dc5-bee9-8e0396ee33e4 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:16.821984 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aba665-bd90-4dc5-bee9-8e0396ee33e4 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:16.827928 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d443a-5fe7-403e-8f77-2749ba052aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:16.828531 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d443a-5fe7-403e-8f77-2749ba052aef admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:16.828802 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d443a-5fe7-403e-8f77-2749ba052aef admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:16.829148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d443a-5fe7-403e-8f77-2749ba052aef admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:16.829860 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d443a-5fe7-403e-8f77-2749ba052aef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:01:16.830192 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d443a-5fe7-403e-8f77-2749ba052aef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:16.831778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d443a-5fe7-403e-8f77-2749ba052aef admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:16.834530 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6b522-6ea1-4310-8491-dbf30bfb9e7b None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:16.838749 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb3cfb-50a7-49f7-a97a-c8eaf7dcea9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:16.839434 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb3cfb-50a7-49f7-a97a-c8eaf7dcea9f service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:16.839867 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb3cfb-50a7-49f7-a97a-c8eaf7dcea9f service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:16.840144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb3cfb-50a7-49f7-a97a-c8eaf7dcea9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:16.846246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1120/2250] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:01:16.851003 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d443a-5fe7-403e-8f77-2749ba052aef admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:16.853562 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb3cfb-50a7-49f7-a97a-c8eaf7dcea9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:16.855120 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb3cfb-50a7-49f7-a97a-c8eaf7dcea9f service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:16.861097 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d443a-5fe7-403e-8f77-2749ba052aef admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:16.866225 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226a726-eb5a-438e-a376-d75e88aa34a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:16.866420 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1131/2251] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:01:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:01:16.866524 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226a726-eb5a-438e-a376-d75e88aa34a4 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:16.866748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226a726-eb5a-438e-a376-d75e88aa34a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:16.867014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226a726-eb5a-438e-a376-d75e88aa34a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:16.867703 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226a726-eb5a-438e-a376-d75e88aa34a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:16.869907 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226a726-eb5a-438e-a376-d75e88aa34a4 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:16.885848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:16.985201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1121/2252] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:01:16 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:01:16.986329 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb3cfb-50a7-49f7-a97a-c8eaf7dcea9f service neutron] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:16.997840 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb3cfb-50a7-49f7-a97a-c8eaf7dcea9f service neutron] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:17.066218 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cca4a-2eaf-4875-9d13-39725463caca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:17.067558 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cca4a-2eaf-4875-9d13-39725463caca admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:17.067834 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cca4a-2eaf-4875-9d13-39725463caca admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:17.068098 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cca4a-2eaf-4875-9d13-39725463caca admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:17.068908 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04cca4a-2eaf-4875-9d13-39725463caca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:17.070908 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04cca4a-2eaf-4875-9d13-39725463caca admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:17.185608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1132/2253] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:01:16 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:01:17.188772 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226a726-eb5a-438e-a376-d75e88aa34a4 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:17.200811 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226a726-eb5a-438e-a376-d75e88aa34a4 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:17.205868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ec348-98c6-4743-b29a-2f4da0960b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:17.207016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ec348-98c6-4743-b29a-2f4da0960b70 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:17.207318 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ec348-98c6-4743-b29a-2f4da0960b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:17.208271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ec348-98c6-4743-b29a-2f4da0960b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:17.208945 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ec348-98c6-4743-b29a-2f4da0960b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:17.211134 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ec348-98c6-4743-b29a-2f4da0960b70 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:17.227528 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1122/2254] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:01:17.228812 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cca4a-2eaf-4875-9d13-39725463caca admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:17.240787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cca4a-2eaf-4875-9d13-39725463caca admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:17.246186 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6411a66-313b-4ffb-a9b6-6cb905fd91ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:17.246878 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6411a66-313b-4ffb-a9b6-6cb905fd91ff admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:17.247187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6411a66-313b-4ffb-a9b6-6cb905fd91ff admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:17.247559 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6411a66-313b-4ffb-a9b6-6cb905fd91ff admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:17.248350 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6411a66-313b-4ffb-a9b6-6cb905fd91ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:17.250340 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6411a66-313b-4ffb-a9b6-6cb905fd91ff admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:17.267310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ec348-98c6-4743-b29a-2f4da0960b70 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:17.267771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1133/2255] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:01:17.279331 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ec348-98c6-4743-b29a-2f4da0960b70 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:17.284771 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635fa68-3267-4021-a552-e564cba0546c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:17.285596 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635fa68-3267-4021-a552-e564cba0546c admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:17.285944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635fa68-3267-4021-a552-e564cba0546c admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:17.286324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635fa68-3267-4021-a552-e564cba0546c admin admin] PATH_INFO: `/v3/projects/d568e2d8cbea4e659e3f6271c700ba2b/users/8f55978b503143dfbc04720671a5a079/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:17.307316 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635fa68-3267-4021-a552-e564cba0546c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d568e2d8cbea4e659e3f6271c700ba2b, user_id=8f55978b503143dfbc04720671a5a079, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:17.310155 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635fa68-3267-4021-a552-e564cba0546c admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:17.386889 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1123/2256] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:01:17 2022] PUT /identity/v3/projects/d568e2d8cbea4e659e3f6271c700ba2b/users/8f55978b503143dfbc04720671a5a079/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:01:17.398540 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bcc1f-ca35-498d-89b6-9dbefbdc8fe6 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:17.399051 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bcc1f-ca35-498d-89b6-9dbefbdc8fe6 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:17.399671 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bcc1f-ca35-498d-89b6-9dbefbdc8fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:17.433957 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-fc4bcc1f-ca35-498d-89b6-9dbefbdc8fe6 None None] MFA Rules not processed for user `8f55978b503143dfbc04720671a5a079`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:17.435331 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-fc4bcc1f-ca35-498d-89b6-9dbefbdc8fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:17.452693 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635fa68-3267-4021-a552-e564cba0546c admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:17.454637 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-5635fa68-3267-4021-a552-e564cba0546c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:17.527980 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:17.575038 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1134/2257] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:17.587983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bcc1f-ca35-498d-89b6-9dbefbdc8fe6 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:17.589752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635fa68-3267-4021-a552-e564cba0546c admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:17.589905 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-fc4bcc1f-ca35-498d-89b6-9dbefbdc8fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:17.597102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35816798-78f6-4d66-b865-9226da11b06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:17.598971 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35816798-78f6-4d66-b865-9226da11b06c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:17.599256 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35816798-78f6-4d66-b865-9226da11b06c admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:17.599601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35816798-78f6-4d66-b865-9226da11b06c admin admin] PATH_INFO: `/v3/projects/2124ee054d82404b86eca20e03170bee` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:17.600740 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35816798-78f6-4d66-b865-9226da11b06c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2124ee054d82404b86eca20e03170bee)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:17.602858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35816798-78f6-4d66-b865-9226da11b06c admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:17.651569 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bcc1f-ca35-498d-89b6-9dbefbdc8fe6 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:17.658433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35a147-1fbd-4641-a34a-46354faa9412 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:17.659069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35a147-1fbd-4641-a34a-46354faa9412 service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:17.659412 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35a147-1fbd-4641-a34a-46354faa9412 service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:17.659781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35a147-1fbd-4641-a34a-46354faa9412 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:17.673938 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35a147-1fbd-4641-a34a-46354faa9412 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:17.675882 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35a147-1fbd-4641-a34a-46354faa9412 service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:17.687223 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1135/2258] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:01:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:01:17.789703 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-35816798-78f6-4d66-b865-9226da11b06c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2124ee054d82404b86eca20e03170bee', 'request_id': 'req-35816798-78f6-4d66-b865-9226da11b06c'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:17.798702 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-35816798-78f6-4d66-b865-9226da11b06c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2124ee054d82404b86eca20e03170bee', 'request_id': 'req-35816798-78f6-4d66-b865-9226da11b06c'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:17.806547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-35816798-78f6-4d66-b865-9226da11b06c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2124ee054d82404b86eca20e03170bee', 'request_id': 'req-35816798-78f6-4d66-b865-9226da11b06c'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:17.897268 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-35816798-78f6-4d66-b865-9226da11b06c admin admin] The token cache is being invalidate because project 2124ee054d82404b86eca20e03170bee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:01:17.897549 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-35816798-78f6-4d66-b865-9226da11b06c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:17.898199 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-35816798-78f6-4d66-b865-9226da11b06c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:17.899745 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1124/2259] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:01:17 2022] DELETE /identity/v3/projects/2124ee054d82404b86eca20e03170bee => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:01:20.818769 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35a147-1fbd-4641-a34a-46354faa9412 service cinder] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:20.829806 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35a147-1fbd-4641-a34a-46354faa9412 service cinder] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:20.887225 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541c823-4ef6-493a-aacf-c6b38f52093d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:20.887864 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541c823-4ef6-493a-aacf-c6b38f52093d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:20.888145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541c823-4ef6-493a-aacf-c6b38f52093d admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:20.888419 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541c823-4ef6-493a-aacf-c6b38f52093d admin admin] PATH_INFO: `/v3/users/8f55978b503143dfbc04720671a5a079` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:20.889555 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541c823-4ef6-493a-aacf-c6b38f52093d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f55978b503143dfbc04720671a5a079)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:20.891548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541c823-4ef6-493a-aacf-c6b38f52093d admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:21.110749 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-b541c823-4ef6-493a-aacf-c6b38f52093d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f55978b503143dfbc04720671a5a079'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:21.124494 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-b541c823-4ef6-493a-aacf-c6b38f52093d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f55978b503143dfbc04720671a5a079'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:21.125194 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-b541c823-4ef6-493a-aacf-c6b38f52093d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f55978b503143dfbc04720671a5a079'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:21.125799 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-b541c823-4ef6-493a-aacf-c6b38f52093d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f55978b503143dfbc04720671a5a079'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:21.133344 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-b541c823-4ef6-493a-aacf-c6b38f52093d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f55978b503143dfbc04720671a5a079'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:21.136657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:21.215791 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1136/2260] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:01:20 2022] DELETE /identity/v3/users/8f55978b503143dfbc04720671a5a079 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:01:21.221139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f9913-1e32-4f35-a166-b747508039e2 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:21.221626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f9913-1e32-4f35-a166-b747508039e2 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:21.221742 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f9913-1e32-4f35-a166-b747508039e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:21.242113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-0b7f9913-1e32-4f35-a166-b747508039e2 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:21.243269 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-0b7f9913-1e32-4f35-a166-b747508039e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:21.291693 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:21.310278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1125/2261] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:21.320733 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541c823-4ef6-493a-aacf-c6b38f52093d admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:21.322170 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-b541c823-4ef6-493a-aacf-c6b38f52093d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:21.390059 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541c823-4ef6-493a-aacf-c6b38f52093d admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:21.393800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ce7c7-d99d-4f46-98a5-c3a9ab41941e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:21.394757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ce7c7-d99d-4f46-98a5-c3a9ab41941e service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:21.395158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ce7c7-d99d-4f46-98a5-c3a9ab41941e service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:21.395570 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ce7c7-d99d-4f46-98a5-c3a9ab41941e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:21.411914 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ce7c7-d99d-4f46-98a5-c3a9ab41941e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:21.413085 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ce7c7-d99d-4f46-98a5-c3a9ab41941e service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:21.426487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1137/2262] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:01:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:01:21.622295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0cf0d-d51a-4ef7-a54e-ef1b66d20d5e None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:21.622582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0cf0d-d51a-4ef7-a54e-ef1b66d20d5e None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:21.622882 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0cf0d-d51a-4ef7-a54e-ef1b66d20d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:21.642326 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-28c0cf0d-d51a-4ef7-a54e-ef1b66d20d5e None None] MFA Rules not processed for user `d392c30328a3491bb186bd7b55f4d99c`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:21.643526 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-28c0cf0d-d51a-4ef7-a54e-ef1b66d20d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:21.718940 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1126/2263] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Aug 11 10:01:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:21.729567 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ce7c7-d99d-4f46-98a5-c3a9ab41941e service neutron] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:21.733846 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-a69ce7c7-d99d-4f46-98a5-c3a9ab41941e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:21.837731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ce7c7-d99d-4f46-98a5-c3a9ab41941e service neutron] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:21.845229 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce71a97-0359-4f34-8fae-5c75f24ee234 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e3b1c5aec94673b391210ae51d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:21.846585 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce71a97-0359-4f34-8fae-5c75f24ee234 service swift] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:21.847013 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce71a97-0359-4f34-8fae-5c75f24ee234 service swift] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:21.848023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce71a97-0359-4f34-8fae-5c75f24ee234 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:21.859416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce71a97-0359-4f34-8fae-5c75f24ee234 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:21.861333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce71a97-0359-4f34-8fae-5c75f24ee234 service swift] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:21.872112 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1138/2264] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Aug 11 10:01:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 10:01:22.059315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0cf0d-d51a-4ef7-a54e-ef1b66d20d5e None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:22.059315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-28c0cf0d-d51a-4ef7-a54e-ef1b66d20d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:22.102920 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0cf0d-d51a-4ef7-a54e-ef1b66d20d5e None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:22.108854 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7018e6-3aa1-442e-bc5c-7d5ea261c5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:22.109627 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7018e6-3aa1-442e-bc5c-7d5ea261c5e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:22.109961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7018e6-3aa1-442e-bc5c-7d5ea261c5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:22.110303 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7018e6-3aa1-442e-bc5c-7d5ea261c5e0 admin admin] PATH_INFO: `/v3/projects/d568e2d8cbea4e659e3f6271c700ba2b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:22.111682 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7018e6-3aa1-442e-bc5c-7d5ea261c5e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d568e2d8cbea4e659e3f6271c700ba2b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:22.113762 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7018e6-3aa1-442e-bc5c-7d5ea261c5e0 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:22.243404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ee7018e6-3aa1-442e-bc5c-7d5ea261c5e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd568e2d8cbea4e659e3f6271c700ba2b', 'request_id': 'req-ee7018e6-3aa1-442e-bc5c-7d5ea261c5e0'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:22.256555 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ee7018e6-3aa1-442e-bc5c-7d5ea261c5e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd568e2d8cbea4e659e3f6271c700ba2b', 'request_id': 'req-ee7018e6-3aa1-442e-bc5c-7d5ea261c5e0'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:22.266478 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ee7018e6-3aa1-442e-bc5c-7d5ea261c5e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd568e2d8cbea4e659e3f6271c700ba2b', 'request_id': 'req-ee7018e6-3aa1-442e-bc5c-7d5ea261c5e0'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:22.342121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ee7018e6-3aa1-442e-bc5c-7d5ea261c5e0 admin admin] The token cache is being invalidate because project d568e2d8cbea4e659e3f6271c700ba2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:01:22.342377 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ee7018e6-3aa1-442e-bc5c-7d5ea261c5e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:22.343358 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ee7018e6-3aa1-442e-bc5c-7d5ea261c5e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:22.345855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1127/2265] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:01:22 2022] DELETE /identity/v3/projects/d568e2d8cbea4e659e3f6271c700ba2b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:01:22.350989 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1f387-4856-434c-8a03-a41ff3a56bc7 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:22.351363 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1f387-4856-434c-8a03-a41ff3a56bc7 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:22.351751 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1f387-4856-434c-8a03-a41ff3a56bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:22.376337 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-bed1f387-4856-434c-8a03-a41ff3a56bc7 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:22.377657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-bed1f387-4856-434c-8a03-a41ff3a56bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:22.468298 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1139/2266] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:22.476097 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6544a-79a0-48ce-848f-d4d4541683e6 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:22.476452 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6544a-79a0-48ce-848f-d4d4541683e6 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:22.476794 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6544a-79a0-48ce-848f-d4d4541683e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:22.499893 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-70e6544a-79a0-48ce-848f-d4d4541683e6 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:22.501264 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-70e6544a-79a0-48ce-848f-d4d4541683e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:22.514578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1f387-4856-434c-8a03-a41ff3a56bc7 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:22.518203 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1128/2267] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:22.525327 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1f387-4856-434c-8a03-a41ff3a56bc7 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:22.530138 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a55afa-e004-48ac-a23b-7d41b8eaf9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:22.530795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a55afa-e004-48ac-a23b-7d41b8eaf9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:22.531066 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a55afa-e004-48ac-a23b-7d41b8eaf9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:22.531328 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a55afa-e004-48ac-a23b-7d41b8eaf9b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:22.531977 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a55afa-e004-48ac-a23b-7d41b8eaf9b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:01:22.532273 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a55afa-e004-48ac-a23b-7d41b8eaf9b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:22.533855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a55afa-e004-48ac-a23b-7d41b8eaf9b8 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:22.547904 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1140/2268] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:01:22.552829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6544a-79a0-48ce-848f-d4d4541683e6 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:22.572478 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6544a-79a0-48ce-848f-d4d4541683e6 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:22.579806 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addc397-6b24-414f-ba59-e89940ca86cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:22.580491 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addc397-6b24-414f-ba59-e89940ca86cb admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:22.580834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addc397-6b24-414f-ba59-e89940ca86cb admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:22.581170 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addc397-6b24-414f-ba59-e89940ca86cb admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:22.584911 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addc397-6b24-414f-ba59-e89940ca86cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:22.587834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addc397-6b24-414f-ba59-e89940ca86cb admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:22.696032 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1129/2269] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:01:22 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:01:22.700453 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a55afa-e004-48ac-a23b-7d41b8eaf9b8 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:22.716491 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a55afa-e004-48ac-a23b-7d41b8eaf9b8 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:22.729677 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:22.804526 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35700c-628e-4b4c-b3d8-a2a74d7ed94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:22.805485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35700c-628e-4b4c-b3d8-a2a74d7ed94c admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:22.805780 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35700c-628e-4b4c-b3d8-a2a74d7ed94c admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:22.806219 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35700c-628e-4b4c-b3d8-a2a74d7ed94c admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:22.806789 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35700c-628e-4b4c-b3d8-a2a74d7ed94c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:22.808784 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35700c-628e-4b4c-b3d8-a2a74d7ed94c admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:22.904081 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1141/2270] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:01:22 2022] POST /identity/v3/users => generated 287 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:01:22.906938 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addc397-6b24-414f-ba59-e89940ca86cb admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:22.922509 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addc397-6b24-414f-ba59-e89940ca86cb admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:22.926763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81153ed3-52ed-4df1-93f3-d45426906062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:22.927455 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81153ed3-52ed-4df1-93f3-d45426906062 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:22.928047 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81153ed3-52ed-4df1-93f3-d45426906062 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:22.928320 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81153ed3-52ed-4df1-93f3-d45426906062 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:22.928968 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81153ed3-52ed-4df1-93f3-d45426906062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:22.930601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81153ed3-52ed-4df1-93f3-d45426906062 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:22.947656 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35700c-628e-4b4c-b3d8-a2a74d7ed94c admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:22.954211 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1130/2271] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:01:22.959884 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35700c-628e-4b4c-b3d8-a2a74d7ed94c admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:22.966279 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992de71-2359-45cb-8ff2-48555559cb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:22.966279 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992de71-2359-45cb-8ff2-48555559cb0a admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:22.966531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992de71-2359-45cb-8ff2-48555559cb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:22.967001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992de71-2359-45cb-8ff2-48555559cb0a admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:22.982610 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992de71-2359-45cb-8ff2-48555559cb0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:22.984334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992de71-2359-45cb-8ff2-48555559cb0a admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:22.999648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1142/2272] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:01:23.003891 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81153ed3-52ed-4df1-93f3-d45426906062 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:23.022865 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81153ed3-52ed-4df1-93f3-d45426906062 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:23.029300 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c7371-5745-4689-85ff-9dce3a329ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:23.030202 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c7371-5745-4689-85ff-9dce3a329ba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:23.030537 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c7371-5745-4689-85ff-9dce3a329ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:23.030863 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c7371-5745-4689-85ff-9dce3a329ba8 admin admin] PATH_INFO: `/v3/projects/cdf1953d04194acca61384eea7cf891e/users/19f08b443c1049cbabbc4f1435bbbaee/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:23.051818 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c7371-5745-4689-85ff-9dce3a329ba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf1953d04194acca61384eea7cf891e, user_id=19f08b443c1049cbabbc4f1435bbbaee, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:23.055632 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c7371-5745-4689-85ff-9dce3a329ba8 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:23.121546 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1131/2273] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:01:23 2022] PUT /identity/v3/projects/cdf1953d04194acca61384eea7cf891e/users/19f08b443c1049cbabbc4f1435bbbaee/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:01:23.123383 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2e334-0ba5-45f0-913a-7e2f573df1b6 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:23.123785 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2e334-0ba5-45f0-913a-7e2f573df1b6 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:23.123914 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2e334-0ba5-45f0-913a-7e2f573df1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:23.138209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c8032-b2e4-47e4-a236-5fa426781821 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:23.138490 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c8032-b2e4-47e4-a236-5fa426781821 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:23.138754 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c8032-b2e4-47e4-a236-5fa426781821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:23.162880 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-80d2e334-0ba5-45f0-913a-7e2f573df1b6 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:23.164332 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-80d2e334-0ba5-45f0-913a-7e2f573df1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:23.170318 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-391c8032-b2e4-47e4-a236-5fa426781821 None None] MFA Rules not processed for user `d6ea1e39eb2b47b5b29d63ed8a2d7990`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:23.171526 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-391c8032-b2e4-47e4-a236-5fa426781821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:23.178819 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:23.247876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1143/2274] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:23.261341 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2e334-0ba5-45f0-913a-7e2f573df1b6 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:23.264426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1132/2275] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:23.265207 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-80d2e334-0ba5-45f0-913a-7e2f573df1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:23.366062 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2e334-0ba5-45f0-913a-7e2f573df1b6 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:23.369904 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc497d-7e11-44aa-a5c5-101049644de0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:23.370546 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc497d-7e11-44aa-a5c5-101049644de0 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:23.370824 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc497d-7e11-44aa-a5c5-101049644de0 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:23.371093 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc497d-7e11-44aa-a5c5-101049644de0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:23.387764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc497d-7e11-44aa-a5c5-101049644de0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:23.389296 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc497d-7e11-44aa-a5c5-101049644de0 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:23.401773 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1144/2276] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:01:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:01:32.771332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e949f07-5637-4687-a816-9a438651ca4c None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:32.772563 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e949f07-5637-4687-a816-9a438651ca4c None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:32.773082 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e949f07-5637-4687-a816-9a438651ca4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:32.808234 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-8e949f07-5637-4687-a816-9a438651ca4c None None] MFA Rules not processed for user `19f08b443c1049cbabbc4f1435bbbaee`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:32.809312 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-8e949f07-5637-4687-a816-9a438651ca4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:32.894739 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1133/2277] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:32.899260 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc497d-7e11-44aa-a5c5-101049644de0 service neutron] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:32.915497 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc497d-7e11-44aa-a5c5-101049644de0 service neutron] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:32.922356 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940f953-d4a7-4306-8a46-9fdc80e9744f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:32.923327 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940f953-d4a7-4306-8a46-9fdc80e9744f admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:32.923889 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940f953-d4a7-4306-8a46-9fdc80e9744f admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:32.924521 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940f953-d4a7-4306-8a46-9fdc80e9744f admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:32.925375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940f953-d4a7-4306-8a46-9fdc80e9744f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:32.932542 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940f953-d4a7-4306-8a46-9fdc80e9744f admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:33.022887 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1145/2278] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:01:32 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:01:33.026689 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e949f07-5637-4687-a816-9a438651ca4c None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:33.044787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e949f07-5637-4687-a816-9a438651ca4c None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:33.137214 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9309d-c3ab-4f9a-9035-ddfca3096ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:33.138159 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9309d-c3ab-4f9a-9035-ddfca3096ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:33.138379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9309d-c3ab-4f9a-9035-ddfca3096ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:33.138744 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9309d-c3ab-4f9a-9035-ddfca3096ca2 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:33.139756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9309d-c3ab-4f9a-9035-ddfca3096ca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:33.142051 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9309d-c3ab-4f9a-9035-ddfca3096ca2 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:33.244361 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1134/2279] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:01:33 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:01:33.254437 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940f953-d4a7-4306-8a46-9fdc80e9744f admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:33.266294 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940f953-d4a7-4306-8a46-9fdc80e9744f admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:33.279888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2101170-ed7d-472f-8b5f-25f0abebf8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:33.280103 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2101170-ed7d-472f-8b5f-25f0abebf8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:33.280502 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2101170-ed7d-472f-8b5f-25f0abebf8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:33.280830 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2101170-ed7d-472f-8b5f-25f0abebf8c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:33.281506 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2101170-ed7d-472f-8b5f-25f0abebf8c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:33.283267 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2101170-ed7d-472f-8b5f-25f0abebf8c5 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:33.304750 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1146/2280] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:01:33.308760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9309d-c3ab-4f9a-9035-ddfca3096ca2 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:33.317960 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9309d-c3ab-4f9a-9035-ddfca3096ca2 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:33.328615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54f89d-70a5-4649-91db-a25ed0035513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:33.332583 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54f89d-70a5-4649-91db-a25ed0035513 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:33.332869 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54f89d-70a5-4649-91db-a25ed0035513 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:33.333144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54f89d-70a5-4649-91db-a25ed0035513 admin admin] PATH_INFO: `/v3/projects/b26f8dcb4bdb4881bb8192b8426763ab/users/beef98b1395842f29d8761dac7aaa31d/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:33.358291 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54f89d-70a5-4649-91db-a25ed0035513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b26f8dcb4bdb4881bb8192b8426763ab, user_id=beef98b1395842f29d8761dac7aaa31d, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:33.363265 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54f89d-70a5-4649-91db-a25ed0035513 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:33.443432 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2101170-ed7d-472f-8b5f-25f0abebf8c5 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:33.457954 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1135/2281] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:01:33 2022] PUT /identity/v3/projects/b26f8dcb4bdb4881bb8192b8426763ab/users/beef98b1395842f29d8761dac7aaa31d/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:01:33.458406 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:33.466323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2101170-ed7d-472f-8b5f-25f0abebf8c5 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:33.618871 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0aaa60-c524-4ada-8337-81201a380cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:33.619737 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aaa60-c524-4ada-8337-81201a380cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:33.620132 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aaa60-c524-4ada-8337-81201a380cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:33.622773 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aaa60-c524-4ada-8337-81201a380cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:33.623643 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0aaa60-c524-4ada-8337-81201a380cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:33.630192 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0aaa60-c524-4ada-8337-81201a380cf7 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:33.668083 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1147/2282] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:01:33.671286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54f89d-70a5-4649-91db-a25ed0035513 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:33.696046 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54f89d-70a5-4649-91db-a25ed0035513 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:33.712055 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34f135-e46a-478a-958a-226610da8e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:33.712883 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34f135-e46a-478a-958a-226610da8e00 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:33.713470 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34f135-e46a-478a-958a-226610da8e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:33.714538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34f135-e46a-478a-958a-226610da8e00 admin admin] PATH_INFO: `/v3/projects/b26f8dcb4bdb4881bb8192b8426763ab/users/beef98b1395842f29d8761dac7aaa31d/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:33.717792 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34f135-e46a-478a-958a-226610da8e00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b26f8dcb4bdb4881bb8192b8426763ab, user_id=beef98b1395842f29d8761dac7aaa31d, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:33.722421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34f135-e46a-478a-958a-226610da8e00 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:33.727487 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:33.746447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1136/2283] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:01:33 2022] PUT /identity/v3/projects/b26f8dcb4bdb4881bb8192b8426763ab/users/beef98b1395842f29d8761dac7aaa31d/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:01:35.891855 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0aaa60-c524-4ada-8337-81201a380cf7 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:35.894222 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-4e0aaa60-c524-4ada-8337-81201a380cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:35.914660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0aaa60-c524-4ada-8337-81201a380cf7 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:35.998223 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bd6cb-a1fb-4f66-bd00-58a2803b5410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:35.999350 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bd6cb-a1fb-4f66-bd00-58a2803b5410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:35.999902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bd6cb-a1fb-4f66-bd00-58a2803b5410 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:36.000392 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bd6cb-a1fb-4f66-bd00-58a2803b5410 admin admin] PATH_INFO: `/v3/users/53ec37bb89744b32bbc047cc4ab0e6b6` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:36.001790 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bd6cb-a1fb-4f66-bd00-58a2803b5410 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53ec37bb89744b32bbc047cc4ab0e6b6)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:36.009143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bd6cb-a1fb-4f66-bd00-58a2803b5410 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:36.264683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e63bd6cb-a1fb-4f66-bd00-58a2803b5410 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53ec37bb89744b32bbc047cc4ab0e6b6'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:36.311683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e63bd6cb-a1fb-4f66-bd00-58a2803b5410 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53ec37bb89744b32bbc047cc4ab0e6b6'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:36.316736 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e63bd6cb-a1fb-4f66-bd00-58a2803b5410 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53ec37bb89744b32bbc047cc4ab0e6b6'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:36.320699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e63bd6cb-a1fb-4f66-bd00-58a2803b5410 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53ec37bb89744b32bbc047cc4ab0e6b6'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:36.351131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e63bd6cb-a1fb-4f66-bd00-58a2803b5410 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53ec37bb89744b32bbc047cc4ab0e6b6'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:36.459509 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1148/2284] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:01:35 2022] DELETE /identity/v3/users/53ec37bb89744b32bbc047cc4ab0e6b6 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:01:36.464213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6c400-6367-471b-ade6-02fe40898bdc None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:36.464827 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6c400-6367-471b-ade6-02fe40898bdc None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:36.464827 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6c400-6367-471b-ade6-02fe40898bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:36.514369 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-6ed6c400-6367-471b-ade6-02fe40898bdc None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:36.515635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-6ed6c400-6367-471b-ade6-02fe40898bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:36.626777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1137/2285] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:36.645396 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bd6cb-a1fb-4f66-bd00-58a2803b5410 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:36.647329 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-e63bd6cb-a1fb-4f66-bd00-58a2803b5410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:36.685924 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:36.794463 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bd6cb-a1fb-4f66-bd00-58a2803b5410 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:36.808059 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0247e-ea83-44b0-b7b2-58e2dd38692a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:36.809052 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0247e-ea83-44b0-b7b2-58e2dd38692a service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:36.809583 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0247e-ea83-44b0-b7b2-58e2dd38692a service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:36.809970 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0247e-ea83-44b0-b7b2-58e2dd38692a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:36.831309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0247e-ea83-44b0-b7b2-58e2dd38692a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:36.833116 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0247e-ea83-44b0-b7b2-58e2dd38692a service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:36.878764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1149/2286] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:01:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:01:37.653081 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6c400-6367-471b-ade6-02fe40898bdc None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:37.655224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-6ed6c400-6367-471b-ade6-02fe40898bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:37.671189 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6c400-6367-471b-ade6-02fe40898bdc None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:37.684299 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39185e8e-f233-41c2-be2a-9a10c876f0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:37.684954 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39185e8e-f233-41c2-be2a-9a10c876f0e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:37.685225 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39185e8e-f233-41c2-be2a-9a10c876f0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:37.685875 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39185e8e-f233-41c2-be2a-9a10c876f0e2 admin admin] PATH_INFO: `/v3/projects/0eeb3223eae54feaa62684e974e303f1` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:37.688678 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39185e8e-f233-41c2-be2a-9a10c876f0e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eeb3223eae54feaa62684e974e303f1)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:37.691008 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39185e8e-f233-41c2-be2a-9a10c876f0e2 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:37.847685 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-39185e8e-f233-41c2-be2a-9a10c876f0e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eeb3223eae54feaa62684e974e303f1', 'request_id': 'req-39185e8e-f233-41c2-be2a-9a10c876f0e2'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:37.858124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-39185e8e-f233-41c2-be2a-9a10c876f0e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eeb3223eae54feaa62684e974e303f1', 'request_id': 'req-39185e8e-f233-41c2-be2a-9a10c876f0e2'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:37.870121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-39185e8e-f233-41c2-be2a-9a10c876f0e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eeb3223eae54feaa62684e974e303f1', 'request_id': 'req-39185e8e-f233-41c2-be2a-9a10c876f0e2'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:37.994936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-39185e8e-f233-41c2-be2a-9a10c876f0e2 admin admin] The token cache is being invalidate because project 0eeb3223eae54feaa62684e974e303f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:01:37.995467 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-39185e8e-f233-41c2-be2a-9a10c876f0e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:37.998616 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-39185e8e-f233-41c2-be2a-9a10c876f0e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:01:38.000658 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1138/2287] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:01:37 2022] DELETE /identity/v3/projects/0eeb3223eae54feaa62684e974e303f1 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:01:38.007824 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642163f-90d2-4e76-a705-3bd9f18f375a None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:38.008339 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642163f-90d2-4e76-a705-3bd9f18f375a None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:38.008834 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642163f-90d2-4e76-a705-3bd9f18f375a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:38.043422 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-9642163f-90d2-4e76-a705-3bd9f18f375a None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:38.046438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-9642163f-90d2-4e76-a705-3bd9f18f375a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:38.176975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1150/2288] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:38.177807 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f397f8e-5586-41e8-ab2d-d30d3dcd95e2 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:38.178010 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f397f8e-5586-41e8-ab2d-d30d3dcd95e2 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:38.178609 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f397f8e-5586-41e8-ab2d-d30d3dcd95e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:38.206347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-3f397f8e-5586-41e8-ab2d-d30d3dcd95e2 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:38.208468 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-3f397f8e-5586-41e8-ab2d-d30d3dcd95e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:38.220549 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1139/2289] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:38.224454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642163f-90d2-4e76-a705-3bd9f18f375a None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:38.235230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642163f-90d2-4e76-a705-3bd9f18f375a None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:38.240042 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92640361-a279-4b26-9163-aa5c486cedad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:38.240661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92640361-a279-4b26-9163-aa5c486cedad admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:38.240938 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92640361-a279-4b26-9163-aa5c486cedad admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:38.241202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92640361-a279-4b26-9163-aa5c486cedad admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:38.242017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92640361-a279-4b26-9163-aa5c486cedad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:01:38.242988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92640361-a279-4b26-9163-aa5c486cedad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:38.244609 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92640361-a279-4b26-9163-aa5c486cedad admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:38.261806 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1151/2290] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:01:38.266148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f397f8e-5586-41e8-ab2d-d30d3dcd95e2 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:38.276263 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f397f8e-5586-41e8-ab2d-d30d3dcd95e2 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:38.281023 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f200f4-8c10-4ac9-9cd0-61711324c893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:38.281667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f200f4-8c10-4ac9-9cd0-61711324c893 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:38.281948 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f200f4-8c10-4ac9-9cd0-61711324c893 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:38.282327 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f200f4-8c10-4ac9-9cd0-61711324c893 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:38.283004 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f200f4-8c10-4ac9-9cd0-61711324c893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:38.284945 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f200f4-8c10-4ac9-9cd0-61711324c893 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:38.409677 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1140/2291] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:01:38 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:01:38.413899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92640361-a279-4b26-9163-aa5c486cedad admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:38.439705 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92640361-a279-4b26-9163-aa5c486cedad admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:38.542263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b6ffe-5b61-4a01-91d5-ecf165abf85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:38.542981 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b6ffe-5b61-4a01-91d5-ecf165abf85c admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:38.543327 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b6ffe-5b61-4a01-91d5-ecf165abf85c admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:38.543666 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b6ffe-5b61-4a01-91d5-ecf165abf85c admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:38.544368 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b6ffe-5b61-4a01-91d5-ecf165abf85c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:38.546685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b6ffe-5b61-4a01-91d5-ecf165abf85c admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:38.671421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1152/2292] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:01:38 2022] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:01:38.675627 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f200f4-8c10-4ac9-9cd0-61711324c893 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:38.687880 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f200f4-8c10-4ac9-9cd0-61711324c893 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:38.697849 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77bb79-81fd-417d-9c48-f01796291e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:38.701569 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77bb79-81fd-417d-9c48-f01796291e2d admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:38.701569 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77bb79-81fd-417d-9c48-f01796291e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:38.701569 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77bb79-81fd-417d-9c48-f01796291e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:38.701569 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77bb79-81fd-417d-9c48-f01796291e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:38.702045 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77bb79-81fd-417d-9c48-f01796291e2d admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:38.720300 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1141/2293] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:01:38.725016 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b6ffe-5b61-4a01-91d5-ecf165abf85c admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:38.738338 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b6ffe-5b61-4a01-91d5-ecf165abf85c admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:38.744152 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778df8e-4192-49be-b21e-636f87b5d169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:38.744953 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778df8e-4192-49be-b21e-636f87b5d169 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:38.745311 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778df8e-4192-49be-b21e-636f87b5d169 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:38.745674 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778df8e-4192-49be-b21e-636f87b5d169 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:38.746593 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778df8e-4192-49be-b21e-636f87b5d169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:38.748428 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778df8e-4192-49be-b21e-636f87b5d169 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:38.763133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1153/2294] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:01:38.767316 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77bb79-81fd-417d-9c48-f01796291e2d admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:38.778844 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77bb79-81fd-417d-9c48-f01796291e2d admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:38.784016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a59f4-015a-4406-bf42-15bd15dc693f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:38.784791 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a59f4-015a-4406-bf42-15bd15dc693f admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:38.785134 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a59f4-015a-4406-bf42-15bd15dc693f admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:38.785477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a59f4-015a-4406-bf42-15bd15dc693f admin admin] PATH_INFO: `/v3/projects/04cdb9c3b2dd489ab204a8b1863511b0/users/e2508b9e971242f5b7f60b1261574539/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:38.814388 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a59f4-015a-4406-bf42-15bd15dc693f admin admin] RBAC: Authorizing `identity:create_grant(project_id=04cdb9c3b2dd489ab204a8b1863511b0, user_id=e2508b9e971242f5b7f60b1261574539, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:38.817387 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a59f4-015a-4406-bf42-15bd15dc693f admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:38.928680 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1142/2295] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:01:38 2022] PUT /identity/v3/projects/04cdb9c3b2dd489ab204a8b1863511b0/users/e2508b9e971242f5b7f60b1261574539/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:01:38.934468 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1d352-73f3-4bf6-a25c-00eabbaaf0ba None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:38.934759 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1d352-73f3-4bf6-a25c-00eabbaaf0ba None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:38.935067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1d352-73f3-4bf6-a25c-00eabbaaf0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:38.956997 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-c5c1d352-73f3-4bf6-a25c-00eabbaaf0ba None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:38.958475 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-c5c1d352-73f3-4bf6-a25c-00eabbaaf0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:38.989900 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:39.040458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1154/2296] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:39.051445 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a59f4-015a-4406-bf42-15bd15dc693f admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:39.053430 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-fa0a59f4-015a-4406-bf42-15bd15dc693f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:39.074868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:39.124990 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a59f4-015a-4406-bf42-15bd15dc693f admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:39.129278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bbdf6-f884-4bf5-98ef-0488856cb557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:39.130005 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bbdf6-f884-4bf5-98ef-0488856cb557 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:39.130410 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bbdf6-f884-4bf5-98ef-0488856cb557 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:39.130779 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bbdf6-f884-4bf5-98ef-0488856cb557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:39.147556 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40bbdf6-f884-4bf5-98ef-0488856cb557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:39.150406 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40bbdf6-f884-4bf5-98ef-0488856cb557 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:39.168824 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1143/2297] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:01:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:01:40.896231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faf522-fd29-4cd3-b777-53091ff26661 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:40.896231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faf522-fd29-4cd3-b777-53091ff26661 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:40.896231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faf522-fd29-4cd3-b777-53091ff26661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:40.951378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-53faf522-fd29-4cd3-b777-53091ff26661 None None] MFA Rules not processed for user `e2508b9e971242f5b7f60b1261574539`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:40.953262 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-53faf522-fd29-4cd3-b777-53091ff26661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:41.038159 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1155/2298] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:41.049687 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bbdf6-f884-4bf5-98ef-0488856cb557 service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:41.056912 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-c40bbdf6-f884-4bf5-98ef-0488856cb557 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:41.122358 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bbdf6-f884-4bf5-98ef-0488856cb557 service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:41.126659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6718d2-a6b7-418e-97f8-502311ab4ec2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:41.127290 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6718d2-a6b7-418e-97f8-502311ab4ec2 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:41.127786 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6718d2-a6b7-418e-97f8-502311ab4ec2 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:41.127967 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6718d2-a6b7-418e-97f8-502311ab4ec2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:41.138009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6718d2-a6b7-418e-97f8-502311ab4ec2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:41.139651 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6718d2-a6b7-418e-97f8-502311ab4ec2 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:41.149694 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1144/2299] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:01:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:01:41.529314 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024375b-618a-4965-8e72-a7aa1cb6f87d None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:41.529600 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024375b-618a-4965-8e72-a7aa1cb6f87d None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:41.529867 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024375b-618a-4965-8e72-a7aa1cb6f87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:41.567502 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-2024375b-618a-4965-8e72-a7aa1cb6f87d None None] MFA Rules not processed for user `beef98b1395842f29d8761dac7aaa31d`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:41.568886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-2024375b-618a-4965-8e72-a7aa1cb6f87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:41.678110 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1156/2300] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:41.692819 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6718d2-a6b7-418e-97f8-502311ab4ec2 service cinder] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:41.697995 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-8b6718d2-a6b7-418e-97f8-502311ab4ec2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:41.792114 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6718d2-a6b7-418e-97f8-502311ab4ec2 service cinder] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:41.798847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7383f8-46b2-494b-b416-8b82e16d201b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:41.799458 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7383f8-46b2-494b-b416-8b82e16d201b service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:41.799733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7383f8-46b2-494b-b416-8b82e16d201b service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:41.800004 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7383f8-46b2-494b-b416-8b82e16d201b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:41.801745 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-bc7383f8-46b2-494b-b416-8b82e16d201b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:41.864108 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7383f8-46b2-494b-b416-8b82e16d201b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:41.865712 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7383f8-46b2-494b-b416-8b82e16d201b service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:41.869213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:41.875042 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1145/2301] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:01:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:01:43.311806 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e13f6-2618-49cf-bb61-97b87a62476b None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:43.312309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e13f6-2618-49cf-bb61-97b87a62476b None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:43.312422 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e13f6-2618-49cf-bb61-97b87a62476b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:43.353070 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-ef9e13f6-2618-49cf-bb61-97b87a62476b None None] MFA Rules not processed for user `e2508b9e971242f5b7f60b1261574539`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:43.353351 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ef9e13f6-2618-49cf-bb61-97b87a62476b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:43.363684 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1157/2302] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:45.804731 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd4a76-a119-472d-b1e1-02128c83109b None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:45.805278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd4a76-a119-472d-b1e1-02128c83109b None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:45.805278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd4a76-a119-472d-b1e1-02128c83109b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:45.843713 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-b5dd4a76-a119-472d-b1e1-02128c83109b None None] MFA Rules not processed for user `19f08b443c1049cbabbc4f1435bbbaee`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:45.843713 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-b5dd4a76-a119-472d-b1e1-02128c83109b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:45.856739 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1146/2303] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:01:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:46.492644 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caedb65-195a-412e-b2a9-4f6b3b6f988e None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:46.493846 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caedb65-195a-412e-b2a9-4f6b3b6f988e None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:46.495034 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caedb65-195a-412e-b2a9-4f6b3b6f988e None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:46.498210 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1158/2304] 10.222.0.13 () {54 vars in 921 bytes} [Thu Aug 11 10:01:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:01:46.508783 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c871e41-f8e8-4b87-ab2d-b87f8cb1dddf None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:46.508783 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c871e41-f8e8-4b87-ab2d-b87f8cb1dddf None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:46.508783 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c871e41-f8e8-4b87-ab2d-b87f8cb1dddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:46.531072 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-5c871e41-f8e8-4b87-ab2d-b87f8cb1dddf None None] MFA Rules not processed for user `4c1dc8e0d9454ad98894ed1e8d31f931`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:46.534034 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-5c871e41-f8e8-4b87-ab2d-b87f8cb1dddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:46.548447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1147/2305] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Aug 11 10:01:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:46.563014 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caedb65-195a-412e-b2a9-4f6b3b6f988e None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:46.564983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-1caedb65-195a-412e-b2a9-4f6b3b6f988e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:46.617869 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:01:46.648680 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caedb65-195a-412e-b2a9-4f6b3b6f988e None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:46.664138 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4850b8-b025-43cf-8d70-d771514c52e6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7791be968594cea9c32b51a7b3454b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:46.665027 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4850b8-b025-43cf-8d70-d771514c52e6 service glance] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:46.665529 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4850b8-b025-43cf-8d70-d771514c52e6 service glance] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:46.666608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4850b8-b025-43cf-8d70-d771514c52e6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:46.681582 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4850b8-b025-43cf-8d70-d771514c52e6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:46.683483 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4850b8-b025-43cf-8d70-d771514c52e6 service glance] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:46.702180 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1159/2306] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:01:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:01:47.133678 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4a75b-6938-4bdc-86b6-59bdd3d127d4 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:47.134273 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4a75b-6938-4bdc-86b6-59bdd3d127d4 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:47.134273 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4a75b-6938-4bdc-86b6-59bdd3d127d4 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:47.136040 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1148/2307] 10.222.0.13 () {54 vars in 921 bytes} [Thu Aug 11 10:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:01:47.141386 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134521dc-fb8c-4916-8df2-200d4cac4d93 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:47.141810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134521dc-fb8c-4916-8df2-200d4cac4d93 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:47.142248 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134521dc-fb8c-4916-8df2-200d4cac4d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:47.169531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-134521dc-fb8c-4916-8df2-200d4cac4d93 None None] MFA Rules not processed for user `4ac6ca32b5144c59b2bb5086fbd53ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:47.169531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-134521dc-fb8c-4916-8df2-200d4cac4d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:47.180995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1160/2308] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Aug 11 10:01:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:01:47.197726 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4a75b-6938-4bdc-86b6-59bdd3d127d4 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:47.200378 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-bec4a75b-6938-4bdc-86b6-59bdd3d127d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:47.223557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4a75b-6938-4bdc-86b6-59bdd3d127d4 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:47.228030 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84837c-f338-4e5c-a304-4bbb47b815f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:47.228682 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84837c-f338-4e5c-a304-4bbb47b815f2 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:47.228959 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84837c-f338-4e5c-a304-4bbb47b815f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:47.229227 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84837c-f338-4e5c-a304-4bbb47b815f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:47.248272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84837c-f338-4e5c-a304-4bbb47b815f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:47.250138 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84837c-f338-4e5c-a304-4bbb47b815f2 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:47.264783 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1149/2309] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:01:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:01:47.386708 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05212c4f-ec82-4c21-b8e8-45c9f54b8b0e None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:47.386888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05212c4f-ec82-4c21-b8e8-45c9f54b8b0e None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:47.387144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05212c4f-ec82-4c21-b8e8-45c9f54b8b0e None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:47.388626 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1161/2310] 10.222.0.13 () {54 vars in 921 bytes} [Thu Aug 11 10:01:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:01:47.394266 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a13f6-c396-4386-9124-fc67ca93f0cb None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:47.394625 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a13f6-c396-4386-9124-fc67ca93f0cb None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:47.395055 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a13f6-c396-4386-9124-fc67ca93f0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:47.415627 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-886a13f6-c396-4386-9124-fc67ca93f0cb None None] MFA Rules not processed for user `4c1dc8e0d9454ad98894ed1e8d31f931`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:47.416969 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-886a13f6-c396-4386-9124-fc67ca93f0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:47.429503 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1150/2311] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Aug 11 10:01:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:47.440985 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05212c4f-ec82-4c21-b8e8-45c9f54b8b0e None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:47.453062 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05212c4f-ec82-4c21-b8e8-45c9f54b8b0e None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:47.457119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8991591-6b0c-4aec-a497-9f8832449ca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:47.457748 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8991591-6b0c-4aec-a497-9f8832449ca9 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:47.458009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8991591-6b0c-4aec-a497-9f8832449ca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:47.458308 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8991591-6b0c-4aec-a497-9f8832449ca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:47.471492 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8991591-6b0c-4aec-a497-9f8832449ca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:47.473214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8991591-6b0c-4aec-a497-9f8832449ca9 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:47.485961 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1162/2312] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:01:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:01:53.422765 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e486a85-92e1-447f-b91f-88bb395e6529 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:53.423251 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e486a85-92e1-447f-b91f-88bb395e6529 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:53.423341 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e486a85-92e1-447f-b91f-88bb395e6529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:53.442652 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-6e486a85-92e1-447f-b91f-88bb395e6529 None None] MFA Rules not processed for user `d392c30328a3491bb186bd7b55f4d99c`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:01:53.443908 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-6e486a85-92e1-447f-b91f-88bb395e6529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:53.510639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1151/2313] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Aug 11 10:01:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:01:53.533179 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8991591-6b0c-4aec-a497-9f8832449ca9 service neutron] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:01:53.534977 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-d8991591-6b0c-4aec-a497-9f8832449ca9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:01:53.611970 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8991591-6b0c-4aec-a497-9f8832449ca9 service neutron] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:01:53.617237 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbaf429-24c5-4172-876a-2c7ac7d38318 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e3b1c5aec94673b391210ae51d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:01:53.617877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaf429-24c5-4172-876a-2c7ac7d38318 service swift] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:01:53.618190 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaf429-24c5-4172-876a-2c7ac7d38318 service swift] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:01:53.618466 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaf429-24c5-4172-876a-2c7ac7d38318 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:01:53.626783 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbaf429-24c5-4172-876a-2c7ac7d38318 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:01:53.628360 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbaf429-24c5-4172-876a-2c7ac7d38318 service swift] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:01:53.641090 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1163/2314] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Aug 11 10:01:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 10:02:03.503530 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=41 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:02:03.636902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=51 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:02:15.953314 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc1879-4dfd-4d30-bc94-f97d3aa26888 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:02:15.953872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc1879-4dfd-4d30-bc94-f97d3aa26888 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:02:15.953872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc1879-4dfd-4d30-bc94-f97d3aa26888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:02:15.974103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-1adc1879-4dfd-4d30-bc94-f97d3aa26888 None None] MFA Rules not processed for user `d392c30328a3491bb186bd7b55f4d99c`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:02:15.975445 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-1adc1879-4dfd-4d30-bc94-f97d3aa26888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:02:15.985469 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1152/2315] 10.222.0.13 () {58 vars in 967 bytes} [Thu Aug 11 10:02:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:02:16.000136 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbaf429-24c5-4172-876a-2c7ac7d38318 service swift] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:02:16.010651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbaf429-24c5-4172-876a-2c7ac7d38318 service swift] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:02:16.015621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20a292-46dd-4726-9105-f770f0d624a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e3b1c5aec94673b391210ae51d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:02:16.016204 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20a292-46dd-4726-9105-f770f0d624a0 service swift] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:02:16.016524 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20a292-46dd-4726-9105-f770f0d624a0 service swift] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:02:16.016844 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20a292-46dd-4726-9105-f770f0d624a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:02:16.026360 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20a292-46dd-4726-9105-f770f0d624a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:02:16.027981 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20a292-46dd-4726-9105-f770f0d624a0 service swift] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:02:16.036745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1164/2316] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Aug 11 10:02:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 10:02:23.663801 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc1879-4dfd-4d30-bc94-f97d3aa26888 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:02:23.665374 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-1adc1879-4dfd-4d30-bc94-f97d3aa26888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:02:23.743171 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc1879-4dfd-4d30-bc94-f97d3aa26888 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:02:23.748349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a5764-71ef-48b7-a717-ae9f722343c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0061ce46df224f4491599ed10548b2ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:02:23.748967 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a5764-71ef-48b7-a717-ae9f722343c0 service placement] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:02:23.749243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a5764-71ef-48b7-a717-ae9f722343c0 service placement] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:02:23.749508 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a5764-71ef-48b7-a717-ae9f722343c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:02:23.751288 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-bc4a5764-71ef-48b7-a717-ae9f722343c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:02:23.764501 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a5764-71ef-48b7-a717-ae9f722343c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:02:23.766185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a5764-71ef-48b7-a717-ae9f722343c0 service placement] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:02:23.777293 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1153/2317] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:02:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:02:26.034066 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=6 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:02:26.219234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20a292-46dd-4726-9105-f770f0d624a0 service swift] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:02:26.228361 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20a292-46dd-4726-9105-f770f0d624a0 service swift] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:02:26.231961 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665bf61-f396-41f6-b4e7-1b99166c49fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:02:26.232552 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665bf61-f396-41f6-b4e7-1b99166c49fd service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:02:26.232831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665bf61-f396-41f6-b4e7-1b99166c49fd service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:02:26.233103 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665bf61-f396-41f6-b4e7-1b99166c49fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:02:26.242375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665bf61-f396-41f6-b4e7-1b99166c49fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:02:26.243775 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665bf61-f396-41f6-b4e7-1b99166c49fd service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:02:26.253871 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1165/2318] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:02:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:02:30.583149 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24a717-9bbd-4a00-a812-83e6c3660b18 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:02:30.583717 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24a717-9bbd-4a00-a812-83e6c3660b18 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:02:30.583717 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24a717-9bbd-4a00-a812-83e6c3660b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:02:30.602833 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-fe24a717-9bbd-4a00-a812-83e6c3660b18 None None] MFA Rules not processed for user `20bf487c5b8e490da15060ea798a83ca`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:02:30.603990 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-fe24a717-9bbd-4a00-a812-83e6c3660b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:02:30.660165 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1154/2319] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:02:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:02:32.340963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70479733-4e94-469b-a5fe-f6a8bb00ce22 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:02:32.341516 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70479733-4e94-469b-a5fe-f6a8bb00ce22 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:02:32.341516 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70479733-4e94-469b-a5fe-f6a8bb00ce22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:02:32.363801 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-70479733-4e94-469b-a5fe-f6a8bb00ce22 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:02:32.364987 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-70479733-4e94-469b-a5fe-f6a8bb00ce22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:02:32.372920 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1166/2320] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Aug 11 10:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:02:32.396018 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24a717-9bbd-4a00-a812-83e6c3660b18 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:02:32.408866 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24a717-9bbd-4a00-a812-83e6c3660b18 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:02:32.414844 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af87ef6-f5a9-4989-a809-b15aea4e8e76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:02:32.417033 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af87ef6-f5a9-4989-a809-b15aea4e8e76 service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:02:32.417033 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af87ef6-f5a9-4989-a809-b15aea4e8e76 service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:02:32.417033 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af87ef6-f5a9-4989-a809-b15aea4e8e76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:02:32.424303 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af87ef6-f5a9-4989-a809-b15aea4e8e76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:02:32.426615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af87ef6-f5a9-4989-a809-b15aea4e8e76 service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:02:32.437045 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1155/2321] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:02:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:02:37.719738 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d1cfe-07cb-4250-be6c-26ea7cd8b386 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:02:37.720239 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d1cfe-07cb-4250-be6c-26ea7cd8b386 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:02:37.720329 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d1cfe-07cb-4250-be6c-26ea7cd8b386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:02:37.741512 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-e74d1cfe-07cb-4250-be6c-26ea7cd8b386 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:02:37.742669 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-e74d1cfe-07cb-4250-be6c-26ea7cd8b386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:02:37.750433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1167/2322] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Aug 11 10:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:02:37.773119 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af87ef6-f5a9-4989-a809-b15aea4e8e76 service nova] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:02:37.785155 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af87ef6-f5a9-4989-a809-b15aea4e8e76 service nova] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:02:37.791395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4ddaf-8e17-4d45-84d1-601377fdaf5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:02:37.792001 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4ddaf-8e17-4d45-84d1-601377fdaf5c service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:02:37.792278 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4ddaf-8e17-4d45-84d1-601377fdaf5c service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:02:37.792551 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4ddaf-8e17-4d45-84d1-601377fdaf5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:02:37.801018 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4ddaf-8e17-4d45-84d1-601377fdaf5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:02:37.803213 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4ddaf-8e17-4d45-84d1-601377fdaf5c service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:02:37.812886 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1156/2323] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:02:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:02:43.150808 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b1a2a-e45e-4329-9491-193925c885da None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:02:43.151426 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b1a2a-e45e-4329-9491-193925c885da None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:02:43.151426 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b1a2a-e45e-4329-9491-193925c885da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:02:43.170323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-618b1a2a-e45e-4329-9491-193925c885da None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:02:43.171534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-618b1a2a-e45e-4329-9491-193925c885da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:02:43.179946 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1168/2324] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Aug 11 10:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:02:43.203527 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4ddaf-8e17-4d45-84d1-601377fdaf5c service nova] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:02:43.204947 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-2fc4ddaf-8e17-4d45-84d1-601377fdaf5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:02:43.220450 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4ddaf-8e17-4d45-84d1-601377fdaf5c service nova] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:02:43.227249 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287a5ae-837c-48f1-953a-b8454288e3e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:02:43.227984 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287a5ae-837c-48f1-953a-b8454288e3e9 service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:02:43.228269 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287a5ae-837c-48f1-953a-b8454288e3e9 service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:02:43.228542 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287a5ae-837c-48f1-953a-b8454288e3e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:02:43.237494 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287a5ae-837c-48f1-953a-b8454288e3e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:02:43.239127 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287a5ae-837c-48f1-953a-b8454288e3e9 service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:02:43.249356 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1157/2325] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:02:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:02:46.073276 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e78f02-7a96-4c29-a379-4269d878beb8 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:02:46.073801 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e78f02-7a96-4c29-a379-4269d878beb8 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:02:46.073801 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e78f02-7a96-4c29-a379-4269d878beb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:02:46.093007 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-42e78f02-7a96-4c29-a379-4269d878beb8 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:02:46.094251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-42e78f02-7a96-4c29-a379-4269d878beb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:02:46.102770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1169/2326] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Aug 11 10:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:02:46.125990 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287a5ae-837c-48f1-953a-b8454288e3e9 service nova] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:02:46.131651 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=79 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:02:46.137524 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287a5ae-837c-48f1-953a-b8454288e3e9 service nova] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:02:46.142990 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537910c-6aa7-4a9c-b4e7-3a0734c518a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:02:46.143576 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537910c-6aa7-4a9c-b4e7-3a0734c518a5 service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:02:46.143858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537910c-6aa7-4a9c-b4e7-3a0734c518a5 service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:02:46.144132 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537910c-6aa7-4a9c-b4e7-3a0734c518a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:02:46.153219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537910c-6aa7-4a9c-b4e7-3a0734c518a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:02:46.154885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537910c-6aa7-4a9c-b4e7-3a0734c518a5 service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:02:46.164825 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1158/2327] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:02:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:02:51.414319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a4967-4921-4aa9-9544-ced7f7599a42 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:02:51.414805 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a4967-4921-4aa9-9544-ced7f7599a42 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:02:51.414805 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a4967-4921-4aa9-9544-ced7f7599a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:02:51.433818 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-361a4967-4921-4aa9-9544-ced7f7599a42 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:02:51.435051 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-361a4967-4921-4aa9-9544-ced7f7599a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:02:51.442935 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1170/2328] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Aug 11 10:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:02:51.466483 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537910c-6aa7-4a9c-b4e7-3a0734c518a5 service nova] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:02:51.478410 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537910c-6aa7-4a9c-b4e7-3a0734c518a5 service nova] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:02:51.484707 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890e76c-a462-42b8-bd76-9390a729eef0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:02:51.485202 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890e76c-a462-42b8-bd76-9390a729eef0 service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:02:51.485485 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890e76c-a462-42b8-bd76-9390a729eef0 service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:02:51.485905 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890e76c-a462-42b8-bd76-9390a729eef0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:02:51.497001 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890e76c-a462-42b8-bd76-9390a729eef0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:02:51.498031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890e76c-a462-42b8-bd76-9390a729eef0 service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:02:51.508777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1159/2329] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:02:55.633710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f374354-222a-4c11-b0a6-2cdf19842972 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:02:55.634233 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f374354-222a-4c11-b0a6-2cdf19842972 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:02:55.634371 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f374354-222a-4c11-b0a6-2cdf19842972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:02:55.654361 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-1f374354-222a-4c11-b0a6-2cdf19842972 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:02:55.655480 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-1f374354-222a-4c11-b0a6-2cdf19842972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:02:55.663699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1171/2330] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Aug 11 10:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:02:55.688800 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890e76c-a462-42b8-bd76-9390a729eef0 service nova] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:02:55.700464 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890e76c-a462-42b8-bd76-9390a729eef0 service nova] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:02:55.705831 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f29e58-e2f0-4083-8203-0d8b00676399 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:02:55.706445 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f29e58-e2f0-4083-8203-0d8b00676399 service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:02:55.706720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f29e58-e2f0-4083-8203-0d8b00676399 service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:02:55.706989 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f29e58-e2f0-4083-8203-0d8b00676399 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:02:55.715400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f29e58-e2f0-4083-8203-0d8b00676399 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:02:55.716964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f29e58-e2f0-4083-8203-0d8b00676399 service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:02:55.726143 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1160/2331] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:03:02.095298 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a939a3c-3021-455e-9383-f6b96ec95f8d None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:03:02.095815 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a939a3c-3021-455e-9383-f6b96ec95f8d None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:03:02.095915 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a939a3c-3021-455e-9383-f6b96ec95f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:03:02.103669 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=25 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:02.115630 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-1a939a3c-3021-455e-9383-f6b96ec95f8d None None] MFA Rules not processed for user `d6ea1e39eb2b47b5b29d63ed8a2d7990`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:03:02.116689 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-1a939a3c-3021-455e-9383-f6b96ec95f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:03:02.175383 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1172/2332] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:03:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:03:05.722050 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=17 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:12.168841 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=24 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:18.572739 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca54efa-ec7a-468a-b6d4-ef63cc2f29d1 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:03:18.572739 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca54efa-ec7a-468a-b6d4-ef63cc2f29d1 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:03:18.572739 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca54efa-ec7a-468a-b6d4-ef63cc2f29d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:03:18.587779 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-fca54efa-ec7a-468a-b6d4-ef63cc2f29d1 None None] MFA Rules not processed for user `e2508b9e971242f5b7f60b1261574539`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:03:18.588985 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-fca54efa-ec7a-468a-b6d4-ef63cc2f29d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:03:18.597566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1161/2333] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:03:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:03:22.789026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b114c-d178-4db7-90c5-3f06e1d95688 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:03:22.789538 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b114c-d178-4db7-90c5-3f06e1d95688 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:03:22.789637 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b114c-d178-4db7-90c5-3f06e1d95688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:03:22.810163 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-795b114c-d178-4db7-90c5-3f06e1d95688 None None] MFA Rules not processed for user `06ed3b08376e460087fafc4fccfdd2a9`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:03:22.811416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-795b114c-d178-4db7-90c5-3f06e1d95688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:03:22.878472 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1173/2334] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:03:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:03:28.582509 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:32.870772 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=25 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:03:38.125017 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be87eb9-f3a5-4c58-b8ea-a737fdbabadc None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:03:38.125558 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be87eb9-f3a5-4c58-b8ea-a737fdbabadc None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:03:38.125656 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be87eb9-f3a5-4c58-b8ea-a737fdbabadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:03:38.144663 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-3be87eb9-f3a5-4c58-b8ea-a737fdbabadc None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:03:38.145843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-3be87eb9-f3a5-4c58-b8ea-a737fdbabadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:03:38.154847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1162/2335] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Aug 11 10:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:03:38.176617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b114c-d178-4db7-90c5-3f06e1d95688 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:03:38.190555 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b114c-d178-4db7-90c5-3f06e1d95688 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:03:38.196553 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346692c-9d74-40b2-854e-42b8e338f9f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:03:38.197320 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346692c-9d74-40b2-854e-42b8e338f9f9 service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:03:38.197597 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346692c-9d74-40b2-854e-42b8e338f9f9 service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:03:38.197979 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346692c-9d74-40b2-854e-42b8e338f9f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:03:38.211258 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346692c-9d74-40b2-854e-42b8e338f9f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:03:38.213740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346692c-9d74-40b2-854e-42b8e338f9f9 service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:03:38.228760 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1174/2336] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:03:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:03:42.647536 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93649395-d687-42d8-bd4b-5038136de33a None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:03:42.648081 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93649395-d687-42d8-bd4b-5038136de33a None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:03:42.648081 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93649395-d687-42d8-bd4b-5038136de33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:03:42.669060 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-93649395-d687-42d8-bd4b-5038136de33a None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:03:42.670304 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-93649395-d687-42d8-bd4b-5038136de33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:03:42.679172 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1163/2337] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Aug 11 10:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:03:42.725911 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346692c-9d74-40b2-854e-42b8e338f9f9 service nova] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:03:42.737845 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346692c-9d74-40b2-854e-42b8e338f9f9 service nova] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:03:42.743360 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef098e1e-ad06-4604-8aa0-7671b57b0b15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:03:42.743949 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef098e1e-ad06-4604-8aa0-7671b57b0b15 service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:03:42.744223 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef098e1e-ad06-4604-8aa0-7671b57b0b15 service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:03:42.744684 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef098e1e-ad06-4604-8aa0-7671b57b0b15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:03:42.755009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef098e1e-ad06-4604-8aa0-7671b57b0b15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:03:42.757008 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef098e1e-ad06-4604-8aa0-7671b57b0b15 service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:03:42.766200 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1175/2338] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:03:46.565759 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49fa54-4e69-4183-a168-ced1e4bed9b0 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:03:46.567132 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49fa54-4e69-4183-a168-ced1e4bed9b0 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:03:46.567239 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49fa54-4e69-4183-a168-ced1e4bed9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:03:46.586117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-1f49fa54-4e69-4183-a168-ced1e4bed9b0 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:03:46.587281 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-1f49fa54-4e69-4183-a168-ced1e4bed9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:03:46.594926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1164/2339] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Aug 11 10:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:03:46.618187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef098e1e-ad06-4604-8aa0-7671b57b0b15 service nova] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:03:46.629684 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef098e1e-ad06-4604-8aa0-7671b57b0b15 service nova] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:03:46.638397 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34d0af-b046-4b84-86d2-538a139a3910 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:03:46.639009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34d0af-b046-4b84-86d2-538a139a3910 service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:03:46.639280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34d0af-b046-4b84-86d2-538a139a3910 service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:03:46.639550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34d0af-b046-4b84-86d2-538a139a3910 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:03:46.648116 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34d0af-b046-4b84-86d2-538a139a3910 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:03:46.649668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34d0af-b046-4b84-86d2-538a139a3910 service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:03:46.659410 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1176/2340] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:03:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:03:49.798625 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d621a3-011c-4640-9653-791cb05b97f3 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:03:49.799165 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d621a3-011c-4640-9653-791cb05b97f3 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:03:49.799165 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d621a3-011c-4640-9653-791cb05b97f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:03:49.819690 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-37d621a3-011c-4640-9653-791cb05b97f3 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:03:49.820955 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-37d621a3-011c-4640-9653-791cb05b97f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:03:49.830028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1165/2341] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Aug 11 10:03:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:03:49.866572 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34d0af-b046-4b84-86d2-538a139a3910 service nova] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:03:49.877412 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34d0af-b046-4b84-86d2-538a139a3910 service nova] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:03:49.882886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a1308-81c3-4eec-80bc-c6e36785fdb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:03:49.883520 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a1308-81c3-4eec-80bc-c6e36785fdb8 service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:03:49.883790 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a1308-81c3-4eec-80bc-c6e36785fdb8 service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:03:49.884056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a1308-81c3-4eec-80bc-c6e36785fdb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:03:49.891965 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a1308-81c3-4eec-80bc-c6e36785fdb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:03:49.893506 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a1308-81c3-4eec-80bc-c6e36785fdb8 service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:03:49.902648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1177/2342] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:03:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:03:49.933117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1ea8b-c930-4a16-9331-9bda1ee85199 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:03:49.933399 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1ea8b-c930-4a16-9331-9bda1ee85199 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:03:49.933665 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1ea8b-c930-4a16-9331-9bda1ee85199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:03:49.953570 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-65b1ea8b-c930-4a16-9331-9bda1ee85199 None None] MFA Rules not processed for user `20bf487c5b8e490da15060ea798a83ca`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:03:49.954782 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-65b1ea8b-c930-4a16-9331-9bda1ee85199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:03:49.962488 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1166/2343] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:03:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:03:54.080510 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd08d0-4a8b-4677-84a1-ed4ab30aaa06 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:03:54.081477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd08d0-4a8b-4677-84a1-ed4ab30aaa06 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:03:54.081751 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd08d0-4a8b-4677-84a1-ed4ab30aaa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:03:54.103458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-3acd08d0-4a8b-4677-84a1-ed4ab30aaa06 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:03:54.104738 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-3acd08d0-4a8b-4677-84a1-ed4ab30aaa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:03:54.112857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1178/2344] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Aug 11 10:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:03:54.138126 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1ea8b-c930-4a16-9331-9bda1ee85199 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:03:54.151007 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1ea8b-c930-4a16-9331-9bda1ee85199 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:03:54.156276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d75c2c-d417-4002-a4f6-89b49d7c2d66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:03:54.156874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d75c2c-d417-4002-a4f6-89b49d7c2d66 service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:03:54.157153 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d75c2c-d417-4002-a4f6-89b49d7c2d66 service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:03:54.157443 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d75c2c-d417-4002-a4f6-89b49d7c2d66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:03:54.166564 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d75c2c-d417-4002-a4f6-89b49d7c2d66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:03:54.168307 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d75c2c-d417-4002-a4f6-89b49d7c2d66 service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:03:54.183378 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1167/2345] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:03:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:04:04.098475 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=27 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:04.176006 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=21 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:06.385447 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd08d0-4a8b-4677-84a1-ed4ab30aaa06 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:06.397704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd08d0-4a8b-4677-84a1-ed4ab30aaa06 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:06.403219 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248999c-643f-4eac-bb44-3fe105c61538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:06.404340 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248999c-643f-4eac-bb44-3fe105c61538 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:06.404867 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248999c-643f-4eac-bb44-3fe105c61538 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:06.405300 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248999c-643f-4eac-bb44-3fe105c61538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:06.407547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-d248999c-643f-4eac-bb44-3fe105c61538 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:06.425889 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248999c-643f-4eac-bb44-3fe105c61538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:06.429330 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248999c-643f-4eac-bb44-3fe105c61538 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:06.443843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1179/2346] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:04:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:04:13.666550 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d75c2c-d417-4002-a4f6-89b49d7c2d66 service nova] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:13.677370 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d75c2c-d417-4002-a4f6-89b49d7c2d66 service nova] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:13.682646 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936a5fb-b426-43ba-9d6a-0ae6e4bde97f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:13.683352 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936a5fb-b426-43ba-9d6a-0ae6e4bde97f service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:13.683906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936a5fb-b426-43ba-9d6a-0ae6e4bde97f service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:13.684317 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936a5fb-b426-43ba-9d6a-0ae6e4bde97f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:13.686548 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-b936a5fb-b426-43ba-9d6a-0ae6e4bde97f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:13.702240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936a5fb-b426-43ba-9d6a-0ae6e4bde97f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:13.703602 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936a5fb-b426-43ba-9d6a-0ae6e4bde97f service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:13.715407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1168/2347] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:04:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:04:16.438347 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=6 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:16.834994 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1c22e-d56b-42bc-9ede-4ce6fd9aac25 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:16.835272 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1c22e-d56b-42bc-9ede-4ce6fd9aac25 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:16.835563 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1c22e-d56b-42bc-9ede-4ce6fd9aac25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:16.856053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-19c1c22e-d56b-42bc-9ede-4ce6fd9aac25 None None] MFA Rules not processed for user `211b0ba5012f4e0f8ab1c850d4ebdfaf`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:04:16.857387 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-19c1c22e-d56b-42bc-9ede-4ce6fd9aac25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:16.912916 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1180/2348] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:04:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:04:17.846293 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936a5fb-b426-43ba-9d6a-0ae6e4bde97f service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:17.860102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936a5fb-b426-43ba-9d6a-0ae6e4bde97f service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:17.863895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94049bc5-2196-44d9-9cb0-64b072c66bba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:17.864524 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94049bc5-2196-44d9-9cb0-64b072c66bba service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:17.864802 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94049bc5-2196-44d9-9cb0-64b072c66bba service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:17.865071 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94049bc5-2196-44d9-9cb0-64b072c66bba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:17.866939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-94049bc5-2196-44d9-9cb0-64b072c66bba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:17.878222 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94049bc5-2196-44d9-9cb0-64b072c66bba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:17.879642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94049bc5-2196-44d9-9cb0-64b072c66bba service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:17.888624 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1169/2349] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:04:17 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:04:24.727495 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1c22e-d56b-42bc-9ede-4ce6fd9aac25 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:24.742032 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1c22e-d56b-42bc-9ede-4ce6fd9aac25 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:24.748252 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b611f51-73e5-4155-a0ae-e17d9aa5ef81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:24.748846 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b611f51-73e5-4155-a0ae-e17d9aa5ef81 service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:24.749120 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b611f51-73e5-4155-a0ae-e17d9aa5ef81 service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:24.749384 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b611f51-73e5-4155-a0ae-e17d9aa5ef81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:24.751314 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-5b611f51-73e5-4155-a0ae-e17d9aa5ef81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:24.762513 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b611f51-73e5-4155-a0ae-e17d9aa5ef81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:24.764147 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b611f51-73e5-4155-a0ae-e17d9aa5ef81 service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:24.773130 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1181/2350] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:04:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:04:27.884474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=12 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:30.360940 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94049bc5-2196-44d9-9cb0-64b072c66bba service cinder] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:30.370030 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94049bc5-2196-44d9-9cb0-64b072c66bba service cinder] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:30.373730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f111bd-03af-4f01-b662-1a568d9b11f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:30.374376 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f111bd-03af-4f01-b662-1a568d9b11f8 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:30.374652 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f111bd-03af-4f01-b662-1a568d9b11f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:30.374920 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f111bd-03af-4f01-b662-1a568d9b11f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:30.379584 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-59f111bd-03af-4f01-b662-1a568d9b11f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:30.388667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f111bd-03af-4f01-b662-1a568d9b11f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:30.390161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f111bd-03af-4f01-b662-1a568d9b11f8 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:30.401738 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1170/2351] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:04:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:04:34.092325 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b611f51-73e5-4155-a0ae-e17d9aa5ef81 service nova] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:34.093845 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-5b611f51-73e5-4155-a0ae-e17d9aa5ef81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:34.108465 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b611f51-73e5-4155-a0ae-e17d9aa5ef81 service nova] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:34.119101 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f576a-4898-4b9f-9789-0b07aab612a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:34.120476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f576a-4898-4b9f-9789-0b07aab612a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:34.120765 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f576a-4898-4b9f-9789-0b07aab612a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:34.121221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f576a-4898-4b9f-9789-0b07aab612a4 admin admin] PATH_INFO: `/v3/users/d6ea1e39eb2b47b5b29d63ed8a2d7990` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:34.122486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f576a-4898-4b9f-9789-0b07aab612a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6ea1e39eb2b47b5b29d63ed8a2d7990)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:34.124414 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f576a-4898-4b9f-9789-0b07aab612a4 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:34.134726 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f111bd-03af-4f01-b662-1a568d9b11f8 service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:34.144180 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f111bd-03af-4f01-b662-1a568d9b11f8 service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:34.149503 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786784b7-457a-48f5-af1a-4b7727daed74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:34.150537 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786784b7-457a-48f5-af1a-4b7727daed74 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:34.150923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786784b7-457a-48f5-af1a-4b7727daed74 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:34.151341 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786784b7-457a-48f5-af1a-4b7727daed74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:34.153294 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-786784b7-457a-48f5-af1a-4b7727daed74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:34.163723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786784b7-457a-48f5-af1a-4b7727daed74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:34.165250 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786784b7-457a-48f5-af1a-4b7727daed74 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:34.173998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1171/2352] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:04:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:04:34.281477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-1f0f576a-4898-4b9f-9789-0b07aab612a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6ea1e39eb2b47b5b29d63ed8a2d7990'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:34.296008 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-1f0f576a-4898-4b9f-9789-0b07aab612a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6ea1e39eb2b47b5b29d63ed8a2d7990'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:34.296719 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-1f0f576a-4898-4b9f-9789-0b07aab612a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6ea1e39eb2b47b5b29d63ed8a2d7990'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:34.297330 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-1f0f576a-4898-4b9f-9789-0b07aab612a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6ea1e39eb2b47b5b29d63ed8a2d7990'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:34.304851 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-1f0f576a-4898-4b9f-9789-0b07aab612a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6ea1e39eb2b47b5b29d63ed8a2d7990'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:34.386490 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1182/2353] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:04:34 2022] DELETE /identity/v3/users/d6ea1e39eb2b47b5b29d63ed8a2d7990 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:04:34.785178 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786784b7-457a-48f5-af1a-4b7727daed74 service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:34.797058 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786784b7-457a-48f5-af1a-4b7727daed74 service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:34.858829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38a800-e000-4965-b8e0-a7fc46c60a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:34.859448 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38a800-e000-4965-b8e0-a7fc46c60a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:34.859722 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38a800-e000-4965-b8e0-a7fc46c60a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:34.859992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38a800-e000-4965-b8e0-a7fc46c60a21 admin admin] PATH_INFO: `/v3/projects/103b459c84b84542a1542d3af83b91ab` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:34.861139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a38a800-e000-4965-b8e0-a7fc46c60a21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=103b459c84b84542a1542d3af83b91ab)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:34.863073 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a38a800-e000-4965-b8e0-a7fc46c60a21 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:34.959534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f576a-4898-4b9f-9789-0b07aab612a4 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:34.961248 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-1f0f576a-4898-4b9f-9789-0b07aab612a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:34.980511 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f576a-4898-4b9f-9789-0b07aab612a4 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:34.983057 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d7337-1310-44fe-9756-fee42ff57e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:34.983769 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d7337-1310-44fe-9756-fee42ff57e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:34.983967 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d7337-1310-44fe-9756-fee42ff57e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:34.984233 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d7337-1310-44fe-9756-fee42ff57e77 admin admin] PATH_INFO: `/v3/users/e2508b9e971242f5b7f60b1261574539` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:34.985568 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d7337-1310-44fe-9756-fee42ff57e77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2508b9e971242f5b7f60b1261574539)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:34.987745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d7337-1310-44fe-9756-fee42ff57e77 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:35.001415 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-0a38a800-e000-4965-b8e0-a7fc46c60a21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '103b459c84b84542a1542d3af83b91ab', 'request_id': 'req-0a38a800-e000-4965-b8e0-a7fc46c60a21'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:35.009063 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-0a38a800-e000-4965-b8e0-a7fc46c60a21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '103b459c84b84542a1542d3af83b91ab', 'request_id': 'req-0a38a800-e000-4965-b8e0-a7fc46c60a21'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:35.017483 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-0a38a800-e000-4965-b8e0-a7fc46c60a21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '103b459c84b84542a1542d3af83b91ab', 'request_id': 'req-0a38a800-e000-4965-b8e0-a7fc46c60a21'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:35.100225 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-0a38a800-e000-4965-b8e0-a7fc46c60a21 admin admin] The token cache is being invalidate because project 103b459c84b84542a1542d3af83b91ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:04:35.100510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-0a38a800-e000-4965-b8e0-a7fc46c60a21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:35.101128 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-0a38a800-e000-4965-b8e0-a7fc46c60a21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:35.102632 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1172/2354] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:04:34 2022] DELETE /identity/v3/projects/103b459c84b84542a1542d3af83b91ab => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:04:35.107459 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa6197-fbfe-4794-b3a1-9e6945419acf None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:35.107756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa6197-fbfe-4794-b3a1-9e6945419acf None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:35.108022 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa6197-fbfe-4794-b3a1-9e6945419acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:35.126995 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-49aa6197-fbfe-4794-b3a1-9e6945419acf None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:04:35.128175 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-49aa6197-fbfe-4794-b3a1-9e6945419acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:35.165302 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-211d7337-1310-44fe-9756-fee42ff57e77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2508b9e971242f5b7f60b1261574539'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:35.173183 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:35.177804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-211d7337-1310-44fe-9756-fee42ff57e77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2508b9e971242f5b7f60b1261574539'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:35.178562 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-211d7337-1310-44fe-9756-fee42ff57e77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2508b9e971242f5b7f60b1261574539'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:35.179167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-211d7337-1310-44fe-9756-fee42ff57e77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2508b9e971242f5b7f60b1261574539'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:35.186559 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-211d7337-1310-44fe-9756-fee42ff57e77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2508b9e971242f5b7f60b1261574539'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:35.187099 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1173/2355] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:04:35.194447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909db496-27e2-4bd5-be56-5114cc796835 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:35.194934 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909db496-27e2-4bd5-be56-5114cc796835 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:35.195227 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909db496-27e2-4bd5-be56-5114cc796835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:35.205146 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:35.218314 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-909db496-27e2-4bd5-be56-5114cc796835 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:04:35.218314 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-909db496-27e2-4bd5-be56-5114cc796835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:35.224389 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1174/2356] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:04:35.228837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909db496-27e2-4bd5-be56-5114cc796835 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:35.238235 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909db496-27e2-4bd5-be56-5114cc796835 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:35.242932 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1918916-f2e1-4012-b598-7e66f1f30d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:35.247127 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1918916-f2e1-4012-b598-7e66f1f30d7c admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:35.247127 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1918916-f2e1-4012-b598-7e66f1f30d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:35.247127 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1918916-f2e1-4012-b598-7e66f1f30d7c admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:35.247127 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1918916-f2e1-4012-b598-7e66f1f30d7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:04:35.247127 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1918916-f2e1-4012-b598-7e66f1f30d7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:35.247756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1918916-f2e1-4012-b598-7e66f1f30d7c admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:35.262723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1175/2357] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:04:35.264741 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1918916-f2e1-4012-b598-7e66f1f30d7c admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:35.267613 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1183/2358] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:04:34 2022] DELETE /identity/v3/users/e2508b9e971242f5b7f60b1261574539 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:04:35.284317 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1918916-f2e1-4012-b598-7e66f1f30d7c admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:35.353019 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a77d1-ecb0-468f-821c-4fadbdf81aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:35.353892 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a77d1-ecb0-468f-821c-4fadbdf81aba admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:35.354183 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a77d1-ecb0-468f-821c-4fadbdf81aba admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:35.355116 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a77d1-ecb0-468f-821c-4fadbdf81aba admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:35.355894 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a77d1-ecb0-468f-821c-4fadbdf81aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:35.363361 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a77d1-ecb0-468f-821c-4fadbdf81aba admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:35.447810 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1176/2359] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:04:35 2022] POST /identity/v3/projects => generated 373 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:04:35.452336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d7337-1310-44fe-9756-fee42ff57e77 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:35.463297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d7337-1310-44fe-9756-fee42ff57e77 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:35.519413 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afa42b-cc20-4b60-9ff6-ac0e373bfd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:35.520208 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afa42b-cc20-4b60-9ff6-ac0e373bfd4a admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:35.520541 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afa42b-cc20-4b60-9ff6-ac0e373bfd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:35.520814 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afa42b-cc20-4b60-9ff6-ac0e373bfd4a admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:35.524348 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afa42b-cc20-4b60-9ff6-ac0e373bfd4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:35.526698 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a77d1-ecb0-468f-821c-4fadbdf81aba admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:35.526836 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afa42b-cc20-4b60-9ff6-ac0e373bfd4a admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:35.527015 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-9c7a77d1-ecb0-468f-821c-4fadbdf81aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:35.539950 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a77d1-ecb0-468f-821c-4fadbdf81aba admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:35.545351 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b7b3d-47b7-4b73-b1e0-4fdb430a31ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:35.546061 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b7b3d-47b7-4b73-b1e0-4fdb430a31ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:35.546428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b7b3d-47b7-4b73-b1e0-4fdb430a31ec admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:35.546758 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b7b3d-47b7-4b73-b1e0-4fdb430a31ec admin admin] PATH_INFO: `/v3/projects/04cdb9c3b2dd489ab204a8b1863511b0` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:35.547926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b7b3d-47b7-4b73-b1e0-4fdb430a31ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=04cdb9c3b2dd489ab204a8b1863511b0)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:35.549993 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b7b3d-47b7-4b73-b1e0-4fdb430a31ec admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:35.609925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1184/2360] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:04:35 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:04:35.613774 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afa42b-cc20-4b60-9ff6-ac0e373bfd4a admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:35.624013 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afa42b-cc20-4b60-9ff6-ac0e373bfd4a admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:35.628491 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0132aa-cae3-431f-862d-9c930355ae73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:35.629062 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0132aa-cae3-431f-862d-9c930355ae73 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:35.629338 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0132aa-cae3-431f-862d-9c930355ae73 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:35.629607 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0132aa-cae3-431f-862d-9c930355ae73 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:35.630397 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0132aa-cae3-431f-862d-9c930355ae73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:35.631863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0132aa-cae3-431f-862d-9c930355ae73 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:35.641833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1185/2361] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:04:35.645634 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0132aa-cae3-431f-862d-9c930355ae73 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:35.655047 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0132aa-cae3-431f-862d-9c930355ae73 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:35.659643 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1230a-a30d-4a11-871a-e22929fbd082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:35.660220 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1230a-a30d-4a11-871a-e22929fbd082 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:35.660495 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1230a-a30d-4a11-871a-e22929fbd082 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:35.660763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1230a-a30d-4a11-871a-e22929fbd082 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:35.661401 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1230a-a30d-4a11-871a-e22929fbd082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:35.662980 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1230a-a30d-4a11-871a-e22929fbd082 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:35.674454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1186/2362] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:04:35.678697 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1230a-a30d-4a11-871a-e22929fbd082 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:35.678960 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-667b7b3d-47b7-4b73-b1e0-4fdb430a31ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04cdb9c3b2dd489ab204a8b1863511b0', 'request_id': 'req-667b7b3d-47b7-4b73-b1e0-4fdb430a31ec'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:35.685104 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-667b7b3d-47b7-4b73-b1e0-4fdb430a31ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04cdb9c3b2dd489ab204a8b1863511b0', 'request_id': 'req-667b7b3d-47b7-4b73-b1e0-4fdb430a31ec'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:35.689821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1230a-a30d-4a11-871a-e22929fbd082 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:35.691286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-667b7b3d-47b7-4b73-b1e0-4fdb430a31ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04cdb9c3b2dd489ab204a8b1863511b0', 'request_id': 'req-667b7b3d-47b7-4b73-b1e0-4fdb430a31ec'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:35.746580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85949334-3400-49b8-a104-a8aa49235961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:35.747249 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85949334-3400-49b8-a104-a8aa49235961 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:35.747521 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85949334-3400-49b8-a104-a8aa49235961 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:35.747808 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85949334-3400-49b8-a104-a8aa49235961 admin admin] PATH_INFO: `/v3/projects/1b20794629cb4c0aa0205bfcd790b178/users/c65c1d5a3c974b238c7342cac3f48718/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:35.751941 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-667b7b3d-47b7-4b73-b1e0-4fdb430a31ec admin admin] The token cache is being invalidate because project 04cdb9c3b2dd489ab204a8b1863511b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:04:35.752226 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-667b7b3d-47b7-4b73-b1e0-4fdb430a31ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:35.752862 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-667b7b3d-47b7-4b73-b1e0-4fdb430a31ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:35.754411 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1177/2363] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:04:35 2022] DELETE /identity/v3/projects/04cdb9c3b2dd489ab204a8b1863511b0 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:04:35.772235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85949334-3400-49b8-a104-a8aa49235961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b20794629cb4c0aa0205bfcd790b178, user_id=c65c1d5a3c974b238c7342cac3f48718, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:35.775272 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85949334-3400-49b8-a104-a8aa49235961 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:35.862416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1187/2364] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:04:35 2022] PUT /identity/v3/projects/1b20794629cb4c0aa0205bfcd790b178/users/c65c1d5a3c974b238c7342cac3f48718/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:04:35.874062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253ef80-c06d-4091-8eed-b26152a031f0 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:35.874481 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253ef80-c06d-4091-8eed-b26152a031f0 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:35.874755 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253ef80-c06d-4091-8eed-b26152a031f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:35.906868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-1253ef80-c06d-4091-8eed-b26152a031f0 None None] MFA Rules not processed for user `c65c1d5a3c974b238c7342cac3f48718`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:04:35.908453 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-1253ef80-c06d-4091-8eed-b26152a031f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:35.955867 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:35.979029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1178/2365] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:04:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:04:35.990933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85949334-3400-49b8-a104-a8aa49235961 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:35.992876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-85949334-3400-49b8-a104-a8aa49235961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:36.024869 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:36.068252 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85949334-3400-49b8-a104-a8aa49235961 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:36.074753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49be38-f026-4c0a-836d-5b320bd6e0e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:36.075562 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49be38-f026-4c0a-836d-5b320bd6e0e1 service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:36.075930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49be38-f026-4c0a-836d-5b320bd6e0e1 service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:36.076267 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49be38-f026-4c0a-836d-5b320bd6e0e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:36.085840 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49be38-f026-4c0a-836d-5b320bd6e0e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:36.089317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49be38-f026-4c0a-836d-5b320bd6e0e1 service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:36.097574 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1188/2366] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:04:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:04:37.857737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253ef80-c06d-4091-8eed-b26152a031f0 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:37.870600 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253ef80-c06d-4091-8eed-b26152a031f0 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:37.878048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe0745-35d1-4096-829b-555552fdb582 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:37.878339 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe0745-35d1-4096-829b-555552fdb582 service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:37.878639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe0745-35d1-4096-829b-555552fdb582 service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:37.878839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe0745-35d1-4096-829b-555552fdb582 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:37.884005 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-9bbe0745-35d1-4096-829b-555552fdb582 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:37.910499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe0745-35d1-4096-829b-555552fdb582 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:37.912135 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe0745-35d1-4096-829b-555552fdb582 service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:37.926949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1179/2367] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:04:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:04:39.378278 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49be38-f026-4c0a-836d-5b320bd6e0e1 service nova] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:39.378800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-0e49be38-f026-4c0a-836d-5b320bd6e0e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:39.443067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49be38-f026-4c0a-836d-5b320bd6e0e1 service nova] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:39.447790 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae4d81-e5fc-48de-85c9-7387fd7810b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:39.448930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae4d81-e5fc-48de-85c9-7387fd7810b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:39.449206 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae4d81-e5fc-48de-85c9-7387fd7810b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:39.449474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae4d81-e5fc-48de-85c9-7387fd7810b3 admin admin] PATH_INFO: `/v3/users/c65c1d5a3c974b238c7342cac3f48718` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:39.451237 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae4d81-e5fc-48de-85c9-7387fd7810b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c65c1d5a3c974b238c7342cac3f48718)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:39.453209 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae4d81-e5fc-48de-85c9-7387fd7810b3 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:39.589893 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-79ae4d81-e5fc-48de-85c9-7387fd7810b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c65c1d5a3c974b238c7342cac3f48718'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:39.602056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-79ae4d81-e5fc-48de-85c9-7387fd7810b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c65c1d5a3c974b238c7342cac3f48718'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:39.602667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-79ae4d81-e5fc-48de-85c9-7387fd7810b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c65c1d5a3c974b238c7342cac3f48718'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:39.603252 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-79ae4d81-e5fc-48de-85c9-7387fd7810b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c65c1d5a3c974b238c7342cac3f48718'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:39.610453 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-79ae4d81-e5fc-48de-85c9-7387fd7810b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c65c1d5a3c974b238c7342cac3f48718'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:39.661367 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1189/2368] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:04:39 2022] DELETE /identity/v3/users/c65c1d5a3c974b238c7342cac3f48718 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:04:39.686788 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3fdb3-f5c8-46a5-8b42-8e8b3e510c1b None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:39.687744 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3fdb3-f5c8-46a5-8b42-8e8b3e510c1b None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:39.688021 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3fdb3-f5c8-46a5-8b42-8e8b3e510c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:39.709114 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-13c3fdb3-f5c8-46a5-8b42-8e8b3e510c1b None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:04:39.710373 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-13c3fdb3-f5c8-46a5-8b42-8e8b3e510c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:39.780359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1180/2369] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:04:39.790248 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae4d81-e5fc-48de-85c9-7387fd7810b3 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:39.791859 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-79ae4d81-e5fc-48de-85c9-7387fd7810b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:39.829525 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:39.852049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae4d81-e5fc-48de-85c9-7387fd7810b3 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:39.856067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e5e97-f954-45b9-90ca-53050d7fc03b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:39.856657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e5e97-f954-45b9-90ca-53050d7fc03b service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:39.856930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e5e97-f954-45b9-90ca-53050d7fc03b service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:39.857196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e5e97-f954-45b9-90ca-53050d7fc03b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:39.866766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e5e97-f954-45b9-90ca-53050d7fc03b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:39.868250 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e5e97-f954-45b9-90ca-53050d7fc03b service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:39.878375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1190/2370] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:04:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:04:40.285546 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3fdb3-f5c8-46a5-8b42-8e8b3e510c1b None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:40.287177 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-13c3fdb3-f5c8-46a5-8b42-8e8b3e510c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:40.301136 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3fdb3-f5c8-46a5-8b42-8e8b3e510c1b None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:40.305702 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a3457-f8b0-4f36-87c2-0a606362d3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:40.306360 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a3457-f8b0-4f36-87c2-0a606362d3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:40.306638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a3457-f8b0-4f36-87c2-0a606362d3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:40.306904 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a3457-f8b0-4f36-87c2-0a606362d3e4 admin admin] PATH_INFO: `/v3/projects/1b20794629cb4c0aa0205bfcd790b178` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:40.308126 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a3457-f8b0-4f36-87c2-0a606362d3e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b20794629cb4c0aa0205bfcd790b178)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:40.310063 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a3457-f8b0-4f36-87c2-0a606362d3e4 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:40.425633 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-dd1a3457-f8b0-4f36-87c2-0a606362d3e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b20794629cb4c0aa0205bfcd790b178', 'request_id': 'req-dd1a3457-f8b0-4f36-87c2-0a606362d3e4'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:40.431102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-dd1a3457-f8b0-4f36-87c2-0a606362d3e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b20794629cb4c0aa0205bfcd790b178', 'request_id': 'req-dd1a3457-f8b0-4f36-87c2-0a606362d3e4'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:40.437182 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-dd1a3457-f8b0-4f36-87c2-0a606362d3e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b20794629cb4c0aa0205bfcd790b178', 'request_id': 'req-dd1a3457-f8b0-4f36-87c2-0a606362d3e4'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:40.534614 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-dd1a3457-f8b0-4f36-87c2-0a606362d3e4 admin admin] The token cache is being invalidate because project 1b20794629cb4c0aa0205bfcd790b178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:04:40.534903 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-dd1a3457-f8b0-4f36-87c2-0a606362d3e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:40.535529 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-dd1a3457-f8b0-4f36-87c2-0a606362d3e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:04:40.537041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1181/2371] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:04:40 2022] DELETE /identity/v3/projects/1b20794629cb4c0aa0205bfcd790b178 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:04:40.542072 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314f26b-73b4-430c-9dc3-b5afb3c1cddd None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:40.543154 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314f26b-73b4-430c-9dc3-b5afb3c1cddd None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:40.543279 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314f26b-73b4-430c-9dc3-b5afb3c1cddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:40.562801 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-2314f26b-73b4-430c-9dc3-b5afb3c1cddd None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:04:40.567754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-2314f26b-73b4-430c-9dc3-b5afb3c1cddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:40.622301 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1191/2372] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:04:40.630219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bf574-d788-4dc7-952a-5e682ff0ef1b None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:40.630507 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bf574-d788-4dc7-952a-5e682ff0ef1b None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:40.630781 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bf574-d788-4dc7-952a-5e682ff0ef1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:40.650628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-9f7bf574-d788-4dc7-952a-5e682ff0ef1b None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:04:40.652424 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-9f7bf574-d788-4dc7-952a-5e682ff0ef1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:40.660331 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1182/2373] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:04:40.664573 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314f26b-73b4-430c-9dc3-b5afb3c1cddd None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:40.674346 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314f26b-73b4-430c-9dc3-b5afb3c1cddd None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:40.678946 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e85d0d-5da8-4879-ad63-6118e9716d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:40.679483 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e85d0d-5da8-4879-ad63-6118e9716d6e admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:40.679763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e85d0d-5da8-4879-ad63-6118e9716d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:40.680053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e85d0d-5da8-4879-ad63-6118e9716d6e admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:40.680672 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e85d0d-5da8-4879-ad63-6118e9716d6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:04:40.680971 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e85d0d-5da8-4879-ad63-6118e9716d6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:40.682590 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e85d0d-5da8-4879-ad63-6118e9716d6e admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:40.694333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1192/2374] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:04:40.699023 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7bf574-d788-4dc7-952a-5e682ff0ef1b None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:40.708493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7bf574-d788-4dc7-952a-5e682ff0ef1b None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:40.713180 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8135eeb-366f-4eef-9876-2808ce3c471c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:40.713808 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8135eeb-366f-4eef-9876-2808ce3c471c admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:40.714754 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8135eeb-366f-4eef-9876-2808ce3c471c admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:40.715027 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8135eeb-366f-4eef-9876-2808ce3c471c admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:40.715644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8135eeb-366f-4eef-9876-2808ce3c471c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:40.717540 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8135eeb-366f-4eef-9876-2808ce3c471c admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:40.808608 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1183/2375] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:04:40 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:04:40.809842 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e85d0d-5da8-4879-ad63-6118e9716d6e admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:40.820256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e85d0d-5da8-4879-ad63-6118e9716d6e admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:40.896908 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14452271-df4d-4933-99fb-ce4ec5402c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:40.897528 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14452271-df4d-4933-99fb-ce4ec5402c0d admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:40.897809 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14452271-df4d-4933-99fb-ce4ec5402c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:40.898101 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14452271-df4d-4933-99fb-ce4ec5402c0d admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:40.898722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14452271-df4d-4933-99fb-ce4ec5402c0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:40.900683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14452271-df4d-4933-99fb-ce4ec5402c0d admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:41.026722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1193/2376] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:04:40 2022] POST /identity/v3/users => generated 286 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:04:41.034863 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8135eeb-366f-4eef-9876-2808ce3c471c admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:41.045082 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8135eeb-366f-4eef-9876-2808ce3c471c admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:41.049730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abb87f-14cd-4f5a-8bde-922a5112b77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:41.050384 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abb87f-14cd-4f5a-8bde-922a5112b77b admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:41.050662 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abb87f-14cd-4f5a-8bde-922a5112b77b admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:41.050932 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abb87f-14cd-4f5a-8bde-922a5112b77b admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:41.051594 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abb87f-14cd-4f5a-8bde-922a5112b77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:41.053192 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abb87f-14cd-4f5a-8bde-922a5112b77b admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:41.067716 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1184/2377] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:04:41.072024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14452271-df4d-4933-99fb-ce4ec5402c0d admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:41.083093 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14452271-df4d-4933-99fb-ce4ec5402c0d admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:41.087765 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3102951-92d5-4221-a6d4-b55d82af3f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:41.088359 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3102951-92d5-4221-a6d4-b55d82af3f77 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:41.095149 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3102951-92d5-4221-a6d4-b55d82af3f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:41.095149 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3102951-92d5-4221-a6d4-b55d82af3f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:41.095149 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3102951-92d5-4221-a6d4-b55d82af3f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:41.095149 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3102951-92d5-4221-a6d4-b55d82af3f77 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:41.101678 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1194/2378] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:04:41.106175 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abb87f-14cd-4f5a-8bde-922a5112b77b admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:41.116159 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abb87f-14cd-4f5a-8bde-922a5112b77b admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:41.121161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83e387-f420-4435-bac8-55ece02d79ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:41.121799 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83e387-f420-4435-bac8-55ece02d79ee admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:41.122165 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83e387-f420-4435-bac8-55ece02d79ee admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:41.122380 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83e387-f420-4435-bac8-55ece02d79ee admin admin] PATH_INFO: `/v3/projects/9bdc35318fb94e28873db6786cc9cede/users/2d4f83b02bca4732a195c6ae978c8e97/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:41.133439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:41.137835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83e387-f420-4435-bac8-55ece02d79ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bdc35318fb94e28873db6786cc9cede, user_id=2d4f83b02bca4732a195c6ae978c8e97, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:41.140560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83e387-f420-4435-bac8-55ece02d79ee admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:41.209864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1185/2379] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:04:41 2022] PUT /identity/v3/projects/9bdc35318fb94e28873db6786cc9cede/users/2d4f83b02bca4732a195c6ae978c8e97/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:04:41.220665 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5d69c-0902-40b9-a8ac-e7292fbc5ae1 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:41.220942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5d69c-0902-40b9-a8ac-e7292fbc5ae1 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:41.221208 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5d69c-0902-40b9-a8ac-e7292fbc5ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:41.248291 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-81c5d69c-0902-40b9-a8ac-e7292fbc5ae1 None None] MFA Rules not processed for user `2d4f83b02bca4732a195c6ae978c8e97`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:04:41.249482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-81c5d69c-0902-40b9-a8ac-e7292fbc5ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:41.278630 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:41.313180 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1195/2380] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:04:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:04:41.317812 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83e387-f420-4435-bac8-55ece02d79ee admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:41.380952 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83e387-f420-4435-bac8-55ece02d79ee admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:41.391697 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9903e2-c2f7-430a-a861-38d7ab7fa1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:41.392317 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9903e2-c2f7-430a-a861-38d7ab7fa1f3 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:41.392593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9903e2-c2f7-430a-a861-38d7ab7fa1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:41.392861 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9903e2-c2f7-430a-a861-38d7ab7fa1f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:41.393502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9903e2-c2f7-430a-a861-38d7ab7fa1f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:41.395449 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9903e2-c2f7-430a-a861-38d7ab7fa1f3 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:41.478938 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1186/2381] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:04:41 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:04:41.484815 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5d69c-0902-40b9-a8ac-e7292fbc5ae1 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:41.497697 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5d69c-0902-40b9-a8ac-e7292fbc5ae1 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:41.552733 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb4a3f-7b4c-4b79-bded-24a01d7c2703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:41.553409 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb4a3f-7b4c-4b79-bded-24a01d7c2703 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:41.553602 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb4a3f-7b4c-4b79-bded-24a01d7c2703 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:41.553872 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb4a3f-7b4c-4b79-bded-24a01d7c2703 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:41.554532 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb4a3f-7b4c-4b79-bded-24a01d7c2703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:41.556469 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb4a3f-7b4c-4b79-bded-24a01d7c2703 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:41.631703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1196/2382] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:04:41 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:04:41.635793 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9903e2-c2f7-430a-a861-38d7ab7fa1f3 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:41.648956 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9903e2-c2f7-430a-a861-38d7ab7fa1f3 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:41.654445 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e5e7c-a9a2-4f6d-b3ed-ca830ef198c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:41.655054 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e5e7c-a9a2-4f6d-b3ed-ca830ef198c0 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:41.655332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e5e7c-a9a2-4f6d-b3ed-ca830ef198c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:41.655615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e5e7c-a9a2-4f6d-b3ed-ca830ef198c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:41.656250 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e5e7c-a9a2-4f6d-b3ed-ca830ef198c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:41.657885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e5e7c-a9a2-4f6d-b3ed-ca830ef198c0 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:41.668702 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1187/2383] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:04:41.673071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb4a3f-7b4c-4b79-bded-24a01d7c2703 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:41.683255 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb4a3f-7b4c-4b79-bded-24a01d7c2703 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:41.690261 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f1569-5f22-46fb-87cc-6ea2bd5f9fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:41.690930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f1569-5f22-46fb-87cc-6ea2bd5f9fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:41.691199 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f1569-5f22-46fb-87cc-6ea2bd5f9fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:41.691484 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f1569-5f22-46fb-87cc-6ea2bd5f9fc5 admin admin] PATH_INFO: `/v3/projects/aacc9dfafd524188a14b5e89d3fd3317/users/3986b2b70b564c0682c1721e1d060fa4/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:41.712823 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f1569-5f22-46fb-87cc-6ea2bd5f9fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aacc9dfafd524188a14b5e89d3fd3317, user_id=3986b2b70b564c0682c1721e1d060fa4, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:41.716286 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f1569-5f22-46fb-87cc-6ea2bd5f9fc5 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:41.780827 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1197/2384] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:04:41 2022] PUT /identity/v3/projects/aacc9dfafd524188a14b5e89d3fd3317/users/3986b2b70b564c0682c1721e1d060fa4/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:04:41.785008 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e5e7c-a9a2-4f6d-b3ed-ca830ef198c0 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:41.795002 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e5e7c-a9a2-4f6d-b3ed-ca830ef198c0 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:41.851335 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7948851-8344-4105-8144-cc810e0e936a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:41.852039 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7948851-8344-4105-8144-cc810e0e936a admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:41.852320 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7948851-8344-4105-8144-cc810e0e936a admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:41.852588 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7948851-8344-4105-8144-cc810e0e936a admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:41.853277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7948851-8344-4105-8144-cc810e0e936a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:41.855071 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7948851-8344-4105-8144-cc810e0e936a admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:41.864934 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1188/2385] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:04:41.869129 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f1569-5f22-46fb-87cc-6ea2bd5f9fc5 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:41.880074 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f1569-5f22-46fb-87cc-6ea2bd5f9fc5 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:41.884813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c90a06-4bfe-43ae-805a-f3ffa86c00e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:41.885468 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c90a06-4bfe-43ae-805a-f3ffa86c00e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:41.885744 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c90a06-4bfe-43ae-805a-f3ffa86c00e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:41.886611 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c90a06-4bfe-43ae-805a-f3ffa86c00e0 admin admin] PATH_INFO: `/v3/projects/aacc9dfafd524188a14b5e89d3fd3317/users/3986b2b70b564c0682c1721e1d060fa4/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:41.888548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c90a06-4bfe-43ae-805a-f3ffa86c00e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aacc9dfafd524188a14b5e89d3fd3317, user_id=3986b2b70b564c0682c1721e1d060fa4, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:41.891578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c90a06-4bfe-43ae-805a-f3ffa86c00e0 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:41.902377 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1198/2386] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:04:41 2022] PUT /identity/v3/projects/aacc9dfafd524188a14b5e89d3fd3317/users/3986b2b70b564c0682c1721e1d060fa4/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:04:41.914030 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bae1f6-9e77-4122-8e52-53a5c05396fe None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:41.919286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bae1f6-9e77-4122-8e52-53a5c05396fe None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:41.919286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bae1f6-9e77-4122-8e52-53a5c05396fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:41.942579 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-77bae1f6-9e77-4122-8e52-53a5c05396fe None None] MFA Rules not processed for user `3986b2b70b564c0682c1721e1d060fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:04:41.943817 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-77bae1f6-9e77-4122-8e52-53a5c05396fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:41.992221 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:42.014209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1189/2387] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:04:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:04:42.028907 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c90a06-4bfe-43ae-805a-f3ffa86c00e0 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:42.030749 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-15c90a06-4bfe-43ae-805a-f3ffa86c00e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:42.094974 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c90a06-4bfe-43ae-805a-f3ffa86c00e0 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:42.098714 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb802ab-3e1a-4db6-a8bd-f7f2bb461182 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:42.099319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb802ab-3e1a-4db6-a8bd-f7f2bb461182 service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:42.099594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb802ab-3e1a-4db6-a8bd-f7f2bb461182 service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:42.099866 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb802ab-3e1a-4db6-a8bd-f7f2bb461182 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:42.109559 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb802ab-3e1a-4db6-a8bd-f7f2bb461182 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:42.111295 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb802ab-3e1a-4db6-a8bd-f7f2bb461182 service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:42.121508 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1199/2388] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:04:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:04:42.360416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bae1f6-9e77-4122-8e52-53a5c05396fe None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:42.370183 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bae1f6-9e77-4122-8e52-53a5c05396fe None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:42.375740 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33972c-a0e5-4531-8522-3790d71950d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:42.376331 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33972c-a0e5-4531-8522-3790d71950d4 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:42.376626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33972c-a0e5-4531-8522-3790d71950d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:42.376890 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33972c-a0e5-4531-8522-3790d71950d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:42.431723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33972c-a0e5-4531-8522-3790d71950d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:42.433168 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33972c-a0e5-4531-8522-3790d71950d4 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:42.441747 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1190/2389] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:04:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:04:47.050548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb792f13-2dd0-424b-8972-d81b0b2a1000 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:47.051041 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb792f13-2dd0-424b-8972-d81b0b2a1000 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:47.051148 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb792f13-2dd0-424b-8972-d81b0b2a1000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:47.070647 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-cb792f13-2dd0-424b-8972-d81b0b2a1000 None None] MFA Rules not processed for user `d392c30328a3491bb186bd7b55f4d99c`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:04:47.071885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-cb792f13-2dd0-424b-8972-d81b0b2a1000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:47.091457 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:47.132155 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1200/2390] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Aug 11 10:04:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:04:47.259589 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33972c-a0e5-4531-8522-3790d71950d4 service cinder] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:47.261104 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-ad33972c-a0e5-4531-8522-3790d71950d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:47.330628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33972c-a0e5-4531-8522-3790d71950d4 service cinder] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:47.335715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49470d-bed0-458d-969c-a2abb3748915 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e3b1c5aec94673b391210ae51d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:47.336313 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49470d-bed0-458d-969c-a2abb3748915 service swift] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:47.336588 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49470d-bed0-458d-969c-a2abb3748915 service swift] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:47.336856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49470d-bed0-458d-969c-a2abb3748915 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:47.344905 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49470d-bed0-458d-969c-a2abb3748915 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:47.346555 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49470d-bed0-458d-969c-a2abb3748915 service swift] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:47.363194 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1191/2391] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Aug 11 10:04:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 10:04:48.753346 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb792f13-2dd0-424b-8972-d81b0b2a1000 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:48.755771 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-cb792f13-2dd0-424b-8972-d81b0b2a1000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:48.857440 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb792f13-2dd0-424b-8972-d81b0b2a1000 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:48.863555 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ce681-fc93-4320-b319-2f476aaf55dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:48.864262 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ce681-fc93-4320-b319-2f476aaf55dd service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:48.864631 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ce681-fc93-4320-b319-2f476aaf55dd service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:48.864974 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ce681-fc93-4320-b319-2f476aaf55dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:48.867281 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ac2ce681-fc93-4320-b319-2f476aaf55dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:48.962311 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ce681-fc93-4320-b319-2f476aaf55dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:48.964009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ce681-fc93-4320-b319-2f476aaf55dd service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:48.973532 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1201/2392] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:04:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:04:53.643592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc153ca-fc29-4bcb-85bd-157ca383ebc7 None None] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:53.644183 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc153ca-fc29-4bcb-85bd-157ca383ebc7 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:53.644183 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc153ca-fc29-4bcb-85bd-157ca383ebc7 None None] PATH_INFO: `/` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:53.645957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1192/2393] 10.222.0.13 () {54 vars in 921 bytes} [Thu Aug 11 10:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:04:53.652094 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed4764-4a2b-4d7f-8779-fbdd8d6967c1 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:53.652676 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed4764-4a2b-4d7f-8779-fbdd8d6967c1 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:53.652858 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed4764-4a2b-4d7f-8779-fbdd8d6967c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:53.675363 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-40ed4764-4a2b-4d7f-8779-fbdd8d6967c1 None None] MFA Rules not processed for user `4ac6ca32b5144c59b2bb5086fbd53ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:04:53.677321 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-40ed4764-4a2b-4d7f-8779-fbdd8d6967c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:54.025311 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1202/2394] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Aug 11 10:04:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:04:54.026782 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc153ca-fc29-4bcb-85bd-157ca383ebc7 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:54.026782 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-2dc153ca-fc29-4bcb-85bd-157ca383ebc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:54.026782 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc153ca-fc29-4bcb-85bd-157ca383ebc7 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:54.028006 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5376b-621e-4c84-a562-80f7f91c3546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:54.028006 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5376b-621e-4c84-a562-80f7f91c3546 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:54.028006 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5376b-621e-4c84-a562-80f7f91c3546 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:54.028006 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5376b-621e-4c84-a562-80f7f91c3546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:54.028450 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5376b-621e-4c84-a562-80f7f91c3546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:54.028450 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5376b-621e-4c84-a562-80f7f91c3546 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:54.028450 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1193/2395] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:04:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:04:54.028843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448ab0b-8afd-4a63-a7d0-d6e789b82e5c None None] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:54.028843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448ab0b-8afd-4a63-a7d0-d6e789b82e5c None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:54.028843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448ab0b-8afd-4a63-a7d0-d6e789b82e5c None None] PATH_INFO: `/` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:54.028843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1203/2396] 10.222.0.13 () {54 vars in 921 bytes} [Thu Aug 11 10:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:04:54.029290 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e0db1-f287-4a6d-8226-1941394191f7 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:54.029290 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e0db1-f287-4a6d-8226-1941394191f7 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:54.029290 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e0db1-f287-4a6d-8226-1941394191f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:54.029290 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-233e0db1-f287-4a6d-8226-1941394191f7 None None] MFA Rules not processed for user `4c1dc8e0d9454ad98894ed1e8d31f931`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:04:54.029290 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-233e0db1-f287-4a6d-8226-1941394191f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:54.029290 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1194/2397] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Aug 11 10:04:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:04:54.030909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448ab0b-8afd-4a63-a7d0-d6e789b82e5c None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:54.030909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448ab0b-8afd-4a63-a7d0-d6e789b82e5c None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:54.030909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753d0e8-abb3-467f-9c58-ab7275dcca9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:54.030909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753d0e8-abb3-467f-9c58-ab7275dcca9e service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:54.031578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753d0e8-abb3-467f-9c58-ab7275dcca9e service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:54.031578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753d0e8-abb3-467f-9c58-ab7275dcca9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:54.031578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753d0e8-abb3-467f-9c58-ab7275dcca9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:54.031578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753d0e8-abb3-467f-9c58-ab7275dcca9e service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:54.031578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1204/2398] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:04:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:04:54.084816 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e0db1-f287-4a6d-8226-1941394191f7 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:54.086359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-233e0db1-f287-4a6d-8226-1941394191f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:54.150332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:54.164736 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e0db1-f287-4a6d-8226-1941394191f7 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:54.169861 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ba8d1-305c-4d46-ac2c-47fb7066d374 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0061ce46df224f4491599ed10548b2ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:54.170532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ba8d1-305c-4d46-ac2c-47fb7066d374 service placement] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:54.170810 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ba8d1-305c-4d46-ac2c-47fb7066d374 service placement] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:54.171080 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ba8d1-305c-4d46-ac2c-47fb7066d374 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:54.172844 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-425ba8d1-305c-4d46-ac2c-47fb7066d374 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:54.184064 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ba8d1-305c-4d46-ac2c-47fb7066d374 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:54.186395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ba8d1-305c-4d46-ac2c-47fb7066d374 service placement] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:54.197185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1195/2399] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:04:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:04:55.562649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753d0e8-abb3-467f-9c58-ab7275dcca9e service neutron] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:04:55.572477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:04:55.578176 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753d0e8-abb3-467f-9c58-ab7275dcca9e service neutron] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:04:55.591660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2849ee7-5083-46f6-b2cc-a14d8a944790 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:04:55.593092 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2849ee7-5083-46f6-b2cc-a14d8a944790 service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:04:55.593588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2849ee7-5083-46f6-b2cc-a14d8a944790 service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:04:55.593864 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2849ee7-5083-46f6-b2cc-a14d8a944790 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:04:55.595730 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-f2849ee7-5083-46f6-b2cc-a14d8a944790 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:04:55.611786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2849ee7-5083-46f6-b2cc-a14d8a944790 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:04:55.613825 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2849ee7-5083-46f6-b2cc-a14d8a944790 service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:04:55.626705 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1205/2400] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:04:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:05:04.301580 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=8 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:05.650456 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=5 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:07.450833 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ba8d1-305c-4d46-ac2c-47fb7066d374 service placement] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:07.452414 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-425ba8d1-305c-4d46-ac2c-47fb7066d374 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:07.463914 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ba8d1-305c-4d46-ac2c-47fb7066d374 service placement] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:07.468229 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17678b7a-dd4c-4878-8c8d-e0c3b23d7bd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:07.468719 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17678b7a-dd4c-4878-8c8d-e0c3b23d7bd7 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:07.469000 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17678b7a-dd4c-4878-8c8d-e0c3b23d7bd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:07.469269 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17678b7a-dd4c-4878-8c8d-e0c3b23d7bd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:07.471588 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-17678b7a-dd4c-4878-8c8d-e0c3b23d7bd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:07.481426 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17678b7a-dd4c-4878-8c8d-e0c3b23d7bd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:07.482886 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17678b7a-dd4c-4878-8c8d-e0c3b23d7bd7 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:07.491704 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1196/2401] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:05:11.083221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1323685-90e2-40bf-af58-3f9badb9c8e2 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:11.083686 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1323685-90e2-40bf-af58-3f9badb9c8e2 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:11.086512 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1323685-90e2-40bf-af58-3f9badb9c8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:11.104103 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-d1323685-90e2-40bf-af58-3f9badb9c8e2 None None] MFA Rules not processed for user `d392c30328a3491bb186bd7b55f4d99c`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:11.104325 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-d1323685-90e2-40bf-af58-3f9badb9c8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:11.111969 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1206/2402] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Aug 11 10:05:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:11.124728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17678b7a-dd4c-4878-8c8d-e0c3b23d7bd7 service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:11.141651 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17678b7a-dd4c-4878-8c8d-e0c3b23d7bd7 service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:11.147223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91fe75-3bc9-47dc-b8bd-2c47c598a217 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e3b1c5aec94673b391210ae51d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:11.147834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91fe75-3bc9-47dc-b8bd-2c47c598a217 service swift] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:11.148110 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91fe75-3bc9-47dc-b8bd-2c47c598a217 service swift] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:11.148377 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91fe75-3bc9-47dc-b8bd-2c47c598a217 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:11.157851 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91fe75-3bc9-47dc-b8bd-2c47c598a217 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:11.159457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91fe75-3bc9-47dc-b8bd-2c47c598a217 service swift] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:11.168604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1197/2403] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Aug 11 10:05:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 10:05:11.889096 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1323685-90e2-40bf-af58-3f9badb9c8e2 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:11.898754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1323685-90e2-40bf-af58-3f9badb9c8e2 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:11.902433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a022fc4-ed51-4f80-ad76-7c3db1ca464f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:11.903047 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a022fc4-ed51-4f80-ad76-7c3db1ca464f service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:11.903314 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a022fc4-ed51-4f80-ad76-7c3db1ca464f service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:11.903579 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a022fc4-ed51-4f80-ad76-7c3db1ca464f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:11.905689 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-0a022fc4-ed51-4f80-ad76-7c3db1ca464f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:11.997405 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a022fc4-ed51-4f80-ad76-7c3db1ca464f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:11.999243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a022fc4-ed51-4f80-ad76-7c3db1ca464f service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:12.011295 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1207/2404] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:05:17.218837 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91fe75-3bc9-47dc-b8bd-2c47c598a217 service swift] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:17.221785 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-eb91fe75-3bc9-47dc-b8bd-2c47c598a217 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:17.236479 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91fe75-3bc9-47dc-b8bd-2c47c598a217 service swift] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:17.241932 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9fe0d-9d30-4875-8234-cb1c09c17831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:17.242904 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9fe0d-9d30-4875-8234-cb1c09c17831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:17.243181 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9fe0d-9d30-4875-8234-cb1c09c17831 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:17.243444 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9fe0d-9d30-4875-8234-cb1c09c17831 admin admin] PATH_INFO: `/v3/users/20bf487c5b8e490da15060ea798a83ca` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:17.244863 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9fe0d-9d30-4875-8234-cb1c09c17831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20bf487c5b8e490da15060ea798a83ca)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:17.247030 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9fe0d-9d30-4875-8234-cb1c09c17831 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:17.497288 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-9dc9fe0d-9d30-4875-8234-cb1c09c17831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20bf487c5b8e490da15060ea798a83ca'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:17.533099 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-9dc9fe0d-9d30-4875-8234-cb1c09c17831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20bf487c5b8e490da15060ea798a83ca'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:17.534423 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-9dc9fe0d-9d30-4875-8234-cb1c09c17831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20bf487c5b8e490da15060ea798a83ca'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:17.548270 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-9dc9fe0d-9d30-4875-8234-cb1c09c17831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20bf487c5b8e490da15060ea798a83ca'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:17.623599 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-9dc9fe0d-9d30-4875-8234-cb1c09c17831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20bf487c5b8e490da15060ea798a83ca'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:17.631198 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1198/2405] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:05:17 2022] DELETE /identity/v3/users/20bf487c5b8e490da15060ea798a83ca => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:17.901074 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a022fc4-ed51-4f80-ad76-7c3db1ca464f service neutron] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:17.921820 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a022fc4-ed51-4f80-ad76-7c3db1ca464f service neutron] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:17.999818 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a5386-f759-441e-bf61-a9a684b76be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:18.000465 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a5386-f759-441e-bf61-a9a684b76be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:18.000849 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a5386-f759-441e-bf61-a9a684b76be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:18.001127 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a5386-f759-441e-bf61-a9a684b76be6 admin admin] PATH_INFO: `/v3/projects/f1c39fc0779a464399a3050bba588e59` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:18.003367 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a5386-f759-441e-bf61-a9a684b76be6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1c39fc0779a464399a3050bba588e59)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:18.005376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a5386-f759-441e-bf61-a9a684b76be6 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:18.131632 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-dd9a5386-f759-441e-bf61-a9a684b76be6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1c39fc0779a464399a3050bba588e59', 'request_id': 'req-dd9a5386-f759-441e-bf61-a9a684b76be6'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:18.145936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-dd9a5386-f759-441e-bf61-a9a684b76be6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1c39fc0779a464399a3050bba588e59', 'request_id': 'req-dd9a5386-f759-441e-bf61-a9a684b76be6'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:18.218011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-dd9a5386-f759-441e-bf61-a9a684b76be6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1c39fc0779a464399a3050bba588e59', 'request_id': 'req-dd9a5386-f759-441e-bf61-a9a684b76be6'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:18.231282 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-dd9a5386-f759-441e-bf61-a9a684b76be6 admin admin] The token cache is being invalidate because project f1c39fc0779a464399a3050bba588e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:05:18.231834 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-dd9a5386-f759-441e-bf61-a9a684b76be6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:18.232503 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-dd9a5386-f759-441e-bf61-a9a684b76be6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:18.234211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1208/2406] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:05:17 2022] DELETE /identity/v3/projects/f1c39fc0779a464399a3050bba588e59 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:18.240067 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c09eca-f41c-46e3-8745-b9cda33d8711 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:18.241126 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c09eca-f41c-46e3-8745-b9cda33d8711 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:18.241733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c09eca-f41c-46e3-8745-b9cda33d8711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:18.263527 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-34c09eca-f41c-46e3-8745-b9cda33d8711 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:18.265058 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-34c09eca-f41c-46e3-8745-b9cda33d8711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:18.355434 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1199/2407] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:18.357108 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9d9d9-03c1-4cfd-ac65-f34c5a54c95a None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:18.357501 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9d9d9-03c1-4cfd-ac65-f34c5a54c95a None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:18.357869 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9d9d9-03c1-4cfd-ac65-f34c5a54c95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:18.382526 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-48d9d9d9-03c1-4cfd-ac65-f34c5a54c95a None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:18.383814 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-48d9d9d9-03c1-4cfd-ac65-f34c5a54c95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:18.394643 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1209/2408] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:05:18.404155 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c09eca-f41c-46e3-8745-b9cda33d8711 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:18.411571 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c09eca-f41c-46e3-8745-b9cda33d8711 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:18.416725 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dcc2f-89ac-4b47-96d7-fcc45bd7d604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:18.417321 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dcc2f-89ac-4b47-96d7-fcc45bd7d604 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:18.417603 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dcc2f-89ac-4b47-96d7-fcc45bd7d604 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:18.418639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dcc2f-89ac-4b47-96d7-fcc45bd7d604 admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:18.423004 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571dcc2f-89ac-4b47-96d7-fcc45bd7d604 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:05:18.423838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571dcc2f-89ac-4b47-96d7-fcc45bd7d604 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:18.426821 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571dcc2f-89ac-4b47-96d7-fcc45bd7d604 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:18.443687 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1200/2409] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:05:18.444922 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9d9d9-03c1-4cfd-ac65-f34c5a54c95a None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:18.455448 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9d9d9-03c1-4cfd-ac65-f34c5a54c95a None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:18.460634 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5859f-2aa6-4186-844a-683704f2ba5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:18.461319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5859f-2aa6-4186-844a-683704f2ba5a admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:18.461689 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5859f-2aa6-4186-844a-683704f2ba5a admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:18.462059 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5859f-2aa6-4186-844a-683704f2ba5a admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:18.462721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5859f-2aa6-4186-844a-683704f2ba5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:18.464668 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5859f-2aa6-4186-844a-683704f2ba5a admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:18.475258 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:18.596922 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1210/2410] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:05:18 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:05:18.601361 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dcc2f-89ac-4b47-96d7-fcc45bd7d604 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:18.611476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dcc2f-89ac-4b47-96d7-fcc45bd7d604 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:18.648670 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:18.682783 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486f740-9da4-46c8-9ae7-33e26e13954c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:18.683580 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486f740-9da4-46c8-9ae7-33e26e13954c admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:18.683909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486f740-9da4-46c8-9ae7-33e26e13954c admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:18.685486 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486f740-9da4-46c8-9ae7-33e26e13954c admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:18.686516 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486f740-9da4-46c8-9ae7-33e26e13954c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:18.690308 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486f740-9da4-46c8-9ae7-33e26e13954c admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:18.810037 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1201/2411] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:05:18 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:05:18.815317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5859f-2aa6-4186-844a-683704f2ba5a admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:18.823177 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5859f-2aa6-4186-844a-683704f2ba5a admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:18.829141 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325dbdf-e272-4169-b4c5-4396695cd696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:18.829762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325dbdf-e272-4169-b4c5-4396695cd696 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:18.830035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325dbdf-e272-4169-b4c5-4396695cd696 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:18.830351 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325dbdf-e272-4169-b4c5-4396695cd696 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:18.831541 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325dbdf-e272-4169-b4c5-4396695cd696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:18.833281 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325dbdf-e272-4169-b4c5-4396695cd696 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:18.844187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1211/2412] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:05:18.849869 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486f740-9da4-46c8-9ae7-33e26e13954c admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:18.869755 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486f740-9da4-46c8-9ae7-33e26e13954c admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:18.876948 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e38d1-996c-4260-bdb4-5607507eaa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:18.881673 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e38d1-996c-4260-bdb4-5607507eaa99 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:18.881673 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e38d1-996c-4260-bdb4-5607507eaa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:18.881673 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e38d1-996c-4260-bdb4-5607507eaa99 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:18.881673 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e38d1-996c-4260-bdb4-5607507eaa99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:18.881673 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e38d1-996c-4260-bdb4-5607507eaa99 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:18.893577 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1202/2413] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:05:18.897611 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325dbdf-e272-4169-b4c5-4396695cd696 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:18.913012 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325dbdf-e272-4169-b4c5-4396695cd696 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:18.913012 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0cf35-db4b-4785-8678-53b52b0377ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:18.913952 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0cf35-db4b-4785-8678-53b52b0377ad admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:18.913952 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0cf35-db4b-4785-8678-53b52b0377ad admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:18.914262 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0cf35-db4b-4785-8678-53b52b0377ad admin admin] PATH_INFO: `/v3/projects/d9b0aa3a0c1447b38d2589ac9d61e622/users/e9ba17f8bc414b7f994aea8e8aa31377/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:18.936308 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0cf35-db4b-4785-8678-53b52b0377ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b0aa3a0c1447b38d2589ac9d61e622, user_id=e9ba17f8bc414b7f994aea8e8aa31377, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:18.939033 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0cf35-db4b-4785-8678-53b52b0377ad admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:19.144641 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1212/2414] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:05:18 2022] PUT /identity/v3/projects/d9b0aa3a0c1447b38d2589ac9d61e622/users/e9ba17f8bc414b7f994aea8e8aa31377/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:19.155212 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc13373-c814-47d3-bd97-fdeee1f434aa None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:19.155763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc13373-c814-47d3-bd97-fdeee1f434aa None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:19.156038 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc13373-c814-47d3-bd97-fdeee1f434aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:19.189710 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-cdc13373-c814-47d3-bd97-fdeee1f434aa None None] MFA Rules not processed for user `e9ba17f8bc414b7f994aea8e8aa31377`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:19.191362 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-cdc13373-c814-47d3-bd97-fdeee1f434aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:19.272597 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1203/2415] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:19.273777 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0cf35-db4b-4785-8678-53b52b0377ad admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:19.369834 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0cf35-db4b-4785-8678-53b52b0377ad admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:19.378799 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d227e-9865-455c-b129-6c2d3a875b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:19.380204 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d227e-9865-455c-b129-6c2d3a875b95 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:19.380204 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d227e-9865-455c-b129-6c2d3a875b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:19.380204 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d227e-9865-455c-b129-6c2d3a875b95 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:19.380860 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d227e-9865-455c-b129-6c2d3a875b95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:19.383284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d227e-9865-455c-b129-6c2d3a875b95 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:19.471711 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1213/2416] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:05:19 2022] POST /identity/v3/projects => generated 379 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:05:19.474785 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc13373-c814-47d3-bd97-fdeee1f434aa None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:19.491027 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc13373-c814-47d3-bd97-fdeee1f434aa None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:19.580059 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98da39-7767-4011-b4e0-b71b933dadb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:19.580765 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98da39-7767-4011-b4e0-b71b933dadb2 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:19.581072 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98da39-7767-4011-b4e0-b71b933dadb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:19.581344 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98da39-7767-4011-b4e0-b71b933dadb2 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:19.581997 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98da39-7767-4011-b4e0-b71b933dadb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:19.584089 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98da39-7767-4011-b4e0-b71b933dadb2 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:19.655255 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1204/2417] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:05:19 2022] POST /identity/v3/users => generated 296 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:05:19.659113 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d227e-9865-455c-b129-6c2d3a875b95 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:19.669889 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d227e-9865-455c-b129-6c2d3a875b95 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:19.675246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14339d04-aab3-4638-97be-a47224bfebfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:19.675867 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14339d04-aab3-4638-97be-a47224bfebfb admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:19.676185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14339d04-aab3-4638-97be-a47224bfebfb admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:19.676450 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14339d04-aab3-4638-97be-a47224bfebfb admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:19.677098 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14339d04-aab3-4638-97be-a47224bfebfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:19.678801 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14339d04-aab3-4638-97be-a47224bfebfb admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:19.690902 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1214/2418] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:05:19.695139 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98da39-7767-4011-b4e0-b71b933dadb2 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:19.706659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98da39-7767-4011-b4e0-b71b933dadb2 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:19.717838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44f5f9-da8b-4ea1-aa58-d6511c0e122f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:19.718638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44f5f9-da8b-4ea1-aa58-d6511c0e122f admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:19.718963 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44f5f9-da8b-4ea1-aa58-d6511c0e122f admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:19.719262 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44f5f9-da8b-4ea1-aa58-d6511c0e122f admin admin] PATH_INFO: `/v3/projects/54970c71663940e4b035a872dd387a47/users/104d86dd436c4daeaca3266cede4a928/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:19.744614 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44f5f9-da8b-4ea1-aa58-d6511c0e122f admin admin] RBAC: Authorizing `identity:create_grant(project_id=54970c71663940e4b035a872dd387a47, user_id=104d86dd436c4daeaca3266cede4a928, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:19.746801 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44f5f9-da8b-4ea1-aa58-d6511c0e122f admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:19.855742 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1205/2419] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:05:19 2022] PUT /identity/v3/projects/54970c71663940e4b035a872dd387a47/users/104d86dd436c4daeaca3266cede4a928/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:05:19.866217 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14339d04-aab3-4638-97be-a47224bfebfb admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:19.877475 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14339d04-aab3-4638-97be-a47224bfebfb admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:19.934991 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12744c-a5ab-4bd2-8448-ac0685985271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:19.935972 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12744c-a5ab-4bd2-8448-ac0685985271 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:19.935972 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12744c-a5ab-4bd2-8448-ac0685985271 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:19.936173 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12744c-a5ab-4bd2-8448-ac0685985271 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:19.936773 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12744c-a5ab-4bd2-8448-ac0685985271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:19.938426 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12744c-a5ab-4bd2-8448-ac0685985271 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:19.948296 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1215/2420] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:05:19.953031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44f5f9-da8b-4ea1-aa58-d6511c0e122f admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:19.964126 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44f5f9-da8b-4ea1-aa58-d6511c0e122f admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:19.968311 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac397d5f-e980-4337-8f85-0b1f60f8befd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:19.968968 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac397d5f-e980-4337-8f85-0b1f60f8befd admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:19.969242 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac397d5f-e980-4337-8f85-0b1f60f8befd admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:19.969510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac397d5f-e980-4337-8f85-0b1f60f8befd admin admin] PATH_INFO: `/v3/projects/54970c71663940e4b035a872dd387a47/users/104d86dd436c4daeaca3266cede4a928/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:19.971993 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac397d5f-e980-4337-8f85-0b1f60f8befd admin admin] RBAC: Authorizing `identity:create_grant(project_id=54970c71663940e4b035a872dd387a47, user_id=104d86dd436c4daeaca3266cede4a928, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:19.974785 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac397d5f-e980-4337-8f85-0b1f60f8befd admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:19.977184 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:19.985662 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1206/2421] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:05:19 2022] PUT /identity/v3/projects/54970c71663940e4b035a872dd387a47/users/104d86dd436c4daeaca3266cede4a928/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:19.997852 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce496bc-f7b4-4de5-9c62-84375f661019 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:19.998191 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce496bc-f7b4-4de5-9c62-84375f661019 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:19.998473 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce496bc-f7b4-4de5-9c62-84375f661019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:20.026408 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-3ce496bc-f7b4-4de5-9c62-84375f661019 None None] MFA Rules not processed for user `104d86dd436c4daeaca3266cede4a928`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:20.027623 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-3ce496bc-f7b4-4de5-9c62-84375f661019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:20.041492 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:20.101084 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1216/2422] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:20.112956 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac397d5f-e980-4337-8f85-0b1f60f8befd admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:20.114719 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-ac397d5f-e980-4337-8f85-0b1f60f8befd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:20.173023 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac397d5f-e980-4337-8f85-0b1f60f8befd admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:20.177232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54197db2-ce3f-44bd-8491-c353cf931317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:20.177833 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54197db2-ce3f-44bd-8491-c353cf931317 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:20.178145 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54197db2-ce3f-44bd-8491-c353cf931317 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:20.178414 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54197db2-ce3f-44bd-8491-c353cf931317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:20.187355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54197db2-ce3f-44bd-8491-c353cf931317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:20.188788 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54197db2-ce3f-44bd-8491-c353cf931317 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:20.198515 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1207/2423] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:05:20.414334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce496bc-f7b4-4de5-9c62-84375f661019 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:20.423763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce496bc-f7b4-4de5-9c62-84375f661019 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:20.427317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e10b5a-eb97-4706-8267-545801424945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:20.427899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e10b5a-eb97-4706-8267-545801424945 service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:20.428170 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e10b5a-eb97-4706-8267-545801424945 service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:20.428438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e10b5a-eb97-4706-8267-545801424945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:20.503262 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e10b5a-eb97-4706-8267-545801424945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:20.504710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e10b5a-eb97-4706-8267-545801424945 service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:20.517922 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1217/2424] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:05:23.293872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54197db2-ce3f-44bd-8491-c353cf931317 service cinder] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:23.295349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-54197db2-ce3f-44bd-8491-c353cf931317 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:23.358381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54197db2-ce3f-44bd-8491-c353cf931317 service cinder] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:23.363402 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0147c22-02f6-42c9-bdc6-7f7f46667157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:23.364014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0147c22-02f6-42c9-bdc6-7f7f46667157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:23.365413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0147c22-02f6-42c9-bdc6-7f7f46667157 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:23.365413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0147c22-02f6-42c9-bdc6-7f7f46667157 admin admin] PATH_INFO: `/v3/users/2d4f83b02bca4732a195c6ae978c8e97` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:23.365632 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0147c22-02f6-42c9-bdc6-7f7f46667157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d4f83b02bca4732a195c6ae978c8e97)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:23.367556 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0147c22-02f6-42c9-bdc6-7f7f46667157 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:23.523408 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-b0147c22-02f6-42c9-bdc6-7f7f46667157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d4f83b02bca4732a195c6ae978c8e97'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:23.535336 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-b0147c22-02f6-42c9-bdc6-7f7f46667157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d4f83b02bca4732a195c6ae978c8e97'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:23.536131 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-b0147c22-02f6-42c9-bdc6-7f7f46667157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d4f83b02bca4732a195c6ae978c8e97'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:23.543896 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-b0147c22-02f6-42c9-bdc6-7f7f46667157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d4f83b02bca4732a195c6ae978c8e97'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:23.617413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-b0147c22-02f6-42c9-bdc6-7f7f46667157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d4f83b02bca4732a195c6ae978c8e97'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:23.624209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1208/2425] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:05:23 2022] DELETE /identity/v3/users/2d4f83b02bca4732a195c6ae978c8e97 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:23.629817 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc80fba-2089-464a-8972-e3e440a2e5d2 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:23.630340 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc80fba-2089-464a-8972-e3e440a2e5d2 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:23.630516 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc80fba-2089-464a-8972-e3e440a2e5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:23.651254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-1fc80fba-2089-464a-8972-e3e440a2e5d2 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:23.652539 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-1fc80fba-2089-464a-8972-e3e440a2e5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:23.718537 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1218/2426] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:05:23.728807 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0147c22-02f6-42c9-bdc6-7f7f46667157 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:23.730373 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-b0147c22-02f6-42c9-bdc6-7f7f46667157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:23.750670 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:23.797604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0147c22-02f6-42c9-bdc6-7f7f46667157 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:23.802875 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5266204-2f69-4add-82d2-935cb5dc48f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:23.803489 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5266204-2f69-4add-82d2-935cb5dc48f7 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:23.803768 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5266204-2f69-4add-82d2-935cb5dc48f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:23.804039 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5266204-2f69-4add-82d2-935cb5dc48f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:23.813778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5266204-2f69-4add-82d2-935cb5dc48f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:23.815254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5266204-2f69-4add-82d2-935cb5dc48f7 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:23.825026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1209/2427] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:05:24.402850 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc80fba-2089-464a-8972-e3e440a2e5d2 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:24.404493 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-1fc80fba-2089-464a-8972-e3e440a2e5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:24.424140 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc80fba-2089-464a-8972-e3e440a2e5d2 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:24.434662 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5db321-b429-4ed8-86d9-88aae1879de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:24.434662 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5db321-b429-4ed8-86d9-88aae1879de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:24.434662 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5db321-b429-4ed8-86d9-88aae1879de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:24.434662 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5db321-b429-4ed8-86d9-88aae1879de9 admin admin] PATH_INFO: `/v3/projects/9bdc35318fb94e28873db6786cc9cede` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:24.435404 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5db321-b429-4ed8-86d9-88aae1879de9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bdc35318fb94e28873db6786cc9cede)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:24.435404 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5db321-b429-4ed8-86d9-88aae1879de9 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:24.545713 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:24.549218 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-8b5db321-b429-4ed8-86d9-88aae1879de9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bdc35318fb94e28873db6786cc9cede', 'request_id': 'req-8b5db321-b429-4ed8-86d9-88aae1879de9'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:24.554636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-8b5db321-b429-4ed8-86d9-88aae1879de9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bdc35318fb94e28873db6786cc9cede', 'request_id': 'req-8b5db321-b429-4ed8-86d9-88aae1879de9'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:24.646044 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-8b5db321-b429-4ed8-86d9-88aae1879de9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bdc35318fb94e28873db6786cc9cede', 'request_id': 'req-8b5db321-b429-4ed8-86d9-88aae1879de9'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:24.657485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-8b5db321-b429-4ed8-86d9-88aae1879de9 admin admin] The token cache is being invalidate because project 9bdc35318fb94e28873db6786cc9cede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:05:24.657772 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-8b5db321-b429-4ed8-86d9-88aae1879de9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:24.658428 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-8b5db321-b429-4ed8-86d9-88aae1879de9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:24.659897 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1219/2428] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:05:24 2022] DELETE /identity/v3/projects/9bdc35318fb94e28873db6786cc9cede => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:24.663940 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5266204-2f69-4add-82d2-935cb5dc48f7 service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:24.673674 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5266204-2f69-4add-82d2-935cb5dc48f7 service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:24.731010 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8211c36-d8a9-4e7e-bfa4-196ae738b975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:24.731625 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8211c36-d8a9-4e7e-bfa4-196ae738b975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:24.731899 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8211c36-d8a9-4e7e-bfa4-196ae738b975 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:24.732166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8211c36-d8a9-4e7e-bfa4-196ae738b975 admin admin] PATH_INFO: `/v3/users/3986b2b70b564c0682c1721e1d060fa4` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:24.733265 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8211c36-d8a9-4e7e-bfa4-196ae738b975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3986b2b70b564c0682c1721e1d060fa4)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:24.735237 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8211c36-d8a9-4e7e-bfa4-196ae738b975 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:24.923198 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a8211c36-d8a9-4e7e-bfa4-196ae738b975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3986b2b70b564c0682c1721e1d060fa4'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:24.937901 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a8211c36-d8a9-4e7e-bfa4-196ae738b975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3986b2b70b564c0682c1721e1d060fa4'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:24.938646 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a8211c36-d8a9-4e7e-bfa4-196ae738b975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3986b2b70b564c0682c1721e1d060fa4'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:24.947128 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a8211c36-d8a9-4e7e-bfa4-196ae738b975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3986b2b70b564c0682c1721e1d060fa4'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:25.863823 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a8211c36-d8a9-4e7e-bfa4-196ae738b975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3986b2b70b564c0682c1721e1d060fa4'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:25.870224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1210/2429] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:05:24 2022] DELETE /identity/v3/users/3986b2b70b564c0682c1721e1d060fa4 => generated 0 bytes in 1207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:26.375160 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5db321-b429-4ed8-86d9-88aae1879de9 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:26.376694 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-8b5db321-b429-4ed8-86d9-88aae1879de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:26.389822 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5db321-b429-4ed8-86d9-88aae1879de9 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:26.447375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a2551-2cb3-4e72-ac1d-9ff4bebc63a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:26.447995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a2551-2cb3-4e72-ac1d-9ff4bebc63a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:26.448268 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a2551-2cb3-4e72-ac1d-9ff4bebc63a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:26.448537 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a2551-2cb3-4e72-ac1d-9ff4bebc63a8 admin admin] PATH_INFO: `/v3/projects/aacc9dfafd524188a14b5e89d3fd3317` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:26.449802 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a2551-2cb3-4e72-ac1d-9ff4bebc63a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aacc9dfafd524188a14b5e89d3fd3317)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:26.452535 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a2551-2cb3-4e72-ac1d-9ff4bebc63a8 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:26.579222 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-905a2551-2cb3-4e72-ac1d-9ff4bebc63a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aacc9dfafd524188a14b5e89d3fd3317', 'request_id': 'req-905a2551-2cb3-4e72-ac1d-9ff4bebc63a8'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:26.585336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-905a2551-2cb3-4e72-ac1d-9ff4bebc63a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aacc9dfafd524188a14b5e89d3fd3317', 'request_id': 'req-905a2551-2cb3-4e72-ac1d-9ff4bebc63a8'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:26.664231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-905a2551-2cb3-4e72-ac1d-9ff4bebc63a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aacc9dfafd524188a14b5e89d3fd3317', 'request_id': 'req-905a2551-2cb3-4e72-ac1d-9ff4bebc63a8'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:26.679352 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-905a2551-2cb3-4e72-ac1d-9ff4bebc63a8 admin admin] The token cache is being invalidate because project aacc9dfafd524188a14b5e89d3fd3317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:05:26.680822 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-905a2551-2cb3-4e72-ac1d-9ff4bebc63a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:26.681682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-905a2551-2cb3-4e72-ac1d-9ff4bebc63a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:26.683597 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1220/2430] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:05:26 2022] DELETE /identity/v3/projects/aacc9dfafd524188a14b5e89d3fd3317 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:26.688362 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a8f9f-dabc-4ad2-bf51-f0ea882727c0 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:26.688649 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a8f9f-dabc-4ad2-bf51-f0ea882727c0 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:26.688928 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a8f9f-dabc-4ad2-bf51-f0ea882727c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:26.715243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-118a8f9f-dabc-4ad2-bf51-f0ea882727c0 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:26.717119 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-118a8f9f-dabc-4ad2-bf51-f0ea882727c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:26.769695 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:26.796398 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1211/2431] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:26.805016 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e428b12-05e8-45ad-93cf-7ca5bc73266c None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:26.806739 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e428b12-05e8-45ad-93cf-7ca5bc73266c None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:26.806739 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e428b12-05e8-45ad-93cf-7ca5bc73266c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:26.824928 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-6e428b12-05e8-45ad-93cf-7ca5bc73266c None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:26.826160 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-6e428b12-05e8-45ad-93cf-7ca5bc73266c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:26.834460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1221/2432] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:26.841536 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a8f9f-dabc-4ad2-bf51-f0ea882727c0 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:26.852330 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a8f9f-dabc-4ad2-bf51-f0ea882727c0 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:26.856916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c798b7-9229-4b76-9dc8-e9f16e975c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:26.858117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c798b7-9229-4b76-9dc8-e9f16e975c90 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:26.858117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c798b7-9229-4b76-9dc8-e9f16e975c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:26.858117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c798b7-9229-4b76-9dc8-e9f16e975c90 admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:26.858743 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c798b7-9229-4b76-9dc8-e9f16e975c90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:05:26.859039 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c798b7-9229-4b76-9dc8-e9f16e975c90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:26.860890 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c798b7-9229-4b76-9dc8-e9f16e975c90 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:26.875963 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1212/2433] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:05:26.878844 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e428b12-05e8-45ad-93cf-7ca5bc73266c None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:26.888324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e428b12-05e8-45ad-93cf-7ca5bc73266c None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:26.892980 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b47d65-445f-48e4-a2bd-8498be82690c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:26.893572 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b47d65-445f-48e4-a2bd-8498be82690c admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:26.893845 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b47d65-445f-48e4-a2bd-8498be82690c admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:26.894136 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b47d65-445f-48e4-a2bd-8498be82690c admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:26.894785 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b47d65-445f-48e4-a2bd-8498be82690c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:26.896788 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b47d65-445f-48e4-a2bd-8498be82690c admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:26.993541 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1222/2434] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:05:26 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:05:26.996979 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c798b7-9229-4b76-9dc8-e9f16e975c90 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:27.012761 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c798b7-9229-4b76-9dc8-e9f16e975c90 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:27.082690 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168f229-9bd2-4fe9-b63c-c9c8320779dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:27.083292 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168f229-9bd2-4fe9-b63c-c9c8320779dd admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:27.085741 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168f229-9bd2-4fe9-b63c-c9c8320779dd admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:27.085741 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168f229-9bd2-4fe9-b63c-c9c8320779dd admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:27.085741 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168f229-9bd2-4fe9-b63c-c9c8320779dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:27.086408 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168f229-9bd2-4fe9-b63c-c9c8320779dd admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:27.175935 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1213/2435] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:05:26 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:05:27.177271 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b47d65-445f-48e4-a2bd-8498be82690c admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:27.187769 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b47d65-445f-48e4-a2bd-8498be82690c admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:27.192416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e51fb-9b09-43f7-b065-0ee56d1a7e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:27.194914 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e51fb-9b09-43f7-b065-0ee56d1a7e73 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:27.194914 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e51fb-9b09-43f7-b065-0ee56d1a7e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:27.194914 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e51fb-9b09-43f7-b065-0ee56d1a7e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:27.194914 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e51fb-9b09-43f7-b065-0ee56d1a7e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:27.195963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e51fb-9b09-43f7-b065-0ee56d1a7e73 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:27.208803 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1223/2436] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:05:27.210583 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168f229-9bd2-4fe9-b63c-c9c8320779dd admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:27.220571 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168f229-9bd2-4fe9-b63c-c9c8320779dd admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:27.229515 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922652b1-2825-4ea5-a991-3dd1e001a736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:27.232275 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922652b1-2825-4ea5-a991-3dd1e001a736 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:27.232275 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922652b1-2825-4ea5-a991-3dd1e001a736 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:27.232275 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922652b1-2825-4ea5-a991-3dd1e001a736 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:27.232275 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922652b1-2825-4ea5-a991-3dd1e001a736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:27.233031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922652b1-2825-4ea5-a991-3dd1e001a736 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:27.244766 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1214/2437] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:05:27.254395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e51fb-9b09-43f7-b065-0ee56d1a7e73 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:27.259395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e51fb-9b09-43f7-b065-0ee56d1a7e73 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:27.264616 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f544aea-cd58-4351-996c-057383c61936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:27.265293 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f544aea-cd58-4351-996c-057383c61936 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:27.265598 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f544aea-cd58-4351-996c-057383c61936 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:27.265867 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f544aea-cd58-4351-996c-057383c61936 admin admin] PATH_INFO: `/v3/projects/69c6449994f14b2b9a42c784d8a61173/users/b5777160c7eb430f8a560cdbe6991b8b/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:27.281575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f544aea-cd58-4351-996c-057383c61936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c6449994f14b2b9a42c784d8a61173, user_id=b5777160c7eb430f8a560cdbe6991b8b, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:27.284926 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f544aea-cd58-4351-996c-057383c61936 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:27.384841 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:27.391384 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1224/2438] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:05:27 2022] PUT /identity/v3/projects/69c6449994f14b2b9a42c784d8a61173/users/b5777160c7eb430f8a560cdbe6991b8b/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:27.403241 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65191c01-98c0-4087-a280-f638d1ac8547 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:27.404075 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65191c01-98c0-4087-a280-f638d1ac8547 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:27.404384 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65191c01-98c0-4087-a280-f638d1ac8547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:27.433117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-65191c01-98c0-4087-a280-f638d1ac8547 None None] MFA Rules not processed for user `b5777160c7eb430f8a560cdbe6991b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:27.434374 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-65191c01-98c0-4087-a280-f638d1ac8547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:27.500449 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1215/2439] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:27.505405 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f544aea-cd58-4351-996c-057383c61936 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:27.568975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f544aea-cd58-4351-996c-057383c61936 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:27.573716 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a87d9-eb64-4dde-bdcb-16d62b156409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:27.574346 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a87d9-eb64-4dde-bdcb-16d62b156409 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:27.574680 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a87d9-eb64-4dde-bdcb-16d62b156409 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:27.574882 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a87d9-eb64-4dde-bdcb-16d62b156409 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:27.575583 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a87d9-eb64-4dde-bdcb-16d62b156409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:27.578115 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a87d9-eb64-4dde-bdcb-16d62b156409 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:27.710869 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1225/2440] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:05:27 2022] POST /identity/v3/projects => generated 379 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:05:27.715748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65191c01-98c0-4087-a280-f638d1ac8547 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:27.726400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65191c01-98c0-4087-a280-f638d1ac8547 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:27.757254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:27.787774 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3af007-4c65-4c26-a1ef-54ad7a2dff21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:27.788395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3af007-4c65-4c26-a1ef-54ad7a2dff21 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:27.788987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3af007-4c65-4c26-a1ef-54ad7a2dff21 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:27.789185 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3af007-4c65-4c26-a1ef-54ad7a2dff21 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:27.789795 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3af007-4c65-4c26-a1ef-54ad7a2dff21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:27.791844 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3af007-4c65-4c26-a1ef-54ad7a2dff21 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:27.930027 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656c194-6c5b-4e13-af93-b0339045d7d2 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:27.930340 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656c194-6c5b-4e13-af93-b0339045d7d2 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:27.930620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656c194-6c5b-4e13-af93-b0339045d7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:27.937427 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1216/2441] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:05:27 2022] POST /identity/v3/users => generated 296 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:05:27.938049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3af007-4c65-4c26-a1ef-54ad7a2dff21 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:27.953959 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3af007-4c65-4c26-a1ef-54ad7a2dff21 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:27.958970 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b4950-8806-47f9-9da2-28f637ed8244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:27.959698 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b4950-8806-47f9-9da2-28f637ed8244 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:27.960524 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b4950-8806-47f9-9da2-28f637ed8244 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:27.967362 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b4950-8806-47f9-9da2-28f637ed8244 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:27.967488 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-e656c194-6c5b-4e13-af93-b0339045d7d2 None None] MFA Rules not processed for user `d392c30328a3491bb186bd7b55f4d99c`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:27.967589 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b4950-8806-47f9-9da2-28f637ed8244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:27.967589 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b4950-8806-47f9-9da2-28f637ed8244 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:27.967740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-e656c194-6c5b-4e13-af93-b0339045d7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:27.973808 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1217/2442] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:05:27.978228 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b4950-8806-47f9-9da2-28f637ed8244 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:27.988889 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b4950-8806-47f9-9da2-28f637ed8244 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:27.993581 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c19ae1-68b1-4c6f-846c-dbab257afa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:27.994264 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c19ae1-68b1-4c6f-846c-dbab257afa8e admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:27.994544 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c19ae1-68b1-4c6f-846c-dbab257afa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:27.994814 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c19ae1-68b1-4c6f-846c-dbab257afa8e admin admin] PATH_INFO: `/v3/projects/cfa08cb1c6924019ab3b6f81b4408aae/users/d9c8e7ee0d3a4563a35b221871fb454c/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:28.009990 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c19ae1-68b1-4c6f-846c-dbab257afa8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa08cb1c6924019ab3b6f81b4408aae, user_id=d9c8e7ee0d3a4563a35b221871fb454c, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:28.012701 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c19ae1-68b1-4c6f-846c-dbab257afa8e admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:28.032032 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1226/2443] 10.222.0.13 () {58 vars in 967 bytes} [Thu Aug 11 10:05:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:05:28.044625 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656c194-6c5b-4e13-af93-b0339045d7d2 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:28.046000 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-e656c194-6c5b-4e13-af93-b0339045d7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:28.109752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1218/2444] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:05:27 2022] PUT /identity/v3/projects/cfa08cb1c6924019ab3b6f81b4408aae/users/d9c8e7ee0d3a4563a35b221871fb454c/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:05:28.110697 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c19ae1-68b1-4c6f-846c-dbab257afa8e admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:28.112283 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-84c19ae1-68b1-4c6f-846c-dbab257afa8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:28.120707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656c194-6c5b-4e13-af93-b0339045d7d2 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:28.151967 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:28.170035 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c19ae1-68b1-4c6f-846c-dbab257afa8e admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:28.173698 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88ada6-5693-4dd3-9c65-774d218a56c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:28.174323 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88ada6-5693-4dd3-9c65-774d218a56c4 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:28.174600 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88ada6-5693-4dd3-9c65-774d218a56c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:28.175492 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88ada6-5693-4dd3-9c65-774d218a56c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:28.177295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-db88ada6-5693-4dd3-9c65-774d218a56c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:28.184359 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f8e9b-e0fb-4d0a-9f02-dd1b66f50b9c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e3b1c5aec94673b391210ae51d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:28.185181 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f8e9b-e0fb-4d0a-9f02-dd1b66f50b9c service swift] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:28.185463 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f8e9b-e0fb-4d0a-9f02-dd1b66f50b9c service swift] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:28.185740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f8e9b-e0fb-4d0a-9f02-dd1b66f50b9c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:28.236132 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88ada6-5693-4dd3-9c65-774d218a56c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:28.238150 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88ada6-5693-4dd3-9c65-774d218a56c4 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:28.244340 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f8e9b-e0fb-4d0a-9f02-dd1b66f50b9c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:28.245952 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f8e9b-e0fb-4d0a-9f02-dd1b66f50b9c service swift] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:28.247296 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1219/2445] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:05:28.248024 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88ada6-5693-4dd3-9c65-774d218a56c4 service cinder] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:28.255656 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1227/2446] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Aug 11 10:05:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 11 10:05:28.308601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:28.325966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88ada6-5693-4dd3-9c65-774d218a56c4 service cinder] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:28.331262 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775070e0-e163-45b6-9040-0ace61ca187e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:28.331865 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775070e0-e163-45b6-9040-0ace61ca187e admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:28.332141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775070e0-e163-45b6-9040-0ace61ca187e admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:28.332528 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775070e0-e163-45b6-9040-0ace61ca187e admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:28.333172 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775070e0-e163-45b6-9040-0ace61ca187e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:28.334845 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775070e0-e163-45b6-9040-0ace61ca187e admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:28.345113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1220/2447] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:05:28.349616 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f8e9b-e0fb-4d0a-9f02-dd1b66f50b9c service swift] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:28.360141 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f8e9b-e0fb-4d0a-9f02-dd1b66f50b9c service swift] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:28.365462 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bddf6-753e-419e-a932-c374c582b67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:28.366123 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bddf6-753e-419e-a932-c374c582b67d admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:28.371521 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bddf6-753e-419e-a932-c374c582b67d admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:28.371521 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bddf6-753e-419e-a932-c374c582b67d admin admin] PATH_INFO: `/v3/projects/cfa08cb1c6924019ab3b6f81b4408aae/users/d9c8e7ee0d3a4563a35b221871fb454c/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:28.371521 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292bddf6-753e-419e-a932-c374c582b67d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa08cb1c6924019ab3b6f81b4408aae, user_id=d9c8e7ee0d3a4563a35b221871fb454c, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:28.371521 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292bddf6-753e-419e-a932-c374c582b67d admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:28.381637 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1228/2448] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:05:28 2022] PUT /identity/v3/projects/cfa08cb1c6924019ab3b6f81b4408aae/users/d9c8e7ee0d3a4563a35b221871fb454c/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:05:28.391909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cbeba-a00d-4ae0-8bd7-20b2c7eada4b None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:28.392193 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cbeba-a00d-4ae0-8bd7-20b2c7eada4b None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:28.393847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cbeba-a00d-4ae0-8bd7-20b2c7eada4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:28.419980 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-759cbeba-a00d-4ae0-8bd7-20b2c7eada4b None None] MFA Rules not processed for user `d9c8e7ee0d3a4563a35b221871fb454c`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:28.421218 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-759cbeba-a00d-4ae0-8bd7-20b2c7eada4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:28.496253 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1221/2449] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:28.513476 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bddf6-753e-419e-a932-c374c582b67d admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:28.573294 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bddf6-753e-419e-a932-c374c582b67d admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:28.577257 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a43e38-f5fc-42e2-bcf2-90d267629a34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:28.577858 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a43e38-f5fc-42e2-bcf2-90d267629a34 service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:28.578241 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a43e38-f5fc-42e2-bcf2-90d267629a34 service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:28.578514 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a43e38-f5fc-42e2-bcf2-90d267629a34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:28.587898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a43e38-f5fc-42e2-bcf2-90d267629a34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:28.589428 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a43e38-f5fc-42e2-bcf2-90d267629a34 service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:28.600794 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1229/2450] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:05:29.568850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cbeba-a00d-4ae0-8bd7-20b2c7eada4b None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:29.578483 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cbeba-a00d-4ae0-8bd7-20b2c7eada4b None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:29.583174 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8cfea-53f2-490b-9aab-8f42c380e314 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c8e7ee0d3a4563a35b221871fb454c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa08cb1c6924019ab3b6f81b4408aae', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:29.583821 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8cfea-53f2-490b-9aab-8f42c380e314 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:29.584102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8cfea-53f2-490b-9aab-8f42c380e314 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:29.584377 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8cfea-53f2-490b-9aab-8f42c380e314 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:29.585027 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8cfea-53f2-490b-9aab-8f42c380e314 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:05:29.585332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8cfea-53f2-490b-9aab-8f42c380e314 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:29.586984 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8cfea-53f2-490b-9aab-8f42c380e314 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:29.598741 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1222/2451] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:05:29.602882 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a43e38-f5fc-42e2-bcf2-90d267629a34 service cinder] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:29.612126 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a43e38-f5fc-42e2-bcf2-90d267629a34 service cinder] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:29.617221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6027e8-5255-4026-a0a3-e103f5a05129 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c8e7ee0d3a4563a35b221871fb454c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa08cb1c6924019ab3b6f81b4408aae', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:29.617808 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6027e8-5255-4026-a0a3-e103f5a05129 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:29.618217 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6027e8-5255-4026-a0a3-e103f5a05129 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:29.618498 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6027e8-5255-4026-a0a3-e103f5a05129 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:29.625933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6027e8-5255-4026-a0a3-e103f5a05129 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:29.625933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6027e8-5255-4026-a0a3-e103f5a05129 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:29.688348 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1230/2452] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:05:29 2022] POST /identity/v3/projects => generated 353 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:05:29.692561 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8cfea-53f2-490b-9aab-8f42c380e314 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:29.702637 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8cfea-53f2-490b-9aab-8f42c380e314 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:29.759230 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58819ef-c42d-4a22-b8ff-c5cb6cf00933 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c8e7ee0d3a4563a35b221871fb454c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa08cb1c6924019ab3b6f81b4408aae', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:29.759782 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58819ef-c42d-4a22-b8ff-c5cb6cf00933 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:29.760059 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58819ef-c42d-4a22-b8ff-c5cb6cf00933 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:29.760329 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58819ef-c42d-4a22-b8ff-c5cb6cf00933 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:29.760962 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58819ef-c42d-4a22-b8ff-c5cb6cf00933 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:05:29.761262 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58819ef-c42d-4a22-b8ff-c5cb6cf00933 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:29.762888 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58819ef-c42d-4a22-b8ff-c5cb6cf00933 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:29.773884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1223/2453] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:05:29.813321 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6027e8-5255-4026-a0a3-e103f5a05129 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:29.831602 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6027e8-5255-4026-a0a3-e103f5a05129 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:29.836732 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af22ec-47a1-41a8-aa5a-b50352f08d03 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c8e7ee0d3a4563a35b221871fb454c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa08cb1c6924019ab3b6f81b4408aae', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:29.837350 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af22ec-47a1-41a8-aa5a-b50352f08d03 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:29.837627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af22ec-47a1-41a8-aa5a-b50352f08d03 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:29.837897 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af22ec-47a1-41a8-aa5a-b50352f08d03 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] PATH_INFO: `/v3/projects/80be741040654426ad0922e4a991b4ef` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:29.839032 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af22ec-47a1-41a8-aa5a-b50352f08d03 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] RBAC: Authorizing `identity:delete_project(project_id=80be741040654426ad0922e4a991b4ef)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:29.840982 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af22ec-47a1-41a8-aa5a-b50352f08d03 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:29.958758 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:29.968315 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-66af22ec-47a1-41a8-aa5a-b50352f08d03 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80be741040654426ad0922e4a991b4ef', 'request_id': 'req-66af22ec-47a1-41a8-aa5a-b50352f08d03'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:29.974716 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-66af22ec-47a1-41a8-aa5a-b50352f08d03 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80be741040654426ad0922e4a991b4ef', 'request_id': 'req-66af22ec-47a1-41a8-aa5a-b50352f08d03'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:30.086891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-66af22ec-47a1-41a8-aa5a-b50352f08d03 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80be741040654426ad0922e4a991b4ef', 'request_id': 'req-66af22ec-47a1-41a8-aa5a-b50352f08d03'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:30.244932 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-66af22ec-47a1-41a8-aa5a-b50352f08d03 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] The token cache is being invalidate because project 80be741040654426ad0922e4a991b4ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:05:30.245219 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-66af22ec-47a1-41a8-aa5a-b50352f08d03 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:30.248358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-66af22ec-47a1-41a8-aa5a-b50352f08d03 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:30.254177 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1231/2454] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:05:29 2022] DELETE /identity/v3/projects/80be741040654426ad0922e4a991b4ef => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:30.697239 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58819ef-c42d-4a22-b8ff-c5cb6cf00933 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:30.699016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-a58819ef-c42d-4a22-b8ff-c5cb6cf00933 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:30.745056 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:30.763629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58819ef-c42d-4a22-b8ff-c5cb6cf00933 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:30.795158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af22ec-47a1-41a8-aa5a-b50352f08d03 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:30.796563 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-66af22ec-47a1-41a8-aa5a-b50352f08d03 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:30.818976 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0a0bc-fd92-407d-95f5-5701c043b50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:30.819621 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0a0bc-fd92-407d-95f5-5701c043b50f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:30.819877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0a0bc-fd92-407d-95f5-5701c043b50f admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:30.820146 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0a0bc-fd92-407d-95f5-5701c043b50f admin admin] PATH_INFO: `/v3/users/e9ba17f8bc414b7f994aea8e8aa31377` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:30.821265 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0a0bc-fd92-407d-95f5-5701c043b50f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9ba17f8bc414b7f994aea8e8aa31377)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:30.823230 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0a0bc-fd92-407d-95f5-5701c043b50f admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:30.864926 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af22ec-47a1-41a8-aa5a-b50352f08d03 tempest-VolumeQuotaClassesTest-113243709 tempest-VolumeQuotaClassesTest-113243709-project-admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:30.869464 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f6229-6b30-4fa2-8769-5439489168b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:30.870100 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f6229-6b30-4fa2-8769-5439489168b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:30.870401 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f6229-6b30-4fa2-8769-5439489168b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:30.872427 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f6229-6b30-4fa2-8769-5439489168b1 admin admin] PATH_INFO: `/v3/users/b5777160c7eb430f8a560cdbe6991b8b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:30.872427 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f6229-6b30-4fa2-8769-5439489168b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5777160c7eb430f8a560cdbe6991b8b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:30.873657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f6229-6b30-4fa2-8769-5439489168b1 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:31.002581 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-6cf0a0bc-fd92-407d-95f5-5701c043b50f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9ba17f8bc414b7f994aea8e8aa31377'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:31.014359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-6cf0a0bc-fd92-407d-95f5-5701c043b50f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9ba17f8bc414b7f994aea8e8aa31377'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:31.021733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-6cf0a0bc-fd92-407d-95f5-5701c043b50f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9ba17f8bc414b7f994aea8e8aa31377'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:31.022539 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-6cf0a0bc-fd92-407d-95f5-5701c043b50f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9ba17f8bc414b7f994aea8e8aa31377'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:31.054455 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-995f6229-6b30-4fa2-8769-5439489168b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5777160c7eb430f8a560cdbe6991b8b'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:31.066195 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-995f6229-6b30-4fa2-8769-5439489168b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5777160c7eb430f8a560cdbe6991b8b'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:31.066849 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-995f6229-6b30-4fa2-8769-5439489168b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5777160c7eb430f8a560cdbe6991b8b'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:31.067620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-995f6229-6b30-4fa2-8769-5439489168b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5777160c7eb430f8a560cdbe6991b8b'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:31.074277 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-995f6229-6b30-4fa2-8769-5439489168b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5777160c7eb430f8a560cdbe6991b8b'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:31.086593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-6cf0a0bc-fd92-407d-95f5-5701c043b50f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9ba17f8bc414b7f994aea8e8aa31377'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:31.092825 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1224/2455] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:05:30 2022] DELETE /identity/v3/users/e9ba17f8bc414b7f994aea8e8aa31377 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:31.097776 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e1b94-1232-4ccc-a784-3bc22a0fb225 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:31.098054 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e1b94-1232-4ccc-a784-3bc22a0fb225 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:31.098349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e1b94-1232-4ccc-a784-3bc22a0fb225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:31.116260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-6b4e1b94-1232-4ccc-a784-3bc22a0fb225 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:31.117456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-6b4e1b94-1232-4ccc-a784-3bc22a0fb225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:31.172144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1232/2456] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:05:30 2022] DELETE /identity/v3/users/b5777160c7eb430f8a560cdbe6991b8b => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:05:31.174565 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1225/2457] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:05:31.176535 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ef1c7-00ec-4748-a3d6-a98dd221d071 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:31.180054 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ef1c7-00ec-4748-a3d6-a98dd221d071 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:31.180437 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ef1c7-00ec-4748-a3d6-a98dd221d071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:31.184261 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e1b94-1232-4ccc-a784-3bc22a0fb225 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:31.185637 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-6b4e1b94-1232-4ccc-a784-3bc22a0fb225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:31.199742 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:31.200078 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-425ef1c7-00ec-4748-a3d6-a98dd221d071 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:31.207854 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-425ef1c7-00ec-4748-a3d6-a98dd221d071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:31.239701 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:31.244904 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e1b94-1232-4ccc-a784-3bc22a0fb225 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:31.263725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1233/2458] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:05:31.274290 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ef1c7-00ec-4748-a3d6-a98dd221d071 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:31.306401 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a3b9e-51c5-45e1-abc9-7a2e700afea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:31.306682 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a3b9e-51c5-45e1-abc9-7a2e700afea9 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:31.306961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a3b9e-51c5-45e1-abc9-7a2e700afea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:31.307236 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a3b9e-51c5-45e1-abc9-7a2e700afea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:31.318743 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a3b9e-51c5-45e1-abc9-7a2e700afea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:31.321814 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a3b9e-51c5-45e1-abc9-7a2e700afea9 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:31.335853 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1226/2459] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:05:31.344627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ef1c7-00ec-4748-a3d6-a98dd221d071 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:31.350494 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7bcf3-c94c-492e-bbf9-95ef3bbba10a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:31.351701 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7bcf3-c94c-492e-bbf9-95ef3bbba10a service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:31.351701 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7bcf3-c94c-492e-bbf9-95ef3bbba10a service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:31.352020 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7bcf3-c94c-492e-bbf9-95ef3bbba10a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:31.361139 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7bcf3-c94c-492e-bbf9-95ef3bbba10a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:31.362598 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7bcf3-c94c-492e-bbf9-95ef3bbba10a service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:31.372490 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1234/2460] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:05:31.878886 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a3b9e-51c5-45e1-abc9-7a2e700afea9 service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:31.880625 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-b72a3b9e-51c5-45e1-abc9-7a2e700afea9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:31.883645 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7bcf3-c94c-492e-bbf9-95ef3bbba10a service neutron] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:31.885343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-59b7bcf3-c94c-492e-bbf9-95ef3bbba10a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:31.897594 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a3b9e-51c5-45e1-abc9-7a2e700afea9 service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:31.899509 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7bcf3-c94c-492e-bbf9-95ef3bbba10a service neutron] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:31.902497 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0590c-e343-4055-86bb-70e4b51c2295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:31.903156 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0590c-e343-4055-86bb-70e4b51c2295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:31.903401 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0590c-e343-4055-86bb-70e4b51c2295 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:31.903729 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0590c-e343-4055-86bb-70e4b51c2295 admin admin] PATH_INFO: `/v3/projects/69c6449994f14b2b9a42c784d8a61173` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:31.904563 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d3e58-cfb6-456d-8466-5ba3a9d57b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:31.904848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0590c-e343-4055-86bb-70e4b51c2295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69c6449994f14b2b9a42c784d8a61173)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:31.905370 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d3e58-cfb6-456d-8466-5ba3a9d57b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:31.905649 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d3e58-cfb6-456d-8466-5ba3a9d57b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:31.905920 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d3e58-cfb6-456d-8466-5ba3a9d57b8c admin admin] PATH_INFO: `/v3/projects/d9b0aa3a0c1447b38d2589ac9d61e622` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:31.906973 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0590c-e343-4055-86bb-70e4b51c2295 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:31.907165 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d3e58-cfb6-456d-8466-5ba3a9d57b8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9b0aa3a0c1447b38d2589ac9d61e622)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:31.910200 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d3e58-cfb6-456d-8466-5ba3a9d57b8c admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:32.018805 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-eaf0590c-e343-4055-86bb-70e4b51c2295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69c6449994f14b2b9a42c784d8a61173', 'request_id': 'req-eaf0590c-e343-4055-86bb-70e4b51c2295'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:32.028033 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-eaf0590c-e343-4055-86bb-70e4b51c2295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69c6449994f14b2b9a42c784d8a61173', 'request_id': 'req-eaf0590c-e343-4055-86bb-70e4b51c2295'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:32.034338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-eaf0590c-e343-4055-86bb-70e4b51c2295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69c6449994f14b2b9a42c784d8a61173', 'request_id': 'req-eaf0590c-e343-4055-86bb-70e4b51c2295'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:32.042499 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-df3d3e58-cfb6-456d-8466-5ba3a9d57b8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9b0aa3a0c1447b38d2589ac9d61e622', 'request_id': 'req-df3d3e58-cfb6-456d-8466-5ba3a9d57b8c'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:32.048797 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-df3d3e58-cfb6-456d-8466-5ba3a9d57b8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9b0aa3a0c1447b38d2589ac9d61e622', 'request_id': 'req-df3d3e58-cfb6-456d-8466-5ba3a9d57b8c'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:32.115732 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-eaf0590c-e343-4055-86bb-70e4b51c2295 admin admin] The token cache is being invalidate because project 69c6449994f14b2b9a42c784d8a61173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:05:32.116145 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-eaf0590c-e343-4055-86bb-70e4b51c2295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:32.116836 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-eaf0590c-e343-4055-86bb-70e4b51c2295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:32.122104 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1227/2461] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:05:31 2022] DELETE /identity/v3/projects/69c6449994f14b2b9a42c784d8a61173 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:32.122204 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0590c-e343-4055-86bb-70e4b51c2295 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:32.123471 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-eaf0590c-e343-4055-86bb-70e4b51c2295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:32.173704 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:32.184096 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-df3d3e58-cfb6-456d-8466-5ba3a9d57b8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9b0aa3a0c1447b38d2589ac9d61e622', 'request_id': 'req-df3d3e58-cfb6-456d-8466-5ba3a9d57b8c'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:32.186058 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0590c-e343-4055-86bb-70e4b51c2295 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:32.196779 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-df3d3e58-cfb6-456d-8466-5ba3a9d57b8c admin admin] The token cache is being invalidate because project d9b0aa3a0c1447b38d2589ac9d61e622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:05:32.197065 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-df3d3e58-cfb6-456d-8466-5ba3a9d57b8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:32.197701 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-df3d3e58-cfb6-456d-8466-5ba3a9d57b8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:32.199209 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1235/2462] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:05:31 2022] DELETE /identity/v3/projects/d9b0aa3a0c1447b38d2589ac9d61e622 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:32.203828 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d3e58-cfb6-456d-8466-5ba3a9d57b8c admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:32.205282 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-df3d3e58-cfb6-456d-8466-5ba3a9d57b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:32.244927 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fc9c2-cad7-4030-ada7-b5fb8bd1b852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:32.245597 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fc9c2-cad7-4030-ada7-b5fb8bd1b852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:32.245974 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fc9c2-cad7-4030-ada7-b5fb8bd1b852 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:32.246295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fc9c2-cad7-4030-ada7-b5fb8bd1b852 admin admin] PATH_INFO: `/v3/users/d9c8e7ee0d3a4563a35b221871fb454c` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:32.247429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501fc9c2-cad7-4030-ada7-b5fb8bd1b852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9c8e7ee0d3a4563a35b221871fb454c)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:32.249547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501fc9c2-cad7-4030-ada7-b5fb8bd1b852 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:32.270695 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d3e58-cfb6-456d-8466-5ba3a9d57b8c admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:32.275467 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccac38f-2f67-4d18-8821-398ea0b5785b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:32.276083 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccac38f-2f67-4d18-8821-398ea0b5785b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:32.276363 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccac38f-2f67-4d18-8821-398ea0b5785b admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:32.276632 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccac38f-2f67-4d18-8821-398ea0b5785b admin admin] PATH_INFO: `/v3/users/104d86dd436c4daeaca3266cede4a928` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:32.277753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccac38f-2f67-4d18-8821-398ea0b5785b admin admin] RBAC: Authorizing `identity:delete_user(user_id=104d86dd436c4daeaca3266cede4a928)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:32.279762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccac38f-2f67-4d18-8821-398ea0b5785b admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:32.290360 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:32.397836 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-501fc9c2-cad7-4030-ada7-b5fb8bd1b852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9c8e7ee0d3a4563a35b221871fb454c'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:32.410246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-501fc9c2-cad7-4030-ada7-b5fb8bd1b852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9c8e7ee0d3a4563a35b221871fb454c'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:32.410967 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-501fc9c2-cad7-4030-ada7-b5fb8bd1b852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9c8e7ee0d3a4563a35b221871fb454c'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:32.417978 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-501fc9c2-cad7-4030-ada7-b5fb8bd1b852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9c8e7ee0d3a4563a35b221871fb454c'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:32.443683 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-2ccac38f-2f67-4d18-8821-398ea0b5785b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '104d86dd436c4daeaca3266cede4a928'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:32.457466 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-2ccac38f-2f67-4d18-8821-398ea0b5785b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '104d86dd436c4daeaca3266cede4a928'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:32.458192 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-2ccac38f-2f67-4d18-8821-398ea0b5785b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '104d86dd436c4daeaca3266cede4a928'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:32.458836 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-2ccac38f-2f67-4d18-8821-398ea0b5785b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '104d86dd436c4daeaca3266cede4a928'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:32.465730 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-2ccac38f-2f67-4d18-8821-398ea0b5785b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '104d86dd436c4daeaca3266cede4a928'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:32.469547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-501fc9c2-cad7-4030-ada7-b5fb8bd1b852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9c8e7ee0d3a4563a35b221871fb454c'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:32.476506 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1228/2463] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:05:32 2022] DELETE /identity/v3/users/d9c8e7ee0d3a4563a35b221871fb454c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:05:32.521638 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1236/2464] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:05:32 2022] DELETE /identity/v3/users/104d86dd436c4daeaca3266cede4a928 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:05:33.038214 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fc9c2-cad7-4030-ada7-b5fb8bd1b852 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:33.040263 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-501fc9c2-cad7-4030-ada7-b5fb8bd1b852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:33.075817 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccac38f-2f67-4d18-8821-398ea0b5785b admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:33.078175 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-2ccac38f-2f67-4d18-8821-398ea0b5785b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:33.139874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fc9c2-cad7-4030-ada7-b5fb8bd1b852 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:33.153338 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccac38f-2f67-4d18-8821-398ea0b5785b admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:33.158334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbb022-de69-41a2-9278-bcc22614423b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:33.158982 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbb022-de69-41a2-9278-bcc22614423b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:33.159259 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbb022-de69-41a2-9278-bcc22614423b admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:33.159548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbb022-de69-41a2-9278-bcc22614423b admin admin] PATH_INFO: `/v3/projects/54970c71663940e4b035a872dd387a47` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:33.160805 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babbb022-de69-41a2-9278-bcc22614423b admin admin] RBAC: Authorizing `identity:delete_project(project_id=54970c71663940e4b035a872dd387a47)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:33.162744 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babbb022-de69-41a2-9278-bcc22614423b admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:33.165351 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:33.197936 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b4d5b-24e0-4413-88ee-f7de9e633a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:33.198592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b4d5b-24e0-4413-88ee-f7de9e633a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:33.198867 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b4d5b-24e0-4413-88ee-f7de9e633a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:33.199134 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b4d5b-24e0-4413-88ee-f7de9e633a29 admin admin] PATH_INFO: `/v3/projects/cfa08cb1c6924019ab3b6f81b4408aae` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:33.200240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b4d5b-24e0-4413-88ee-f7de9e633a29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa08cb1c6924019ab3b6f81b4408aae)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:33.202446 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b4d5b-24e0-4413-88ee-f7de9e633a29 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:33.259629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-babbb022-de69-41a2-9278-bcc22614423b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54970c71663940e4b035a872dd387a47', 'request_id': 'req-babbb022-de69-41a2-9278-bcc22614423b'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:33.265435 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-babbb022-de69-41a2-9278-bcc22614423b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54970c71663940e4b035a872dd387a47', 'request_id': 'req-babbb022-de69-41a2-9278-bcc22614423b'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:33.304590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a32b4d5b-24e0-4413-88ee-f7de9e633a29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa08cb1c6924019ab3b6f81b4408aae', 'request_id': 'req-a32b4d5b-24e0-4413-88ee-f7de9e633a29'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:33.314649 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a32b4d5b-24e0-4413-88ee-f7de9e633a29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa08cb1c6924019ab3b6f81b4408aae', 'request_id': 'req-a32b4d5b-24e0-4413-88ee-f7de9e633a29'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:33.316971 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a32b4d5b-24e0-4413-88ee-f7de9e633a29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa08cb1c6924019ab3b6f81b4408aae', 'request_id': 'req-a32b4d5b-24e0-4413-88ee-f7de9e633a29'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:33.327266 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-babbb022-de69-41a2-9278-bcc22614423b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54970c71663940e4b035a872dd387a47', 'request_id': 'req-babbb022-de69-41a2-9278-bcc22614423b'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:33.339078 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-babbb022-de69-41a2-9278-bcc22614423b admin admin] The token cache is being invalidate because project 54970c71663940e4b035a872dd387a47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:05:33.339361 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-babbb022-de69-41a2-9278-bcc22614423b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:33.339975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-babbb022-de69-41a2-9278-bcc22614423b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:33.341420 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1237/2465] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:05:33 2022] DELETE /identity/v3/projects/54970c71663940e4b035a872dd387a47 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:33.345968 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96a3f2-eae1-477a-b7af-726740777e7d None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:33.346291 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96a3f2-eae1-477a-b7af-726740777e7d None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:33.346564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96a3f2-eae1-477a-b7af-726740777e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:33.368257 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-3a96a3f2-eae1-477a-b7af-726740777e7d None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:33.369454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-3a96a3f2-eae1-477a-b7af-726740777e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:33.376881 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a32b4d5b-24e0-4413-88ee-f7de9e633a29 admin admin] The token cache is being invalidate because project cfa08cb1c6924019ab3b6f81b4408aae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:05:33.377190 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a32b4d5b-24e0-4413-88ee-f7de9e633a29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:33.377821 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a32b4d5b-24e0-4413-88ee-f7de9e633a29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:33.380041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1229/2466] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:05:33 2022] DELETE /identity/v3/projects/cfa08cb1c6924019ab3b6f81b4408aae => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:33.384175 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:33.384802 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8f0a2-e14a-4183-b9ba-f057f1cce280 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:33.389539 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8f0a2-e14a-4183-b9ba-f057f1cce280 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:33.389539 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8f0a2-e14a-4183-b9ba-f057f1cce280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:33.404926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-0fd8f0a2-e14a-4183-b9ba-f057f1cce280 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:33.406150 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-0fd8f0a2-e14a-4183-b9ba-f057f1cce280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:33.434145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1238/2467] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:05:33.442024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e614849-ea92-4fac-848d-977c4252884a None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:33.442993 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e614849-ea92-4fac-848d-977c4252884a None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:33.443333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e614849-ea92-4fac-848d-977c4252884a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:33.462794 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-1e614849-ea92-4fac-848d-977c4252884a None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:33.463948 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-1e614849-ea92-4fac-848d-977c4252884a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:33.466879 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1230/2468] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:05:33.472620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1239/2469] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:05:33.475170 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954bd8c-812c-4a01-a29b-58a0e0d810f9 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:33.475459 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954bd8c-812c-4a01-a29b-58a0e0d810f9 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:33.475982 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954bd8c-812c-4a01-a29b-58a0e0d810f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:33.476720 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e614849-ea92-4fac-848d-977c4252884a None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:33.486069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e614849-ea92-4fac-848d-977c4252884a None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:33.492231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec94776-478e-43e6-80cc-f2bfbb5f225d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:33.492822 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec94776-478e-43e6-80cc-f2bfbb5f225d admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:33.493109 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec94776-478e-43e6-80cc-f2bfbb5f225d admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:33.493363 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec94776-478e-43e6-80cc-f2bfbb5f225d admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:33.493996 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec94776-478e-43e6-80cc-f2bfbb5f225d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:05:33.494329 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec94776-478e-43e6-80cc-f2bfbb5f225d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:33.495904 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec94776-478e-43e6-80cc-f2bfbb5f225d admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:33.496133 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-e954bd8c-812c-4a01-a29b-58a0e0d810f9 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:33.497348 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-e954bd8c-812c-4a01-a29b-58a0e0d810f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:33.505575 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1231/2470] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:05:33.511095 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1240/2471] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:05:33.511264 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954bd8c-812c-4a01-a29b-58a0e0d810f9 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:33.512037 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec94776-478e-43e6-80cc-f2bfbb5f225d admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:33.519067 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954bd8c-812c-4a01-a29b-58a0e0d810f9 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:33.521749 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec94776-478e-43e6-80cc-f2bfbb5f225d admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:33.523700 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986626a4-188a-4e4b-afd1-43623c3aadbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:33.524293 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986626a4-188a-4e4b-afd1-43623c3aadbf admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:33.524567 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986626a4-188a-4e4b-afd1-43623c3aadbf admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:33.524840 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986626a4-188a-4e4b-afd1-43623c3aadbf admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:33.525474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986626a4-188a-4e4b-afd1-43623c3aadbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:05:33.525950 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986626a4-188a-4e4b-afd1-43623c3aadbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:33.526505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0127eb-2b6e-41a9-b27c-7849ac900933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:33.527076 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0127eb-2b6e-41a9-b27c-7849ac900933 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:33.527346 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0127eb-2b6e-41a9-b27c-7849ac900933 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:33.527520 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986626a4-188a-4e4b-afd1-43623c3aadbf admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:33.527619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0127eb-2b6e-41a9-b27c-7849ac900933 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:33.528192 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0127eb-2b6e-41a9-b27c-7849ac900933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:33.530277 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0127eb-2b6e-41a9-b27c-7849ac900933 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:33.539654 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1232/2472] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:05:33.544111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986626a4-188a-4e4b-afd1-43623c3aadbf admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:33.562331 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986626a4-188a-4e4b-afd1-43623c3aadbf admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:33.562331 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2957b3f-39f2-4bc3-8037-e6789bb943f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:33.562331 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2957b3f-39f2-4bc3-8037-e6789bb943f8 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:33.562331 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2957b3f-39f2-4bc3-8037-e6789bb943f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:33.562843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2957b3f-39f2-4bc3-8037-e6789bb943f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:33.562843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2957b3f-39f2-4bc3-8037-e6789bb943f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:33.563119 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2957b3f-39f2-4bc3-8037-e6789bb943f8 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:33.626023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1241/2473] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:05:33 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:05:33.630282 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0127eb-2b6e-41a9-b27c-7849ac900933 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:33.636826 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1233/2474] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:05:33 2022] POST /identity/v3/projects => generated 409 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:05:33.640844 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2957b3f-39f2-4bc3-8037-e6789bb943f8 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:33.665528 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:33.699700 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0127eb-2b6e-41a9-b27c-7849ac900933 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:33.711608 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2957b3f-39f2-4bc3-8037-e6789bb943f8 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:33.717995 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70259547-c094-4829-88a6-e0e7633b985b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:33.718791 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70259547-c094-4829-88a6-e0e7633b985b admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:33.719584 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70259547-c094-4829-88a6-e0e7633b985b admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:33.719861 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70259547-c094-4829-88a6-e0e7633b985b admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:33.720549 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70259547-c094-4829-88a6-e0e7633b985b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:33.722945 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70259547-c094-4829-88a6-e0e7633b985b admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:33.759553 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d28534-a275-4235-9d8f-22b49cb69e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:33.760178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d28534-a275-4235-9d8f-22b49cb69e14 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:33.760449 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d28534-a275-4235-9d8f-22b49cb69e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:33.760715 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d28534-a275-4235-9d8f-22b49cb69e14 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:33.761326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d28534-a275-4235-9d8f-22b49cb69e14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:33.763246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d28534-a275-4235-9d8f-22b49cb69e14 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:33.858651 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1234/2475] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:05:33 2022] POST /identity/v3/users => generated 305 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:05:33.858851 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1242/2476] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:05:33 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:05:33.862650 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70259547-c094-4829-88a6-e0e7633b985b admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:33.867192 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d28534-a275-4235-9d8f-22b49cb69e14 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:33.872415 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70259547-c094-4829-88a6-e0e7633b985b admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:33.872863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d28534-a275-4235-9d8f-22b49cb69e14 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:33.877106 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a378c-ac97-4d1f-91f4-c39731d0e789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:33.877568 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63500a6d-ae2b-4734-9431-5b2fc34897e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:33.877724 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a378c-ac97-4d1f-91f4-c39731d0e789 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:33.877889 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a378c-ac97-4d1f-91f4-c39731d0e789 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:33.878184 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a378c-ac97-4d1f-91f4-c39731d0e789 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:33.878329 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63500a6d-ae2b-4734-9431-5b2fc34897e0 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:33.878462 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63500a6d-ae2b-4734-9431-5b2fc34897e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:33.878730 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63500a6d-ae2b-4734-9431-5b2fc34897e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:33.878933 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a378c-ac97-4d1f-91f4-c39731d0e789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:33.879352 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63500a6d-ae2b-4734-9431-5b2fc34897e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:33.880550 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a378c-ac97-4d1f-91f4-c39731d0e789 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:33.880894 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63500a6d-ae2b-4734-9431-5b2fc34897e0 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:33.890516 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1235/2477] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:05:33.892299 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1243/2478] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:05:33.895116 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a378c-ac97-4d1f-91f4-c39731d0e789 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:33.898283 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63500a6d-ae2b-4734-9431-5b2fc34897e0 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:33.903302 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:33.905153 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a378c-ac97-4d1f-91f4-c39731d0e789 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:33.908103 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63500a6d-ae2b-4734-9431-5b2fc34897e0 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:33.910477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d40c6-ea04-493c-87ec-8eb92a116631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:33.911066 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d40c6-ea04-493c-87ec-8eb92a116631 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:33.911344 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d40c6-ea04-493c-87ec-8eb92a116631 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:33.911616 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d40c6-ea04-493c-87ec-8eb92a116631 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:33.912246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d40c6-ea04-493c-87ec-8eb92a116631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:33.913642 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2058dc8-5ba1-43ab-9718-6da828197aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:33.913959 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d40c6-ea04-493c-87ec-8eb92a116631 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:33.914426 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2058dc8-5ba1-43ab-9718-6da828197aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:33.914808 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2058dc8-5ba1-43ab-9718-6da828197aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:33.915084 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2058dc8-5ba1-43ab-9718-6da828197aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:33.915708 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2058dc8-5ba1-43ab-9718-6da828197aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:33.917261 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2058dc8-5ba1-43ab-9718-6da828197aa5 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:33.925287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1236/2479] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:05:33.930109 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1244/2480] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:05:33.931537 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d40c6-ea04-493c-87ec-8eb92a116631 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:33.931784 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2058dc8-5ba1-43ab-9718-6da828197aa5 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:33.941948 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2058dc8-5ba1-43ab-9718-6da828197aa5 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:33.947394 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a4dad-8e66-4c64-a582-ebe2cacbf684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:33.948086 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a4dad-8e66-4c64-a582-ebe2cacbf684 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:33.948306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d40c6-ea04-493c-87ec-8eb92a116631 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:33.948412 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a4dad-8e66-4c64-a582-ebe2cacbf684 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:33.948609 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a4dad-8e66-4c64-a582-ebe2cacbf684 admin admin] PATH_INFO: `/v3/projects/298d233f37b049a3bb60a541824cc10b/users/b9f7f6ef80fb4f859c7dc85e4109e2d2/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:33.953295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87210b38-803f-4b70-ad6e-d0d87275792e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:33.953942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87210b38-803f-4b70-ad6e-d0d87275792e admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:33.954281 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87210b38-803f-4b70-ad6e-d0d87275792e admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:33.954552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87210b38-803f-4b70-ad6e-d0d87275792e admin admin] PATH_INFO: `/v3/projects/e739e043c3c94f47ae33a21b7ea910bb/users/953e82b17c34452fa8c5546febc1ca2b/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:33.963684 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a4dad-8e66-4c64-a582-ebe2cacbf684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=298d233f37b049a3bb60a541824cc10b, user_id=b9f7f6ef80fb4f859c7dc85e4109e2d2, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:33.966342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a4dad-8e66-4c64-a582-ebe2cacbf684 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:33.969553 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87210b38-803f-4b70-ad6e-d0d87275792e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e739e043c3c94f47ae33a21b7ea910bb, user_id=953e82b17c34452fa8c5546febc1ca2b, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:33.972986 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87210b38-803f-4b70-ad6e-d0d87275792e admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:34.047261 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1245/2481] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:05:33 2022] PUT /identity/v3/projects/298d233f37b049a3bb60a541824cc10b/users/b9f7f6ef80fb4f859c7dc85e4109e2d2/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:05:34.057360 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21408af9-7008-4352-8c95-0c280280e842 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:34.057642 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21408af9-7008-4352-8c95-0c280280e842 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:34.057743 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1237/2482] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:05:33 2022] PUT /identity/v3/projects/e739e043c3c94f47ae33a21b7ea910bb/users/953e82b17c34452fa8c5546febc1ca2b/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:34.058208 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21408af9-7008-4352-8c95-0c280280e842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:34.067756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b44f6-72a8-4c30-82d2-d527890960dd None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:34.068031 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b44f6-72a8-4c30-82d2-d527890960dd None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:34.068305 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b44f6-72a8-4c30-82d2-d527890960dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:34.087994 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-21408af9-7008-4352-8c95-0c280280e842 None None] MFA Rules not processed for user `b9f7f6ef80fb4f859c7dc85e4109e2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:34.089301 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-21408af9-7008-4352-8c95-0c280280e842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:34.099824 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-fc1b44f6-72a8-4c30-82d2-d527890960dd None None] MFA Rules not processed for user `953e82b17c34452fa8c5546febc1ca2b`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:34.101201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-fc1b44f6-72a8-4c30-82d2-d527890960dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:34.168910 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1246/2483] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:05:34.173485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21408af9-7008-4352-8c95-0c280280e842 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:34.177533 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1238/2484] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:34 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:05:34.178433 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b44f6-72a8-4c30-82d2-d527890960dd None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:34.235006 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:34.249635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b44f6-72a8-4c30-82d2-d527890960dd None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:34.250980 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21408af9-7008-4352-8c95-0c280280e842 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:34.255145 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedbc61-4b18-4ad6-bf55-922b75d63657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:34.255753 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedbc61-4b18-4ad6-bf55-922b75d63657 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:34.256028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedbc61-4b18-4ad6-bf55-922b75d63657 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:34.256294 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedbc61-4b18-4ad6-bf55-922b75d63657 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:34.256912 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedbc61-4b18-4ad6-bf55-922b75d63657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:34.257157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d4ae2-1962-4015-b342-a448ec2ab977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:34.257878 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d4ae2-1962-4015-b342-a448ec2ab977 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:34.258192 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d4ae2-1962-4015-b342-a448ec2ab977 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:34.258462 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d4ae2-1962-4015-b342-a448ec2ab977 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:34.259077 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d4ae2-1962-4015-b342-a448ec2ab977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:34.259195 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedbc61-4b18-4ad6-bf55-922b75d63657 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:34.261044 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d4ae2-1962-4015-b342-a448ec2ab977 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:34.342114 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1247/2485] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:05:34 2022] POST /identity/v3/projects => generated 369 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:05:34.344903 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d4ae2-1962-4015-b342-a448ec2ab977 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:34.375175 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1239/2486] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:05:34 2022] POST /identity/v3/projects => generated 409 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:05:34.379629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedbc61-4b18-4ad6-bf55-922b75d63657 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:34.389671 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:34.407479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d4ae2-1962-4015-b342-a448ec2ab977 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:34.442424 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedbc61-4b18-4ad6-bf55-922b75d63657 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:34.447332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1264fa8-8fcb-4ea1-a954-e8d127d0eea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:34.448018 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1264fa8-8fcb-4ea1-a954-e8d127d0eea2 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:34.448296 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1264fa8-8fcb-4ea1-a954-e8d127d0eea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:34.448568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1264fa8-8fcb-4ea1-a954-e8d127d0eea2 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:34.449189 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1264fa8-8fcb-4ea1-a954-e8d127d0eea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:34.451196 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1264fa8-8fcb-4ea1-a954-e8d127d0eea2 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:34.462749 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcea1bb-1f49-4dab-a409-79eafaa22dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:34.463349 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcea1bb-1f49-4dab-a409-79eafaa22dec admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:34.463626 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcea1bb-1f49-4dab-a409-79eafaa22dec admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:34.463891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcea1bb-1f49-4dab-a409-79eafaa22dec admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:34.464493 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcea1bb-1f49-4dab-a409-79eafaa22dec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:34.466409 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcea1bb-1f49-4dab-a409-79eafaa22dec admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:34.544877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1248/2487] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:05:34 2022] POST /identity/v3/users => generated 291 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:05:34.547236 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1240/2488] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:05:34 2022] POST /identity/v3/users => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:05:34.548903 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcea1bb-1f49-4dab-a409-79eafaa22dec admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:34.551407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1264fa8-8fcb-4ea1-a954-e8d127d0eea2 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:34.559430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcea1bb-1f49-4dab-a409-79eafaa22dec admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:34.564040 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9524c-3de9-4201-867f-fcb7e39fbbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:34.567222 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1264fa8-8fcb-4ea1-a954-e8d127d0eea2 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:34.567345 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9524c-3de9-4201-867f-fcb7e39fbbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:34.567345 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9524c-3de9-4201-867f-fcb7e39fbbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:34.567345 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9524c-3de9-4201-867f-fcb7e39fbbb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:34.567345 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9524c-3de9-4201-867f-fcb7e39fbbb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:34.567923 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9524c-3de9-4201-867f-fcb7e39fbbb0 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:34.570351 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d254b6-beac-4935-adb0-d07e3071bf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:34.570963 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d254b6-beac-4935-adb0-d07e3071bf02 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:34.571303 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d254b6-beac-4935-adb0-d07e3071bf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:34.571507 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d254b6-beac-4935-adb0-d07e3071bf02 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:34.572148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d254b6-beac-4935-adb0-d07e3071bf02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:34.573737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d254b6-beac-4935-adb0-d07e3071bf02 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:34.581095 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1249/2489] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:05:34.584636 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1241/2490] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:05:34.586220 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9524c-3de9-4201-867f-fcb7e39fbbb0 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:34.588467 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d254b6-beac-4935-adb0-d07e3071bf02 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:34.595932 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9524c-3de9-4201-867f-fcb7e39fbbb0 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:34.598493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d254b6-beac-4935-adb0-d07e3071bf02 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:34.600587 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ded58-91f5-46f0-96c1-51d69cf62799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:34.601215 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ded58-91f5-46f0-96c1-51d69cf62799 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:34.601490 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ded58-91f5-46f0-96c1-51d69cf62799 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:34.601757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ded58-91f5-46f0-96c1-51d69cf62799 admin admin] PATH_INFO: `/v3/projects/20d1bfb81a4b40b6b67bee2df803fee1/users/a90e8c9522bc43769162a8460ad554a6/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:34.603111 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b3afe-2750-4ec4-bb3c-61fbf5f685de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:34.603740 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b3afe-2750-4ec4-bb3c-61fbf5f685de admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:34.604022 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b3afe-2750-4ec4-bb3c-61fbf5f685de admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:34.604301 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b3afe-2750-4ec4-bb3c-61fbf5f685de admin admin] PATH_INFO: `/v3/projects/ec2e48462f094c98896d9a8e16a54886/users/6cad5ee2435d496ba9c009236b7d2d83/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:34.616630 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ded58-91f5-46f0-96c1-51d69cf62799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d1bfb81a4b40b6b67bee2df803fee1, user_id=a90e8c9522bc43769162a8460ad554a6, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:34.619357 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ded58-91f5-46f0-96c1-51d69cf62799 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:34.620312 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b3afe-2750-4ec4-bb3c-61fbf5f685de admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec2e48462f094c98896d9a8e16a54886, user_id=6cad5ee2435d496ba9c009236b7d2d83, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:34.623243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b3afe-2750-4ec4-bb3c-61fbf5f685de admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:34.714743 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1250/2491] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:05:34 2022] PUT /identity/v3/projects/20d1bfb81a4b40b6b67bee2df803fee1/users/a90e8c9522bc43769162a8460ad554a6/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:05:34.718749 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ded58-91f5-46f0-96c1-51d69cf62799 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:34.745961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1242/2492] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:05:34 2022] PUT /identity/v3/projects/ec2e48462f094c98896d9a8e16a54886/users/6cad5ee2435d496ba9c009236b7d2d83/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:34.749861 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b3afe-2750-4ec4-bb3c-61fbf5f685de admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:34.782105 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ded58-91f5-46f0-96c1-51d69cf62799 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:34.812122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b3afe-2750-4ec4-bb3c-61fbf5f685de admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:34.817732 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab8386-7544-43c5-9e6f-df0ba7fc080f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:34.818368 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab8386-7544-43c5-9e6f-df0ba7fc080f admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:34.818637 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab8386-7544-43c5-9e6f-df0ba7fc080f admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:34.818903 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab8386-7544-43c5-9e6f-df0ba7fc080f admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:34.819561 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab8386-7544-43c5-9e6f-df0ba7fc080f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:34.821137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab8386-7544-43c5-9e6f-df0ba7fc080f admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:34.831261 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1243/2493] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:05:34.831994 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:34.835586 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab8386-7544-43c5-9e6f-df0ba7fc080f admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:34.841316 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1b28d-ac4c-421e-868c-cbf31a6ebd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:34.841972 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1b28d-ac4c-421e-868c-cbf31a6ebd57 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:34.842326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1b28d-ac4c-421e-868c-cbf31a6ebd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:34.844490 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1b28d-ac4c-421e-868c-cbf31a6ebd57 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:34.844490 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1b28d-ac4c-421e-868c-cbf31a6ebd57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:34.844965 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1b28d-ac4c-421e-868c-cbf31a6ebd57 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:34.845122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab8386-7544-43c5-9e6f-df0ba7fc080f admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:34.853568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386c631-b8eb-4808-9297-f024551e6c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:34.854268 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386c631-b8eb-4808-9297-f024551e6c46 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:34.854554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386c631-b8eb-4808-9297-f024551e6c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:34.855450 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386c631-b8eb-4808-9297-f024551e6c46 admin admin] PATH_INFO: `/v3/projects/ec2e48462f094c98896d9a8e16a54886/users/6cad5ee2435d496ba9c009236b7d2d83/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:34.857488 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386c631-b8eb-4808-9297-f024551e6c46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec2e48462f094c98896d9a8e16a54886, user_id=6cad5ee2435d496ba9c009236b7d2d83, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:34.858190 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1251/2494] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:05:34.860228 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386c631-b8eb-4808-9297-f024551e6c46 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:34.861826 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1b28d-ac4c-421e-868c-cbf31a6ebd57 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:34.871537 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1244/2495] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:05:34 2022] PUT /identity/v3/projects/ec2e48462f094c98896d9a8e16a54886/users/6cad5ee2435d496ba9c009236b7d2d83/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:05:34.874778 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1b28d-ac4c-421e-868c-cbf31a6ebd57 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:34.882965 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92330b-1d1c-4a9f-8753-0207d548f1de None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:34.883246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92330b-1d1c-4a9f-8753-0207d548f1de None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:34.883528 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92330b-1d1c-4a9f-8753-0207d548f1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:34.904973 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:34.913183 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-af92330b-1d1c-4a9f-8753-0207d548f1de None None] MFA Rules not processed for user `6cad5ee2435d496ba9c009236b7d2d83`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:34.914440 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-af92330b-1d1c-4a9f-8753-0207d548f1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:34.933593 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a03fe-7d31-4c68-b59d-180eaf4d269c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:34.934278 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a03fe-7d31-4c68-b59d-180eaf4d269c admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:34.934552 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a03fe-7d31-4c68-b59d-180eaf4d269c admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:34.934822 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a03fe-7d31-4c68-b59d-180eaf4d269c admin admin] PATH_INFO: `/v3/projects/20d1bfb81a4b40b6b67bee2df803fee1/users/a90e8c9522bc43769162a8460ad554a6/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:34.936979 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a03fe-7d31-4c68-b59d-180eaf4d269c admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d1bfb81a4b40b6b67bee2df803fee1, user_id=a90e8c9522bc43769162a8460ad554a6, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:34.940261 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a03fe-7d31-4c68-b59d-180eaf4d269c admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:34.950409 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1252/2496] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:05:34 2022] PUT /identity/v3/projects/20d1bfb81a4b40b6b67bee2df803fee1/users/a90e8c9522bc43769162a8460ad554a6/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:05:34.962286 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e6d3b-34df-47f4-922d-2dc22bea23a4 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:34.965311 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e6d3b-34df-47f4-922d-2dc22bea23a4 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:34.965311 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e6d3b-34df-47f4-922d-2dc22bea23a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:34.986248 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1245/2497] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:34 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:05:34.993676 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-490e6d3b-34df-47f4-922d-2dc22bea23a4 None None] MFA Rules not processed for user `a90e8c9522bc43769162a8460ad554a6`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:34.995244 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-490e6d3b-34df-47f4-922d-2dc22bea23a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:34.997009 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92330b-1d1c-4a9f-8753-0207d548f1de None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:34.998940 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-af92330b-1d1c-4a9f-8753-0207d548f1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:35.059428 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92330b-1d1c-4a9f-8753-0207d548f1de None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:35.066359 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1253/2498] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:05:35.077745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e6d3b-34df-47f4-922d-2dc22bea23a4 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:35.079152 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-490e6d3b-34df-47f4-922d-2dc22bea23a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:35.114991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03242a3-6ed1-4a9a-b298-35766a72f95e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:35.115937 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03242a3-6ed1-4a9a-b298-35766a72f95e service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:35.116215 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03242a3-6ed1-4a9a-b298-35766a72f95e service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:35.116488 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03242a3-6ed1-4a9a-b298-35766a72f95e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:35.138380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e6d3b-34df-47f4-922d-2dc22bea23a4 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:35.142007 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe211381-6fe8-441e-b941-6fbe57c05b28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:35.142646 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe211381-6fe8-441e-b941-6fbe57c05b28 service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:35.142917 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe211381-6fe8-441e-b941-6fbe57c05b28 service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:35.143186 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe211381-6fe8-441e-b941-6fbe57c05b28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:35.152881 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe211381-6fe8-441e-b941-6fbe57c05b28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:35.154457 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe211381-6fe8-441e-b941-6fbe57c05b28 service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:35.168810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1254/2499] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:05:35.178641 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03242a3-6ed1-4a9a-b298-35766a72f95e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:35.180293 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03242a3-6ed1-4a9a-b298-35766a72f95e service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:35.190313 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1246/2500] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:34 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:05:35.530643 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe211381-6fe8-441e-b941-6fbe57c05b28 service cinder] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:35.539619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe211381-6fe8-441e-b941-6fbe57c05b28 service cinder] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:35.543289 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c428d5e-ab67-411c-8862-74b2fac27e13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:35.543948 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428d5e-ab67-411c-8862-74b2fac27e13 service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:35.544157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428d5e-ab67-411c-8862-74b2fac27e13 service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:35.544427 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428d5e-ab67-411c-8862-74b2fac27e13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:35.550157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:35.603637 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c428d5e-ab67-411c-8862-74b2fac27e13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:35.605096 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c428d5e-ab67-411c-8862-74b2fac27e13 service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:35.613950 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1255/2501] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:35 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:05:36.481437 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03242a3-6ed1-4a9a-b298-35766a72f95e service cinder] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:36.485764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:36.545723 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03242a3-6ed1-4a9a-b298-35766a72f95e service cinder] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:36.551444 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858cf93-eb61-4218-9ec5-6039ac37ad86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:36.552149 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858cf93-eb61-4218-9ec5-6039ac37ad86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:36.552425 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858cf93-eb61-4218-9ec5-6039ac37ad86 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:36.552689 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858cf93-eb61-4218-9ec5-6039ac37ad86 admin admin] PATH_INFO: `/v3/users/b9f7f6ef80fb4f859c7dc85e4109e2d2` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:36.553938 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858cf93-eb61-4218-9ec5-6039ac37ad86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9f7f6ef80fb4f859c7dc85e4109e2d2)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:36.556057 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858cf93-eb61-4218-9ec5-6039ac37ad86 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:36.717721 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-e858cf93-eb61-4218-9ec5-6039ac37ad86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9f7f6ef80fb4f859c7dc85e4109e2d2'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:36.729870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-e858cf93-eb61-4218-9ec5-6039ac37ad86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9f7f6ef80fb4f859c7dc85e4109e2d2'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:36.730479 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-e858cf93-eb61-4218-9ec5-6039ac37ad86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9f7f6ef80fb4f859c7dc85e4109e2d2'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:36.737167 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-e858cf93-eb61-4218-9ec5-6039ac37ad86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9f7f6ef80fb4f859c7dc85e4109e2d2'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:36.778385 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-e858cf93-eb61-4218-9ec5-6039ac37ad86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9f7f6ef80fb4f859c7dc85e4109e2d2'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:36.784455 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1247/2502] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:05:36 2022] DELETE /identity/v3/users/b9f7f6ef80fb4f859c7dc85e4109e2d2 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:36.789495 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc5a4e-cb0e-413d-8627-a8ca983d8d04 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:36.789955 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc5a4e-cb0e-413d-8627-a8ca983d8d04 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:36.790069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc5a4e-cb0e-413d-8627-a8ca983d8d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:36.810564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-abdc5a4e-cb0e-413d-8627-a8ca983d8d04 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:36.811773 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-abdc5a4e-cb0e-413d-8627-a8ca983d8d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:36.868901 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1256/2503] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:36.878886 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858cf93-eb61-4218-9ec5-6039ac37ad86 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:36.880291 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-e858cf93-eb61-4218-9ec5-6039ac37ad86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:36.938612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858cf93-eb61-4218-9ec5-6039ac37ad86 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:36.942260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73cc0f-8d25-46c7-b5dc-5a2086d77cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:36.942947 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73cc0f-8d25-46c7-b5dc-5a2086d77cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:36.943247 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73cc0f-8d25-46c7-b5dc-5a2086d77cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:36.943515 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73cc0f-8d25-46c7-b5dc-5a2086d77cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:36.952420 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73cc0f-8d25-46c7-b5dc-5a2086d77cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:36.953836 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73cc0f-8d25-46c7-b5dc-5a2086d77cc2 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:36.963482 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1248/2504] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:05:37.363242 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc5a4e-cb0e-413d-8627-a8ca983d8d04 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:37.364663 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-abdc5a4e-cb0e-413d-8627-a8ca983d8d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:37.392828 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc5a4e-cb0e-413d-8627-a8ca983d8d04 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:37.392828 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de93e23-e979-4527-8abf-8fc222048842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:37.392828 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de93e23-e979-4527-8abf-8fc222048842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:37.392828 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de93e23-e979-4527-8abf-8fc222048842 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:37.393228 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de93e23-e979-4527-8abf-8fc222048842 admin admin] PATH_INFO: `/v3/projects/298d233f37b049a3bb60a541824cc10b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:37.393333 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de93e23-e979-4527-8abf-8fc222048842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=298d233f37b049a3bb60a541824cc10b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:37.395777 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de93e23-e979-4527-8abf-8fc222048842 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:37.494188 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-7de93e23-e979-4527-8abf-8fc222048842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '298d233f37b049a3bb60a541824cc10b', 'request_id': 'req-7de93e23-e979-4527-8abf-8fc222048842'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:37.499757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-7de93e23-e979-4527-8abf-8fc222048842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '298d233f37b049a3bb60a541824cc10b', 'request_id': 'req-7de93e23-e979-4527-8abf-8fc222048842'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:37.550101 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-7de93e23-e979-4527-8abf-8fc222048842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '298d233f37b049a3bb60a541824cc10b', 'request_id': 'req-7de93e23-e979-4527-8abf-8fc222048842'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:37.562103 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-7de93e23-e979-4527-8abf-8fc222048842 admin admin] The token cache is being invalidate because project 298d233f37b049a3bb60a541824cc10b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:05:37.562486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-7de93e23-e979-4527-8abf-8fc222048842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:37.563024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-7de93e23-e979-4527-8abf-8fc222048842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:37.564467 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1257/2505] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:05:37 2022] DELETE /identity/v3/projects/298d233f37b049a3bb60a541824cc10b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:37.569219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73cc0f-8d25-46c7-b5dc-5a2086d77cc2 service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:37.579292 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73cc0f-8d25-46c7-b5dc-5a2086d77cc2 service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:37.598965 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:37.636589 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93690e0-db4d-4bf4-a733-2c334007bd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:37.637751 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93690e0-db4d-4bf4-a733-2c334007bd14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:37.638175 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93690e0-db4d-4bf4-a733-2c334007bd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:37.638476 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93690e0-db4d-4bf4-a733-2c334007bd14 admin admin] PATH_INFO: `/v3/users/a90e8c9522bc43769162a8460ad554a6` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:37.639650 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93690e0-db4d-4bf4-a733-2c334007bd14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a90e8c9522bc43769162a8460ad554a6)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:37.641621 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93690e0-db4d-4bf4-a733-2c334007bd14 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:37.832061 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-d93690e0-db4d-4bf4-a733-2c334007bd14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a90e8c9522bc43769162a8460ad554a6'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:37.844121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-d93690e0-db4d-4bf4-a733-2c334007bd14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a90e8c9522bc43769162a8460ad554a6'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:37.844817 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-d93690e0-db4d-4bf4-a733-2c334007bd14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a90e8c9522bc43769162a8460ad554a6'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:37.852315 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-d93690e0-db4d-4bf4-a733-2c334007bd14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a90e8c9522bc43769162a8460ad554a6'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:37.898402 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-d93690e0-db4d-4bf4-a733-2c334007bd14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a90e8c9522bc43769162a8460ad554a6'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:37.904701 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1249/2506] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:05:37 2022] DELETE /identity/v3/users/a90e8c9522bc43769162a8460ad554a6 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:38.293688 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de93e23-e979-4527-8abf-8fc222048842 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:38.295128 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-7de93e23-e979-4527-8abf-8fc222048842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:38.309195 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de93e23-e979-4527-8abf-8fc222048842 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:38.342466 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:38.370691 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e9c02-d865-4e09-bf2a-28734689cbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:38.371270 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e9c02-d865-4e09-bf2a-28734689cbb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:38.371549 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e9c02-d865-4e09-bf2a-28734689cbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:38.371812 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e9c02-d865-4e09-bf2a-28734689cbb3 admin admin] PATH_INFO: `/v3/projects/20d1bfb81a4b40b6b67bee2df803fee1` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:38.372919 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e9c02-d865-4e09-bf2a-28734689cbb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20d1bfb81a4b40b6b67bee2df803fee1)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:38.374860 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e9c02-d865-4e09-bf2a-28734689cbb3 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:38.498045 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-a72e9c02-d865-4e09-bf2a-28734689cbb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20d1bfb81a4b40b6b67bee2df803fee1', 'request_id': 'req-a72e9c02-d865-4e09-bf2a-28734689cbb3'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:38.503657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-a72e9c02-d865-4e09-bf2a-28734689cbb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20d1bfb81a4b40b6b67bee2df803fee1', 'request_id': 'req-a72e9c02-d865-4e09-bf2a-28734689cbb3'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:38.584306 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-a72e9c02-d865-4e09-bf2a-28734689cbb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20d1bfb81a4b40b6b67bee2df803fee1', 'request_id': 'req-a72e9c02-d865-4e09-bf2a-28734689cbb3'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:38.595570 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-a72e9c02-d865-4e09-bf2a-28734689cbb3 admin admin] The token cache is being invalidate because project 20d1bfb81a4b40b6b67bee2df803fee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:05:38.595849 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-a72e9c02-d865-4e09-bf2a-28734689cbb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:38.596457 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-a72e9c02-d865-4e09-bf2a-28734689cbb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:38.598576 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1258/2507] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:05:38 2022] DELETE /identity/v3/projects/20d1bfb81a4b40b6b67bee2df803fee1 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:38.605563 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b076b53-f47d-4b50-a639-7b61a13c95db None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:38.606040 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b076b53-f47d-4b50-a639-7b61a13c95db None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:38.606171 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b076b53-f47d-4b50-a639-7b61a13c95db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:38.625014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-2b076b53-f47d-4b50-a639-7b61a13c95db None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:38.626258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-2b076b53-f47d-4b50-a639-7b61a13c95db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:38.686617 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1250/2508] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:38.694912 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c793128-068d-423a-8fe3-a0640496957e None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:38.695196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c793128-068d-423a-8fe3-a0640496957e None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:38.695468 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c793128-068d-423a-8fe3-a0640496957e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:38.715648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-3c793128-068d-423a-8fe3-a0640496957e None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:38.716903 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-3c793128-068d-423a-8fe3-a0640496957e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:38.725033 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1259/2509] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:38.729567 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b076b53-f47d-4b50-a639-7b61a13c95db None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:38.739154 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b076b53-f47d-4b50-a639-7b61a13c95db None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:38.743709 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00142a-474b-448d-9bdb-3687e2461d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:38.744298 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00142a-474b-448d-9bdb-3687e2461d46 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:38.744569 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00142a-474b-448d-9bdb-3687e2461d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:38.744834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00142a-474b-448d-9bdb-3687e2461d46 admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:38.745477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00142a-474b-448d-9bdb-3687e2461d46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:05:38.745776 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00142a-474b-448d-9bdb-3687e2461d46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:38.747508 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00142a-474b-448d-9bdb-3687e2461d46 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:38.759582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1251/2510] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:05:38.763978 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c793128-068d-423a-8fe3-a0640496957e None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:38.775105 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c793128-068d-423a-8fe3-a0640496957e None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:38.779762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adb9ae-52da-4fe3-a140-e10293c14933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:38.780349 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adb9ae-52da-4fe3-a140-e10293c14933 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:38.780618 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adb9ae-52da-4fe3-a140-e10293c14933 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:38.780880 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adb9ae-52da-4fe3-a140-e10293c14933 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:38.781499 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52adb9ae-52da-4fe3-a140-e10293c14933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:38.783451 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52adb9ae-52da-4fe3-a140-e10293c14933 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:38.900036 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1260/2511] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:05:38 2022] POST /identity/v3/projects => generated 369 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:05:38.904435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00142a-474b-448d-9bdb-3687e2461d46 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:38.914645 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00142a-474b-448d-9bdb-3687e2461d46 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:38.944590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:38.979171 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87736c-8773-4a9e-86f4-31b952d9d584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:38.979787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87736c-8773-4a9e-86f4-31b952d9d584 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:38.980065 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87736c-8773-4a9e-86f4-31b952d9d584 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:38.980330 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87736c-8773-4a9e-86f4-31b952d9d584 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:38.980950 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87736c-8773-4a9e-86f4-31b952d9d584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:38.983348 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87736c-8773-4a9e-86f4-31b952d9d584 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:39.090993 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1252/2512] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:05:38 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:05:39.092860 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adb9ae-52da-4fe3-a140-e10293c14933 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:39.110046 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adb9ae-52da-4fe3-a140-e10293c14933 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:39.115639 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e0212-01b9-4b29-992c-126c0645082a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:39.116372 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e0212-01b9-4b29-992c-126c0645082a admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:39.116716 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e0212-01b9-4b29-992c-126c0645082a admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:39.117057 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e0212-01b9-4b29-992c-126c0645082a admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:39.117792 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e0212-01b9-4b29-992c-126c0645082a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:39.119558 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e0212-01b9-4b29-992c-126c0645082a admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:39.135285 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1261/2513] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:05:39.135397 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87736c-8773-4a9e-86f4-31b952d9d584 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:39.148885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87736c-8773-4a9e-86f4-31b952d9d584 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:39.153885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7648b-f8a5-47b0-b61c-cbef575ebaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:39.158387 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7648b-f8a5-47b0-b61c-cbef575ebaee admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:39.158387 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7648b-f8a5-47b0-b61c-cbef575ebaee admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:39.158387 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7648b-f8a5-47b0-b61c-cbef575ebaee admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:39.158387 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7648b-f8a5-47b0-b61c-cbef575ebaee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:39.158387 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7648b-f8a5-47b0-b61c-cbef575ebaee admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:39.168547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1253/2514] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:05:39.172662 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e0212-01b9-4b29-992c-126c0645082a admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:39.183849 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e0212-01b9-4b29-992c-126c0645082a admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:39.189290 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9e8c3-ee24-4c3d-8c5d-efe491e78391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:39.190210 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9e8c3-ee24-4c3d-8c5d-efe491e78391 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:39.190539 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9e8c3-ee24-4c3d-8c5d-efe491e78391 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:39.190863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9e8c3-ee24-4c3d-8c5d-efe491e78391 admin admin] PATH_INFO: `/v3/projects/a9a21523cb9c4bc9ac00eb744b6a1ed2/users/1abf9df1c4ec43aaaa3875393d530d83/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:39.210014 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9e8c3-ee24-4c3d-8c5d-efe491e78391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a21523cb9c4bc9ac00eb744b6a1ed2, user_id=1abf9df1c4ec43aaaa3875393d530d83, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:39.212943 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9e8c3-ee24-4c3d-8c5d-efe491e78391 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:39.287465 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1262/2515] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:05:39 2022] PUT /identity/v3/projects/a9a21523cb9c4bc9ac00eb744b6a1ed2/users/1abf9df1c4ec43aaaa3875393d530d83/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:05:39.297787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bbe4d-23f9-4e9e-9469-bd9fa540ac56 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:39.298143 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bbe4d-23f9-4e9e-9469-bd9fa540ac56 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:39.298391 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bbe4d-23f9-4e9e-9469-bd9fa540ac56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:39.328431 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-f80bbe4d-23f9-4e9e-9469-bd9fa540ac56 None None] MFA Rules not processed for user `1abf9df1c4ec43aaaa3875393d530d83`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:39.329658 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-f80bbe4d-23f9-4e9e-9469-bd9fa540ac56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:39.400952 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1254/2516] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:39.414111 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9e8c3-ee24-4c3d-8c5d-efe491e78391 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:39.415899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-a3b9e8c3-ee24-4c3d-8c5d-efe491e78391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:39.484969 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9e8c3-ee24-4c3d-8c5d-efe491e78391 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:39.491469 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f0a51-1044-4941-8de4-74948fba3ac7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7791be968594cea9c32b51a7b3454b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:39.492076 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f0a51-1044-4941-8de4-74948fba3ac7 service glance] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:39.492422 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f0a51-1044-4941-8de4-74948fba3ac7 service glance] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:39.492602 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f0a51-1044-4941-8de4-74948fba3ac7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:39.502344 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f0a51-1044-4941-8de4-74948fba3ac7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:39.503847 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f0a51-1044-4941-8de4-74948fba3ac7 service glance] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:39.508618 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:39.513590 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1263/2517] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:05:42.537452 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80bbe4d-23f9-4e9e-9469-bd9fa540ac56 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:42.538909 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-f80bbe4d-23f9-4e9e-9469-bd9fa540ac56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:42.608548 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80bbe4d-23f9-4e9e-9469-bd9fa540ac56 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:42.613780 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a077fb5-f594-4556-9c4e-c5f2611e1fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:42.614438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a077fb5-f594-4556-9c4e-c5f2611e1fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:42.614731 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a077fb5-f594-4556-9c4e-c5f2611e1fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:42.615055 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a077fb5-f594-4556-9c4e-c5f2611e1fc5 admin admin] PATH_INFO: `/v3/users/953e82b17c34452fa8c5546febc1ca2b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:42.616163 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a077fb5-f594-4556-9c4e-c5f2611e1fc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=953e82b17c34452fa8c5546febc1ca2b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:42.618431 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a077fb5-f594-4556-9c4e-c5f2611e1fc5 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:42.810415 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:42.817014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-1a077fb5-f594-4556-9c4e-c5f2611e1fc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '953e82b17c34452fa8c5546febc1ca2b'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:42.829764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-1a077fb5-f594-4556-9c4e-c5f2611e1fc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '953e82b17c34452fa8c5546febc1ca2b'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:42.830475 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-1a077fb5-f594-4556-9c4e-c5f2611e1fc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '953e82b17c34452fa8c5546febc1ca2b'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:42.837681 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-1a077fb5-f594-4556-9c4e-c5f2611e1fc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '953e82b17c34452fa8c5546febc1ca2b'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:42.927697 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-1a077fb5-f594-4556-9c4e-c5f2611e1fc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '953e82b17c34452fa8c5546febc1ca2b'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:42.933988 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1255/2518] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:05:42 2022] DELETE /identity/v3/users/953e82b17c34452fa8c5546febc1ca2b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:42.940163 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b473a5-63cb-4aae-9c29-a9d2ae84aa2c None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:42.940703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b473a5-63cb-4aae-9c29-a9d2ae84aa2c None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:42.941121 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b473a5-63cb-4aae-9c29-a9d2ae84aa2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:42.961547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-76b473a5-63cb-4aae-9c29-a9d2ae84aa2c None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:42.962778 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-76b473a5-63cb-4aae-9c29-a9d2ae84aa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:43.028110 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1264/2519] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:05:43.038342 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a077fb5-f594-4556-9c4e-c5f2611e1fc5 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:43.039767 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-1a077fb5-f594-4556-9c4e-c5f2611e1fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:43.098297 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a077fb5-f594-4556-9c4e-c5f2611e1fc5 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:43.101853 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba8286-3a5e-4111-ae57-d13922dc74da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:43.102479 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba8286-3a5e-4111-ae57-d13922dc74da service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:43.102761 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba8286-3a5e-4111-ae57-d13922dc74da service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:43.103034 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba8286-3a5e-4111-ae57-d13922dc74da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:43.112157 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba8286-3a5e-4111-ae57-d13922dc74da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:43.113719 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba8286-3a5e-4111-ae57-d13922dc74da service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:43.124423 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1256/2520] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:05:43.781024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b473a5-63cb-4aae-9c29-a9d2ae84aa2c None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:43.782762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-76b473a5-63cb-4aae-9c29-a9d2ae84aa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:43.798324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b473a5-63cb-4aae-9c29-a9d2ae84aa2c None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:43.804413 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed42dce-8707-4e20-8d2f-ddda29e75ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:43.805017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed42dce-8707-4e20-8d2f-ddda29e75ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:43.805505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed42dce-8707-4e20-8d2f-ddda29e75ced admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:43.805688 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed42dce-8707-4e20-8d2f-ddda29e75ced admin admin] PATH_INFO: `/v3/projects/e739e043c3c94f47ae33a21b7ea910bb` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:43.806929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed42dce-8707-4e20-8d2f-ddda29e75ced admin admin] RBAC: Authorizing `identity:delete_project(project_id=e739e043c3c94f47ae33a21b7ea910bb)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:43.808811 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed42dce-8707-4e20-8d2f-ddda29e75ced admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:43.940167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-2ed42dce-8707-4e20-8d2f-ddda29e75ced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e739e043c3c94f47ae33a21b7ea910bb', 'request_id': 'req-2ed42dce-8707-4e20-8d2f-ddda29e75ced'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:43.945712 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-2ed42dce-8707-4e20-8d2f-ddda29e75ced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e739e043c3c94f47ae33a21b7ea910bb', 'request_id': 'req-2ed42dce-8707-4e20-8d2f-ddda29e75ced'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:44.002240 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-2ed42dce-8707-4e20-8d2f-ddda29e75ced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e739e043c3c94f47ae33a21b7ea910bb', 'request_id': 'req-2ed42dce-8707-4e20-8d2f-ddda29e75ced'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:44.015889 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-2ed42dce-8707-4e20-8d2f-ddda29e75ced admin admin] The token cache is being invalidate because project e739e043c3c94f47ae33a21b7ea910bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:05:44.018930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-2ed42dce-8707-4e20-8d2f-ddda29e75ced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:44.018930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-2ed42dce-8707-4e20-8d2f-ddda29e75ced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:44.018930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1265/2521] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:05:43 2022] DELETE /identity/v3/projects/e739e043c3c94f47ae33a21b7ea910bb => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:44.022923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba8286-3a5e-4111-ae57-d13922dc74da service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:44.033174 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba8286-3a5e-4111-ae57-d13922dc74da service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:44.096269 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d0641-ae8f-4f85-bf01-d03de78fa0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:44.096886 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d0641-ae8f-4f85-bf01-d03de78fa0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:44.097166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d0641-ae8f-4f85-bf01-d03de78fa0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:44.097991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d0641-ae8f-4f85-bf01-d03de78fa0f4 admin admin] PATH_INFO: `/v3/users/6cad5ee2435d496ba9c009236b7d2d83` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:44.099215 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d0641-ae8f-4f85-bf01-d03de78fa0f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cad5ee2435d496ba9c009236b7d2d83)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:44.101148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d0641-ae8f-4f85-bf01-d03de78fa0f4 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:44.233355 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ef6d0641-ae8f-4f85-bf01-d03de78fa0f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cad5ee2435d496ba9c009236b7d2d83'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:44.244554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:44.245850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ef6d0641-ae8f-4f85-bf01-d03de78fa0f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cad5ee2435d496ba9c009236b7d2d83'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:44.246661 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ef6d0641-ae8f-4f85-bf01-d03de78fa0f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cad5ee2435d496ba9c009236b7d2d83'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:44.253481 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ef6d0641-ae8f-4f85-bf01-d03de78fa0f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cad5ee2435d496ba9c009236b7d2d83'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:44.321062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ef6d0641-ae8f-4f85-bf01-d03de78fa0f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cad5ee2435d496ba9c009236b7d2d83'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:44.327499 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1257/2522] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:05:44 2022] DELETE /identity/v3/users/6cad5ee2435d496ba9c009236b7d2d83 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:44.734267 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed42dce-8707-4e20-8d2f-ddda29e75ced admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:44.736016 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-2ed42dce-8707-4e20-8d2f-ddda29e75ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:44.761425 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed42dce-8707-4e20-8d2f-ddda29e75ced admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:44.828586 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facbbe6-3078-40c1-be8d-f1872c5444cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:44.829492 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facbbe6-3078-40c1-be8d-f1872c5444cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:44.830175 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facbbe6-3078-40c1-be8d-f1872c5444cc admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:44.830687 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facbbe6-3078-40c1-be8d-f1872c5444cc admin admin] PATH_INFO: `/v3/projects/ec2e48462f094c98896d9a8e16a54886` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:44.832981 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facbbe6-3078-40c1-be8d-f1872c5444cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec2e48462f094c98896d9a8e16a54886)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:44.835075 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facbbe6-3078-40c1-be8d-f1872c5444cc admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:44.939936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:44.957941 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-5facbbe6-3078-40c1-be8d-f1872c5444cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec2e48462f094c98896d9a8e16a54886', 'request_id': 'req-5facbbe6-3078-40c1-be8d-f1872c5444cc'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:44.963279 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-5facbbe6-3078-40c1-be8d-f1872c5444cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec2e48462f094c98896d9a8e16a54886', 'request_id': 'req-5facbbe6-3078-40c1-be8d-f1872c5444cc'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:45.023971 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-5facbbe6-3078-40c1-be8d-f1872c5444cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec2e48462f094c98896d9a8e16a54886', 'request_id': 'req-5facbbe6-3078-40c1-be8d-f1872c5444cc'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:45.036497 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-5facbbe6-3078-40c1-be8d-f1872c5444cc admin admin] The token cache is being invalidate because project ec2e48462f094c98896d9a8e16a54886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:05:45.036815 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-5facbbe6-3078-40c1-be8d-f1872c5444cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:45.037387 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-5facbbe6-3078-40c1-be8d-f1872c5444cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:45.038994 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1266/2523] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:05:44 2022] DELETE /identity/v3/projects/ec2e48462f094c98896d9a8e16a54886 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:45.043922 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032b0e4-f6f9-464b-b732-4ba24501ce86 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:45.044422 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032b0e4-f6f9-464b-b732-4ba24501ce86 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:45.044519 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032b0e4-f6f9-464b-b732-4ba24501ce86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:45.063818 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-9032b0e4-f6f9-464b-b732-4ba24501ce86 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:45.065010 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-9032b0e4-f6f9-464b-b732-4ba24501ce86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:45.127333 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1258/2524] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:45.136497 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9f647-eae7-420b-aa8d-e98ca885f631 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:45.136776 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9f647-eae7-420b-aa8d-e98ca885f631 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:45.137044 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9f647-eae7-420b-aa8d-e98ca885f631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:45.157884 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-ffd9f647-eae7-420b-aa8d-e98ca885f631 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:45.159113 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ffd9f647-eae7-420b-aa8d-e98ca885f631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:45.167992 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1267/2525] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:45.172146 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032b0e4-f6f9-464b-b732-4ba24501ce86 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:45.181841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032b0e4-f6f9-464b-b732-4ba24501ce86 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:45.186450 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a27d2-2f0a-4d05-a0a9-1a1858b430a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:45.187041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a27d2-2f0a-4d05-a0a9-1a1858b430a0 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:45.187348 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a27d2-2f0a-4d05-a0a9-1a1858b430a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:45.187619 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a27d2-2f0a-4d05-a0a9-1a1858b430a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:45.188256 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a27d2-2f0a-4d05-a0a9-1a1858b430a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:05:45.188587 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a27d2-2f0a-4d05-a0a9-1a1858b430a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:45.190212 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a27d2-2f0a-4d05-a0a9-1a1858b430a0 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:45.202035 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1259/2526] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:05:45.206669 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9f647-eae7-420b-aa8d-e98ca885f631 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:45.216589 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9f647-eae7-420b-aa8d-e98ca885f631 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:45.221272 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f6857-e6d8-4961-8dc7-f05d55398c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:45.221862 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f6857-e6d8-4961-8dc7-f05d55398c73 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:45.222170 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f6857-e6d8-4961-8dc7-f05d55398c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:45.227635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f6857-e6d8-4961-8dc7-f05d55398c73 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:45.227635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f6857-e6d8-4961-8dc7-f05d55398c73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:45.227635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f6857-e6d8-4961-8dc7-f05d55398c73 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:45.324256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1268/2527] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:05:45 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:05:45.328681 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a27d2-2f0a-4d05-a0a9-1a1858b430a0 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:45.339095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a27d2-2f0a-4d05-a0a9-1a1858b430a0 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:45.396741 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0131d-2d1c-4ddf-82e4-c948f355057e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:45.397366 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0131d-2d1c-4ddf-82e4-c948f355057e admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:45.397647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0131d-2d1c-4ddf-82e4-c948f355057e admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:45.397922 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0131d-2d1c-4ddf-82e4-c948f355057e admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:45.398610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0131d-2d1c-4ddf-82e4-c948f355057e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:45.400618 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0131d-2d1c-4ddf-82e4-c948f355057e admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:45.500259 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1260/2528] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:05:45 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:05:45.504700 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f6857-e6d8-4961-8dc7-f05d55398c73 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:45.515092 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f6857-e6d8-4961-8dc7-f05d55398c73 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:45.520414 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56501863-4a20-4f39-b4fb-0089f2f47c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:45.521065 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56501863-4a20-4f39-b4fb-0089f2f47c51 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:45.521330 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56501863-4a20-4f39-b4fb-0089f2f47c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:45.521609 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56501863-4a20-4f39-b4fb-0089f2f47c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:45.522266 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56501863-4a20-4f39-b4fb-0089f2f47c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:45.523946 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56501863-4a20-4f39-b4fb-0089f2f47c51 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:45.533607 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1269/2529] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:05:45.537389 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0131d-2d1c-4ddf-82e4-c948f355057e admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:45.547439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0131d-2d1c-4ddf-82e4-c948f355057e admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:45.552056 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9225d-3941-4e3c-8191-c5b61a70ed46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:45.552643 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9225d-3941-4e3c-8191-c5b61a70ed46 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:45.552921 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9225d-3941-4e3c-8191-c5b61a70ed46 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:45.553191 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9225d-3941-4e3c-8191-c5b61a70ed46 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:45.553821 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9225d-3941-4e3c-8191-c5b61a70ed46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:45.555436 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9225d-3941-4e3c-8191-c5b61a70ed46 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:45.565732 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1261/2530] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:05:45.570252 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56501863-4a20-4f39-b4fb-0089f2f47c51 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:45.580321 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56501863-4a20-4f39-b4fb-0089f2f47c51 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:45.585484 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c43b7d-700e-4ad1-9d1f-cb50f1b77ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:45.586139 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c43b7d-700e-4ad1-9d1f-cb50f1b77ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:45.586412 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c43b7d-700e-4ad1-9d1f-cb50f1b77ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:45.586678 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c43b7d-700e-4ad1-9d1f-cb50f1b77ab7 admin admin] PATH_INFO: `/v3/projects/2ec5bc4c39d240308f53069b33962e9b/users/ffbcb125b4e4441abb86533eea20727a/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:45.601232 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c43b7d-700e-4ad1-9d1f-cb50f1b77ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ec5bc4c39d240308f53069b33962e9b, user_id=ffbcb125b4e4441abb86533eea20727a, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:45.603903 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c43b7d-700e-4ad1-9d1f-cb50f1b77ab7 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:45.677268 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1270/2531] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:05:45 2022] PUT /identity/v3/projects/2ec5bc4c39d240308f53069b33962e9b/users/ffbcb125b4e4441abb86533eea20727a/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:45.688046 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a1553-5810-457d-b520-0d611d5e8fcd None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:45.688336 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a1553-5810-457d-b520-0d611d5e8fcd None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:45.688613 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a1553-5810-457d-b520-0d611d5e8fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:45.717549 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-c21a1553-5810-457d-b520-0d611d5e8fcd None None] MFA Rules not processed for user `ffbcb125b4e4441abb86533eea20727a`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:45.718959 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-c21a1553-5810-457d-b520-0d611d5e8fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:45.752832 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:45.784347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1262/2532] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:45.795331 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c43b7d-700e-4ad1-9d1f-cb50f1b77ab7 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:45.797028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-35c43b7d-700e-4ad1-9d1f-cb50f1b77ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:45.856030 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c43b7d-700e-4ad1-9d1f-cb50f1b77ab7 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:45.859652 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a2e67-cbd7-443f-bf48-8ff42fd51132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:45.860245 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a2e67-cbd7-443f-bf48-8ff42fd51132 service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:45.860519 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a2e67-cbd7-443f-bf48-8ff42fd51132 service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:45.860789 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a2e67-cbd7-443f-bf48-8ff42fd51132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:45.869441 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a2e67-cbd7-443f-bf48-8ff42fd51132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:45.870880 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a2e67-cbd7-443f-bf48-8ff42fd51132 service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:45.880552 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1271/2533] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:05:45.909452 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a1553-5810-457d-b520-0d611d5e8fcd None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:45.976568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a1553-5810-457d-b520-0d611d5e8fcd None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:45.981169 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8b02a-5e01-4af5-82d4-6bd602391be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:45.981796 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8b02a-5e01-4af5-82d4-6bd602391be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:45.982074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8b02a-5e01-4af5-82d4-6bd602391be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:45.982375 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8b02a-5e01-4af5-82d4-6bd602391be9 admin admin] PATH_INFO: `/v3/users/ffbcb125b4e4441abb86533eea20727a` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:45.983531 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8b02a-5e01-4af5-82d4-6bd602391be9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffbcb125b4e4441abb86533eea20727a)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:45.985450 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8b02a-5e01-4af5-82d4-6bd602391be9 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:46.131066 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-0bf8b02a-5e01-4af5-82d4-6bd602391be9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffbcb125b4e4441abb86533eea20727a'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:46.131718 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a2e67-cbd7-443f-bf48-8ff42fd51132 service cinder] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:46.132470 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-6e5a2e67-cbd7-443f-bf48-8ff42fd51132 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:46.142446 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-0bf8b02a-5e01-4af5-82d4-6bd602391be9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffbcb125b4e4441abb86533eea20727a'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:46.143159 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-0bf8b02a-5e01-4af5-82d4-6bd602391be9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffbcb125b4e4441abb86533eea20727a'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:46.150135 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-0bf8b02a-5e01-4af5-82d4-6bd602391be9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffbcb125b4e4441abb86533eea20727a'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:46.190478 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-0bf8b02a-5e01-4af5-82d4-6bd602391be9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffbcb125b4e4441abb86533eea20727a'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:46.194670 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a2e67-cbd7-443f-bf48-8ff42fd51132 service cinder] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:46.196920 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1263/2534] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:05:45 2022] DELETE /identity/v3/users/ffbcb125b4e4441abb86533eea20727a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:46.201205 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec8d8b-ad24-4cd1-ad2b-c87d7413310a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:46.201356 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3075d99-e25e-4849-b64d-bcb2afe179f0 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:46.205175 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3075d99-e25e-4849-b64d-bcb2afe179f0 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:46.205364 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec8d8b-ad24-4cd1-ad2b-c87d7413310a service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:46.205465 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3075d99-e25e-4849-b64d-bcb2afe179f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:46.205647 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec8d8b-ad24-4cd1-ad2b-c87d7413310a service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:46.205647 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec8d8b-ad24-4cd1-ad2b-c87d7413310a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:46.205647 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-2bec8d8b-ad24-4cd1-ad2b-c87d7413310a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:46.214881 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:46.216755 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec8d8b-ad24-4cd1-ad2b-c87d7413310a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:46.218425 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec8d8b-ad24-4cd1-ad2b-c87d7413310a service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:46.220764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-b3075d99-e25e-4849-b64d-bcb2afe179f0 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:46.224819 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-b3075d99-e25e-4849-b64d-bcb2afe179f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:46.230963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1272/2535] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:05:46.276023 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:46.294104 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1264/2536] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:05:46.304301 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec8d8b-ad24-4cd1-ad2b-c87d7413310a service neutron] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:46.305707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-2bec8d8b-ad24-4cd1-ad2b-c87d7413310a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:46.317124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec8d8b-ad24-4cd1-ad2b-c87d7413310a service neutron] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:46.366485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b5738-430e-4060-9501-0c8517700039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:46.367003 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b5738-430e-4060-9501-0c8517700039 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:46.367280 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b5738-430e-4060-9501-0c8517700039 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:46.367556 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b5738-430e-4060-9501-0c8517700039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:46.377266 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b5738-430e-4060-9501-0c8517700039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:46.379199 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b5738-430e-4060-9501-0c8517700039 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:46.389220 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1273/2537] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:05:46.834511 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3075d99-e25e-4849-b64d-bcb2afe179f0 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:46.836059 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-b3075d99-e25e-4849-b64d-bcb2afe179f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:46.850158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3075d99-e25e-4849-b64d-bcb2afe179f0 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:46.855665 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6af42-70be-4af8-a796-7badc3c7eecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:46.856304 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6af42-70be-4af8-a796-7badc3c7eecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:46.856583 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6af42-70be-4af8-a796-7badc3c7eecd admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:46.856854 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6af42-70be-4af8-a796-7badc3c7eecd admin admin] PATH_INFO: `/v3/projects/2ec5bc4c39d240308f53069b33962e9b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:46.857990 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6af42-70be-4af8-a796-7badc3c7eecd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ec5bc4c39d240308f53069b33962e9b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:46.859969 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6af42-70be-4af8-a796-7badc3c7eecd admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:46.964563 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-62e6af42-70be-4af8-a796-7badc3c7eecd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ec5bc4c39d240308f53069b33962e9b', 'request_id': 'req-62e6af42-70be-4af8-a796-7badc3c7eecd'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:46.971692 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-62e6af42-70be-4af8-a796-7badc3c7eecd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ec5bc4c39d240308f53069b33962e9b', 'request_id': 'req-62e6af42-70be-4af8-a796-7badc3c7eecd'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:46.980892 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-62e6af42-70be-4af8-a796-7badc3c7eecd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ec5bc4c39d240308f53069b33962e9b', 'request_id': 'req-62e6af42-70be-4af8-a796-7badc3c7eecd'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:47.049181 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-62e6af42-70be-4af8-a796-7badc3c7eecd admin admin] The token cache is being invalidate because project 2ec5bc4c39d240308f53069b33962e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:05:47.049655 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-62e6af42-70be-4af8-a796-7badc3c7eecd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:47.051135 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-62e6af42-70be-4af8-a796-7badc3c7eecd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:47.052734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1265/2538] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:05:46 2022] DELETE /identity/v3/projects/2ec5bc4c39d240308f53069b33962e9b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:47.057741 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7130b0d-96ac-4cca-a786-8cf1b7596152 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:47.058289 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7130b0d-96ac-4cca-a786-8cf1b7596152 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:47.058655 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7130b0d-96ac-4cca-a786-8cf1b7596152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:47.079102 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-f7130b0d-96ac-4cca-a786-8cf1b7596152 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:47.080292 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-f7130b0d-96ac-4cca-a786-8cf1b7596152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:47.146692 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1274/2539] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:05:47.151207 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829a39f-3225-4c27-a31e-d2d61667b436 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:47.151602 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829a39f-3225-4c27-a31e-d2d61667b436 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:47.151777 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829a39f-3225-4c27-a31e-d2d61667b436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:47.172454 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-9829a39f-3225-4c27-a31e-d2d61667b436 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:47.174487 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-9829a39f-3225-4c27-a31e-d2d61667b436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:47.187941 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1266/2540] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:47.189327 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7130b0d-96ac-4cca-a786-8cf1b7596152 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:47.208340 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7130b0d-96ac-4cca-a786-8cf1b7596152 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:47.213725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d82d68-5187-4561-8d3b-8cc7a4637f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:47.214439 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d82d68-5187-4561-8d3b-8cc7a4637f9f admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:47.214745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d82d68-5187-4561-8d3b-8cc7a4637f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:47.215012 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d82d68-5187-4561-8d3b-8cc7a4637f9f admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:47.215750 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d82d68-5187-4561-8d3b-8cc7a4637f9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:05:47.216051 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d82d68-5187-4561-8d3b-8cc7a4637f9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:47.217667 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d82d68-5187-4561-8d3b-8cc7a4637f9f admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:47.230645 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1275/2541] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:05:47.234962 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829a39f-3225-4c27-a31e-d2d61667b436 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:47.245546 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829a39f-3225-4c27-a31e-d2d61667b436 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:47.250669 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea163c21-c79e-4efb-9a49-4b37d9aecaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:47.251364 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea163c21-c79e-4efb-9a49-4b37d9aecaf7 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:47.251736 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea163c21-c79e-4efb-9a49-4b37d9aecaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:47.252080 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea163c21-c79e-4efb-9a49-4b37d9aecaf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:47.252787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea163c21-c79e-4efb-9a49-4b37d9aecaf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:47.255560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea163c21-c79e-4efb-9a49-4b37d9aecaf7 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:47.357530 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1267/2542] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:05:47 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:05:47.361905 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d82d68-5187-4561-8d3b-8cc7a4637f9f admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:47.372550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d82d68-5187-4561-8d3b-8cc7a4637f9f admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:47.434571 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cde90-a48c-4532-9cdf-ddf8a4914ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:47.435099 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cde90-a48c-4532-9cdf-ddf8a4914ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:47.435375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cde90-a48c-4532-9cdf-ddf8a4914ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:47.435652 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cde90-a48c-4532-9cdf-ddf8a4914ab0 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:47.436273 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cde90-a48c-4532-9cdf-ddf8a4914ab0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:47.438196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cde90-a48c-4532-9cdf-ddf8a4914ab0 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:47.523686 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1276/2543] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:05:47 2022] POST /identity/v3/users => generated 291 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:05:47.528020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea163c21-c79e-4efb-9a49-4b37d9aecaf7 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:47.542893 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea163c21-c79e-4efb-9a49-4b37d9aecaf7 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:47.553472 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5fc4d-4e51-49b6-9170-caac88b34659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:47.554126 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5fc4d-4e51-49b6-9170-caac88b34659 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:47.554400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5fc4d-4e51-49b6-9170-caac88b34659 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:47.554667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5fc4d-4e51-49b6-9170-caac88b34659 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:47.555457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5fc4d-4e51-49b6-9170-caac88b34659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:47.557108 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5fc4d-4e51-49b6-9170-caac88b34659 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:47.570920 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1268/2544] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:05:47.572132 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cde90-a48c-4532-9cdf-ddf8a4914ab0 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:47.582479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cde90-a48c-4532-9cdf-ddf8a4914ab0 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:47.587102 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3515c0-9939-4a96-b87b-be7bb221ab0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:47.587729 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3515c0-9939-4a96-b87b-be7bb221ab0d admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:47.588006 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3515c0-9939-4a96-b87b-be7bb221ab0d admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:47.588275 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3515c0-9939-4a96-b87b-be7bb221ab0d admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:47.588908 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3515c0-9939-4a96-b87b-be7bb221ab0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:47.590528 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3515c0-9939-4a96-b87b-be7bb221ab0d admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:47.601572 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1277/2545] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:05:47.605662 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5fc4d-4e51-49b6-9170-caac88b34659 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:47.616171 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5fc4d-4e51-49b6-9170-caac88b34659 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:47.620897 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343fd68-b6ad-4cfa-b587-127828fe75ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:47.621543 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343fd68-b6ad-4cfa-b587-127828fe75ca admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:47.621822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343fd68-b6ad-4cfa-b587-127828fe75ca admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:47.622257 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343fd68-b6ad-4cfa-b587-127828fe75ca admin admin] PATH_INFO: `/v3/projects/9fccb80efbfc43668f4b3a54ee2a8b92/users/2f191183f2e44d83837459364dd8034d/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:47.641244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343fd68-b6ad-4cfa-b587-127828fe75ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fccb80efbfc43668f4b3a54ee2a8b92, user_id=2f191183f2e44d83837459364dd8034d, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:47.643958 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343fd68-b6ad-4cfa-b587-127828fe75ca admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:47.711480 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1269/2546] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:05:47 2022] PUT /identity/v3/projects/9fccb80efbfc43668f4b3a54ee2a8b92/users/2f191183f2e44d83837459364dd8034d/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:47.786242 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3884a6b-5ef0-446a-a33b-86c813b82e21 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:47.792657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3884a6b-5ef0-446a-a33b-86c813b82e21 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:47.793266 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3884a6b-5ef0-446a-a33b-86c813b82e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:47.810803 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:47.838614 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-a3884a6b-5ef0-446a-a33b-86c813b82e21 None None] MFA Rules not processed for user `2f191183f2e44d83837459364dd8034d`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:47.840199 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-a3884a6b-5ef0-446a-a33b-86c813b82e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:47.928172 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1278/2547] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:47.929388 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343fd68-b6ad-4cfa-b587-127828fe75ca admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:48.003039 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343fd68-b6ad-4cfa-b587-127828fe75ca admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:48.010326 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635de02-3601-46c2-84ba-efacf6860a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:48.011318 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635de02-3601-46c2-84ba-efacf6860a63 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:48.011751 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635de02-3601-46c2-84ba-efacf6860a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:48.021314 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635de02-3601-46c2-84ba-efacf6860a63 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:48.021886 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635de02-3601-46c2-84ba-efacf6860a63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:48.024040 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635de02-3601-46c2-84ba-efacf6860a63 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:48.095559 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:48.103791 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1270/2548] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:05:47 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:05:48.107699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3884a6b-5ef0-446a-a33b-86c813b82e21 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:48.119606 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3884a6b-5ef0-446a-a33b-86c813b82e21 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:48.185341 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3b77f-9549-4d98-b356-b24806f89c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:48.186178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3b77f-9549-4d98-b356-b24806f89c77 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:48.186306 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3b77f-9549-4d98-b356-b24806f89c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:48.186517 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3b77f-9549-4d98-b356-b24806f89c77 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:48.187298 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3b77f-9549-4d98-b356-b24806f89c77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:48.191086 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3b77f-9549-4d98-b356-b24806f89c77 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:48.313904 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1279/2549] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:05:48 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:05:48.317946 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635de02-3601-46c2-84ba-efacf6860a63 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:48.329171 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635de02-3601-46c2-84ba-efacf6860a63 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:48.334518 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e119a-3552-4e10-baa6-e764b7c2a274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:48.335137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e119a-3552-4e10-baa6-e764b7c2a274 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:48.335407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e119a-3552-4e10-baa6-e764b7c2a274 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:48.336228 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e119a-3552-4e10-baa6-e764b7c2a274 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:48.336890 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e119a-3552-4e10-baa6-e764b7c2a274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:48.338545 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e119a-3552-4e10-baa6-e764b7c2a274 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:48.350731 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1271/2550] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:05:48.355510 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3b77f-9549-4d98-b356-b24806f89c77 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:48.370942 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3b77f-9549-4d98-b356-b24806f89c77 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:48.376192 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e5af9-1e74-4e54-b291-202fdff25f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:48.376829 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e5af9-1e74-4e54-b291-202fdff25f3d admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:48.377100 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e5af9-1e74-4e54-b291-202fdff25f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:48.377537 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e5af9-1e74-4e54-b291-202fdff25f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:48.378231 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e5af9-1e74-4e54-b291-202fdff25f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:48.380423 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e5af9-1e74-4e54-b291-202fdff25f3d admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:48.392660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1280/2551] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:05:48.397748 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e119a-3552-4e10-baa6-e764b7c2a274 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:48.413102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e119a-3552-4e10-baa6-e764b7c2a274 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:48.417775 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9602f-2c82-48c8-a8cc-87472339f210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:48.418489 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9602f-2c82-48c8-a8cc-87472339f210 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:48.418767 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9602f-2c82-48c8-a8cc-87472339f210 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:48.419040 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9602f-2c82-48c8-a8cc-87472339f210 admin admin] PATH_INFO: `/v3/projects/a2092ad447e14384a454e65283eea4d2/users/640f8472322b4e8cb62809b66ee70e70/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:48.433944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9602f-2c82-48c8-a8cc-87472339f210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2092ad447e14384a454e65283eea4d2, user_id=640f8472322b4e8cb62809b66ee70e70, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:48.437152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9602f-2c82-48c8-a8cc-87472339f210 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:48.528914 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1272/2552] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:05:48 2022] PUT /identity/v3/projects/a2092ad447e14384a454e65283eea4d2/users/640f8472322b4e8cb62809b66ee70e70/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:48.538481 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb0a55-191c-4685-a90e-627696a2b659 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:48.538766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb0a55-191c-4685-a90e-627696a2b659 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:48.539039 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb0a55-191c-4685-a90e-627696a2b659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:48.571729 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-ceeb0a55-191c-4685-a90e-627696a2b659 None None] MFA Rules not processed for user `640f8472322b4e8cb62809b66ee70e70`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:48.572959 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ceeb0a55-191c-4685-a90e-627696a2b659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:48.640441 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1281/2553] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:48.645625 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9602f-2c82-48c8-a8cc-87472339f210 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:48.742505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9602f-2c82-48c8-a8cc-87472339f210 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:48.752206 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564213d-8441-4087-aa9f-e699497288f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:48.752842 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564213d-8441-4087-aa9f-e699497288f3 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:48.753120 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564213d-8441-4087-aa9f-e699497288f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:48.753390 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564213d-8441-4087-aa9f-e699497288f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:48.754038 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564213d-8441-4087-aa9f-e699497288f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:48.758202 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564213d-8441-4087-aa9f-e699497288f3 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:48.832833 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1273/2554] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:05:48 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:05:48.837793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb0a55-191c-4685-a90e-627696a2b659 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:48.842568 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:48.848599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb0a55-191c-4685-a90e-627696a2b659 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:48.915663 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af405dd-4472-4d5f-8a6c-3ed3715cafdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:48.916245 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af405dd-4472-4d5f-8a6c-3ed3715cafdc admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:48.916693 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af405dd-4472-4d5f-8a6c-3ed3715cafdc admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:48.916972 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af405dd-4472-4d5f-8a6c-3ed3715cafdc admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:48.917640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af405dd-4472-4d5f-8a6c-3ed3715cafdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:48.919594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af405dd-4472-4d5f-8a6c-3ed3715cafdc admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:48.996489 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1282/2555] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:05:48 2022] POST /identity/v3/users => generated 299 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:05:49.000186 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564213d-8441-4087-aa9f-e699497288f3 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:49.011613 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564213d-8441-4087-aa9f-e699497288f3 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:49.016314 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11111eb-0e2d-4d8b-9882-8cab9d6a2638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:49.016940 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11111eb-0e2d-4d8b-9882-8cab9d6a2638 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:49.017241 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11111eb-0e2d-4d8b-9882-8cab9d6a2638 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:49.020736 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11111eb-0e2d-4d8b-9882-8cab9d6a2638 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:49.020736 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11111eb-0e2d-4d8b-9882-8cab9d6a2638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:49.020736 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11111eb-0e2d-4d8b-9882-8cab9d6a2638 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:49.031059 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1274/2556] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:05:49.035118 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af405dd-4472-4d5f-8a6c-3ed3715cafdc admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:49.045277 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af405dd-4472-4d5f-8a6c-3ed3715cafdc admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:49.050001 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db5e3a-e71a-4cd0-845a-10561514716e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:49.050688 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db5e3a-e71a-4cd0-845a-10561514716e admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:49.050987 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db5e3a-e71a-4cd0-845a-10561514716e admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:49.051744 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db5e3a-e71a-4cd0-845a-10561514716e admin admin] PATH_INFO: `/v3/projects/58f692a39ee14bb4934ba868652b8967/users/b51cb087f30646b7a679774964dbc80a/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:49.074631 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db5e3a-e71a-4cd0-845a-10561514716e admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f692a39ee14bb4934ba868652b8967, user_id=b51cb087f30646b7a679774964dbc80a, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:49.077221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db5e3a-e71a-4cd0-845a-10561514716e admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:49.140156 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1283/2557] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:05:49 2022] PUT /identity/v3/projects/58f692a39ee14bb4934ba868652b8967/users/b51cb087f30646b7a679774964dbc80a/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:49.144291 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11111eb-0e2d-4d8b-9882-8cab9d6a2638 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:49.155413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11111eb-0e2d-4d8b-9882-8cab9d6a2638 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:49.218639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcc7d4-f523-4a05-b498-7ebbd67d451d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:49.219333 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcc7d4-f523-4a05-b498-7ebbd67d451d admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:49.219665 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcc7d4-f523-4a05-b498-7ebbd67d451d admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:49.219999 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcc7d4-f523-4a05-b498-7ebbd67d451d admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:49.220760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fcc7d4-f523-4a05-b498-7ebbd67d451d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:49.222485 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fcc7d4-f523-4a05-b498-7ebbd67d451d admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:49.233458 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1275/2558] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:05:49.237813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db5e3a-e71a-4cd0-845a-10561514716e admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:49.250360 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db5e3a-e71a-4cd0-845a-10561514716e admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:49.257241 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d8567-cce3-46de-964e-94f60734c62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:49.257921 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d8567-cce3-46de-964e-94f60734c62a admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:49.258234 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d8567-cce3-46de-964e-94f60734c62a admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:49.258507 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d8567-cce3-46de-964e-94f60734c62a admin admin] PATH_INFO: `/v3/projects/58f692a39ee14bb4934ba868652b8967/users/b51cb087f30646b7a679774964dbc80a/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:49.260585 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d8567-cce3-46de-964e-94f60734c62a admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f692a39ee14bb4934ba868652b8967, user_id=b51cb087f30646b7a679774964dbc80a, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:49.263492 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d8567-cce3-46de-964e-94f60734c62a admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:49.274608 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1284/2559] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:05:49 2022] PUT /identity/v3/projects/58f692a39ee14bb4934ba868652b8967/users/b51cb087f30646b7a679774964dbc80a/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:49.286880 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07546b8f-44b7-45b2-9e2e-5beea67edd6f None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:49.287230 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07546b8f-44b7-45b2-9e2e-5beea67edd6f None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:49.287538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07546b8f-44b7-45b2-9e2e-5beea67edd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:49.329974 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-07546b8f-44b7-45b2-9e2e-5beea67edd6f None None] MFA Rules not processed for user `b51cb087f30646b7a679774964dbc80a`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:49.331341 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-07546b8f-44b7-45b2-9e2e-5beea67edd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:49.360479 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:49.428570 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1276/2560] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:49.443517 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d8567-cce3-46de-964e-94f60734c62a admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:49.444646 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-eb7d8567-cce3-46de-964e-94f60734c62a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:49.543228 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d8567-cce3-46de-964e-94f60734c62a admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:49.557419 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa3b54-160e-4861-9531-cd9819240087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:49.557419 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa3b54-160e-4861-9531-cd9819240087 service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:49.557419 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa3b54-160e-4861-9531-cd9819240087 service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:49.557419 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa3b54-160e-4861-9531-cd9819240087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:49.643099 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa3b54-160e-4861-9531-cd9819240087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:49.646366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa3b54-160e-4861-9531-cd9819240087 service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:49.657137 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1285/2561] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:05:50.080417 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07546b8f-44b7-45b2-9e2e-5beea67edd6f None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:50.081865 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-07546b8f-44b7-45b2-9e2e-5beea67edd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:50.177512 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07546b8f-44b7-45b2-9e2e-5beea67edd6f None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:50.182406 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ea566-9812-47d5-823b-153cb8b98316 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0061ce46df224f4491599ed10548b2ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:50.183088 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ea566-9812-47d5-823b-153cb8b98316 service placement] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:50.183360 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ea566-9812-47d5-823b-153cb8b98316 service placement] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:50.183625 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ea566-9812-47d5-823b-153cb8b98316 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:50.185559 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-bf0ea566-9812-47d5-823b-153cb8b98316 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:50.207001 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ea566-9812-47d5-823b-153cb8b98316 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:50.210409 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ea566-9812-47d5-823b-153cb8b98316 service placement] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:50.215190 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa3b54-160e-4861-9531-cd9819240087 service cinder] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:50.217386 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-dcfa3b54-160e-4861-9531-cd9819240087 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:50.226146 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1277/2562] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:05:50.238295 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:50.310461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa3b54-160e-4861-9531-cd9819240087 service cinder] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:50.315629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f7ad2-ba98-44d8-ade1-2ab598849583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:50.316332 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f7ad2-ba98-44d8-ade1-2ab598849583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:50.316644 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f7ad2-ba98-44d8-ade1-2ab598849583 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:50.316932 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f7ad2-ba98-44d8-ade1-2ab598849583 admin admin] PATH_INFO: `/v3/users/211b0ba5012f4e0f8ab1c850d4ebdfaf` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:50.318678 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f7ad2-ba98-44d8-ade1-2ab598849583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=211b0ba5012f4e0f8ab1c850d4ebdfaf)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:50.320800 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f7ad2-ba98-44d8-ade1-2ab598849583 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:50.575920 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-5b7f7ad2-ba98-44d8-ade1-2ab598849583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '211b0ba5012f4e0f8ab1c850d4ebdfaf'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:50.588015 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-5b7f7ad2-ba98-44d8-ade1-2ab598849583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '211b0ba5012f4e0f8ab1c850d4ebdfaf'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:50.588763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-5b7f7ad2-ba98-44d8-ade1-2ab598849583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '211b0ba5012f4e0f8ab1c850d4ebdfaf'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:50.589304 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-5b7f7ad2-ba98-44d8-ade1-2ab598849583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '211b0ba5012f4e0f8ab1c850d4ebdfaf'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:50.596107 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-5b7f7ad2-ba98-44d8-ade1-2ab598849583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '211b0ba5012f4e0f8ab1c850d4ebdfaf'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:50.710339 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1286/2563] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:05:50 2022] DELETE /identity/v3/users/211b0ba5012f4e0f8ab1c850d4ebdfaf => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:05:50.980627 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ea566-9812-47d5-823b-153cb8b98316 service placement] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:50.992237 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ea566-9812-47d5-823b-153cb8b98316 service placement] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:51.050703 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aec9b8-4273-4f07-adbc-e00e6f3c9820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:51.051356 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aec9b8-4273-4f07-adbc-e00e6f3c9820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:51.051635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aec9b8-4273-4f07-adbc-e00e6f3c9820 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:51.051907 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aec9b8-4273-4f07-adbc-e00e6f3c9820 admin admin] PATH_INFO: `/v3/projects/bea3dff977df4f8782199d1084bbd808` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:51.053044 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aec9b8-4273-4f07-adbc-e00e6f3c9820 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bea3dff977df4f8782199d1084bbd808)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:51.055016 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aec9b8-4273-4f07-adbc-e00e6f3c9820 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:51.523592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a4aec9b8-4273-4f07-adbc-e00e6f3c9820 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bea3dff977df4f8782199d1084bbd808', 'request_id': 'req-a4aec9b8-4273-4f07-adbc-e00e6f3c9820'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:51.525461 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:51.529433 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a4aec9b8-4273-4f07-adbc-e00e6f3c9820 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bea3dff977df4f8782199d1084bbd808', 'request_id': 'req-a4aec9b8-4273-4f07-adbc-e00e6f3c9820'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:51.535634 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a4aec9b8-4273-4f07-adbc-e00e6f3c9820 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bea3dff977df4f8782199d1084bbd808', 'request_id': 'req-a4aec9b8-4273-4f07-adbc-e00e6f3c9820'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:51.607728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a4aec9b8-4273-4f07-adbc-e00e6f3c9820 admin admin] The token cache is being invalidate because project bea3dff977df4f8782199d1084bbd808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:05:51.614605 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a4aec9b8-4273-4f07-adbc-e00e6f3c9820 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:51.614605 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a4aec9b8-4273-4f07-adbc-e00e6f3c9820 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:51.614605 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1278/2564] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:05:50 2022] DELETE /identity/v3/projects/bea3dff977df4f8782199d1084bbd808 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:51.615964 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b47948-d884-4887-b649-6fab30676321 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:51.616516 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b47948-d884-4887-b649-6fab30676321 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:51.616516 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b47948-d884-4887-b649-6fab30676321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:51.637595 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-08b47948-d884-4887-b649-6fab30676321 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:51.638772 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-08b47948-d884-4887-b649-6fab30676321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:51.699202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1287/2565] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:05:51.707625 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01f7da-f929-4bdd-b32e-6a286a95dafd None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:51.708491 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01f7da-f929-4bdd-b32e-6a286a95dafd None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:51.708760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01f7da-f929-4bdd-b32e-6a286a95dafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:51.727942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-5b01f7da-f929-4bdd-b32e-6a286a95dafd None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:51.729192 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-5b01f7da-f929-4bdd-b32e-6a286a95dafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:51.737173 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1279/2566] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:05:51.741925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b47948-d884-4887-b649-6fab30676321 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:51.751349 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b47948-d884-4887-b649-6fab30676321 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:51.756532 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255914a-f45b-4a2d-91ca-c5f220cdf7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:51.757117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255914a-f45b-4a2d-91ca-c5f220cdf7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:51.757388 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255914a-f45b-4a2d-91ca-c5f220cdf7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:51.757654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255914a-f45b-4a2d-91ca-c5f220cdf7a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:51.758323 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255914a-f45b-4a2d-91ca-c5f220cdf7a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:05:51.758620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255914a-f45b-4a2d-91ca-c5f220cdf7a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:51.760214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255914a-f45b-4a2d-91ca-c5f220cdf7a2 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:51.771596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1288/2567] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:05:51.775926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01f7da-f929-4bdd-b32e-6a286a95dafd None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:51.786053 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01f7da-f929-4bdd-b32e-6a286a95dafd None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:51.790836 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef2a56-8d83-45c5-8a90-1619cad753a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:51.791459 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef2a56-8d83-45c5-8a90-1619cad753a8 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:51.791733 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef2a56-8d83-45c5-8a90-1619cad753a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:51.792000 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef2a56-8d83-45c5-8a90-1619cad753a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:51.792647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef2a56-8d83-45c5-8a90-1619cad753a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:51.794640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef2a56-8d83-45c5-8a90-1619cad753a8 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:51.899580 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1280/2568] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:05:51 2022] POST /identity/v3/projects => generated 389 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:05:51.903697 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255914a-f45b-4a2d-91ca-c5f220cdf7a2 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:51.913870 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255914a-f45b-4a2d-91ca-c5f220cdf7a2 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:51.925211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:51.970819 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f7ab0-e0ef-4dfb-bf09-4889b8366cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:51.971419 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f7ab0-e0ef-4dfb-bf09-4889b8366cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:51.971697 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f7ab0-e0ef-4dfb-bf09-4889b8366cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:51.971967 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f7ab0-e0ef-4dfb-bf09-4889b8366cb4 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:51.972585 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f7ab0-e0ef-4dfb-bf09-4889b8366cb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:51.974547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f7ab0-e0ef-4dfb-bf09-4889b8366cb4 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:52.059647 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1289/2569] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:05:51 2022] POST /identity/v3/users => generated 295 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:05:52.063766 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef2a56-8d83-45c5-8a90-1619cad753a8 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:52.076154 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef2a56-8d83-45c5-8a90-1619cad753a8 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:52.081117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593ec95-0670-426f-9144-3f96914548af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:52.081720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593ec95-0670-426f-9144-3f96914548af admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:52.082004 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593ec95-0670-426f-9144-3f96914548af admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:52.082299 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593ec95-0670-426f-9144-3f96914548af admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:52.082942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593ec95-0670-426f-9144-3f96914548af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:52.084529 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593ec95-0670-426f-9144-3f96914548af admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:52.094967 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1281/2570] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:05:52.099685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f7ab0-e0ef-4dfb-bf09-4889b8366cb4 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:52.109607 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f7ab0-e0ef-4dfb-bf09-4889b8366cb4 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:52.114835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc6c21-c1bb-429b-a610-6eaa147125c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:52.115427 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc6c21-c1bb-429b-a610-6eaa147125c3 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:52.115704 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc6c21-c1bb-429b-a610-6eaa147125c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:52.115974 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc6c21-c1bb-429b-a610-6eaa147125c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:52.116607 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc6c21-c1bb-429b-a610-6eaa147125c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:52.118205 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc6c21-c1bb-429b-a610-6eaa147125c3 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:52.128507 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1290/2571] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:05:52.132598 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593ec95-0670-426f-9144-3f96914548af admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:52.142557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593ec95-0670-426f-9144-3f96914548af admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:52.147086 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee87be-2365-41ce-a452-fb2da61cd5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:52.147718 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee87be-2365-41ce-a452-fb2da61cd5b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:52.147991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee87be-2365-41ce-a452-fb2da61cd5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:52.148260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee87be-2365-41ce-a452-fb2da61cd5b9 admin admin] PATH_INFO: `/v3/projects/71abfb62843d42948a956e6a8f397304/users/67bacd00bac248ff9a28da0b827cb7c6/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:52.163483 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee87be-2365-41ce-a452-fb2da61cd5b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71abfb62843d42948a956e6a8f397304, user_id=67bacd00bac248ff9a28da0b827cb7c6, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:52.166069 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee87be-2365-41ce-a452-fb2da61cd5b9 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:52.259660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1282/2572] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:05:52 2022] PUT /identity/v3/projects/71abfb62843d42948a956e6a8f397304/users/67bacd00bac248ff9a28da0b827cb7c6/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:52.270995 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4276f4c-3281-48e0-b6bc-ace034019632 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:52.271278 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4276f4c-3281-48e0-b6bc-ace034019632 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:52.271549 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4276f4c-3281-48e0-b6bc-ace034019632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:52.299065 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-e4276f4c-3281-48e0-b6bc-ace034019632 None None] MFA Rules not processed for user `67bacd00bac248ff9a28da0b827cb7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:52.300267 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-e4276f4c-3281-48e0-b6bc-ace034019632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:52.365340 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1291/2573] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:52.369779 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee87be-2365-41ce-a452-fb2da61cd5b9 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:52.430406 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee87be-2365-41ce-a452-fb2da61cd5b9 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:52.435102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e28536-a3f0-4db4-b36e-29c617613a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:52.435704 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e28536-a3f0-4db4-b36e-29c617613a9b admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:52.435982 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e28536-a3f0-4db4-b36e-29c617613a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:52.436254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e28536-a3f0-4db4-b36e-29c617613a9b admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:52.436873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e28536-a3f0-4db4-b36e-29c617613a9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:52.438824 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e28536-a3f0-4db4-b36e-29c617613a9b admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:52.523527 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1283/2574] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:05:52 2022] POST /identity/v3/projects => generated 389 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:05:52.527585 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4276f4c-3281-48e0-b6bc-ace034019632 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:52.538747 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4276f4c-3281-48e0-b6bc-ace034019632 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:52.599078 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27998b-48ff-499b-866f-a461c9994c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:52.599078 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27998b-48ff-499b-866f-a461c9994c9f admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:52.599078 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27998b-48ff-499b-866f-a461c9994c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:52.599078 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27998b-48ff-499b-866f-a461c9994c9f admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:52.599505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27998b-48ff-499b-866f-a461c9994c9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:52.599505 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27998b-48ff-499b-866f-a461c9994c9f admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:52.701120 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1292/2575] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:05:52 2022] POST /identity/v3/users => generated 301 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:05:52.704087 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e28536-a3f0-4db4-b36e-29c617613a9b admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:52.705996 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-d0e28536-a3f0-4db4-b36e-29c617613a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:52.706363 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27998b-48ff-499b-866f-a461c9994c9f admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:52.717296 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27998b-48ff-499b-866f-a461c9994c9f admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:52.724157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecab65-6f88-47b3-acb2-8d18d0317988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:52.724749 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecab65-6f88-47b3-acb2-8d18d0317988 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:52.725021 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecab65-6f88-47b3-acb2-8d18d0317988 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:52.725284 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecab65-6f88-47b3-acb2-8d18d0317988 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:52.725914 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecab65-6f88-47b3-acb2-8d18d0317988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:52.727574 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecab65-6f88-47b3-acb2-8d18d0317988 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:52.737772 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1293/2576] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:05:52.741964 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecab65-6f88-47b3-acb2-8d18d0317988 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:52.746967 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:52.751906 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecab65-6f88-47b3-acb2-8d18d0317988 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:52.756572 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa70c97-399f-4578-98c0-6d10ad649a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:52.757193 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa70c97-399f-4578-98c0-6d10ad649a9a admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:52.757467 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa70c97-399f-4578-98c0-6d10ad649a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:52.757733 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa70c97-399f-4578-98c0-6d10ad649a9a admin admin] PATH_INFO: `/v3/projects/559fde7f271a4b41950ea98c74b3020a/users/a22e3f0c06034c808e5c89811bd8b372/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:52.767927 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e28536-a3f0-4db4-b36e-29c617613a9b admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:52.772176 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd3106-24ce-44b4-a797-b86c5a4e6ec8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:52.772634 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa70c97-399f-4578-98c0-6d10ad649a9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=559fde7f271a4b41950ea98c74b3020a, user_id=a22e3f0c06034c808e5c89811bd8b372, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:52.772831 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd3106-24ce-44b4-a797-b86c5a4e6ec8 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:52.773130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd3106-24ce-44b4-a797-b86c5a4e6ec8 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:52.773386 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd3106-24ce-44b4-a797-b86c5a4e6ec8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:52.775159 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-35bd3106-24ce-44b4-a797-b86c5a4e6ec8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:52.775282 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa70c97-399f-4578-98c0-6d10ad649a9a admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:52.789266 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:52.833929 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd3106-24ce-44b4-a797-b86c5a4e6ec8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:52.835573 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd3106-24ce-44b4-a797-b86c5a4e6ec8 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:52.842791 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1294/2577] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:05:52 2022] PUT /identity/v3/projects/559fde7f271a4b41950ea98c74b3020a/users/a22e3f0c06034c808e5c89811bd8b372/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:05:52.844391 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1284/2578] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:05:52.846988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa70c97-399f-4578-98c0-6d10ad649a9a admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:52.909646 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa70c97-399f-4578-98c0-6d10ad649a9a admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:52.915789 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332df35-acd9-4560-b775-2bc9ad80d984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:52.916475 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332df35-acd9-4560-b775-2bc9ad80d984 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:52.916750 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332df35-acd9-4560-b775-2bc9ad80d984 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:52.917438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332df35-acd9-4560-b775-2bc9ad80d984 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:52.918072 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332df35-acd9-4560-b775-2bc9ad80d984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:52.919686 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332df35-acd9-4560-b775-2bc9ad80d984 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:52.930740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1295/2579] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:05:52.935579 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd3106-24ce-44b4-a797-b86c5a4e6ec8 service cinder] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:52.949991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd3106-24ce-44b4-a797-b86c5a4e6ec8 service cinder] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:52.956596 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfad65-bd0e-47be-b317-77c68d884408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:52.960452 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfad65-bd0e-47be-b317-77c68d884408 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:52.960452 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfad65-bd0e-47be-b317-77c68d884408 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:52.960452 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfad65-bd0e-47be-b317-77c68d884408 admin admin] PATH_INFO: `/v3/projects/559fde7f271a4b41950ea98c74b3020a/users/a22e3f0c06034c808e5c89811bd8b372/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:52.961932 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddfad65-bd0e-47be-b317-77c68d884408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=559fde7f271a4b41950ea98c74b3020a, user_id=a22e3f0c06034c808e5c89811bd8b372, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:52.966263 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddfad65-bd0e-47be-b317-77c68d884408 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:52.979548 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1285/2580] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:05:52 2022] PUT /identity/v3/projects/559fde7f271a4b41950ea98c74b3020a/users/a22e3f0c06034c808e5c89811bd8b372/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:52.990074 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81432fec-f12d-46f5-9b32-da0d8c9de227 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:52.994905 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81432fec-f12d-46f5-9b32-da0d8c9de227 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:52.994905 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81432fec-f12d-46f5-9b32-da0d8c9de227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:53.018932 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-81432fec-f12d-46f5-9b32-da0d8c9de227 None None] MFA Rules not processed for user `a22e3f0c06034c808e5c89811bd8b372`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:53.020919 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-81432fec-f12d-46f5-9b32-da0d8c9de227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:53.088327 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1296/2581] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:52 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:53.099448 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfad65-bd0e-47be-b317-77c68d884408 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:53.101310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-2ddfad65-bd0e-47be-b317-77c68d884408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:53.160919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfad65-bd0e-47be-b317-77c68d884408 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:53.164706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1096053-0017-4566-870a-67ce2a4511d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:53.165302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1096053-0017-4566-870a-67ce2a4511d3 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:53.165577 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1096053-0017-4566-870a-67ce2a4511d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:53.165846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1096053-0017-4566-870a-67ce2a4511d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:53.174752 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1096053-0017-4566-870a-67ce2a4511d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:53.176238 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1096053-0017-4566-870a-67ce2a4511d3 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:53.185592 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1286/2582] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:53 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:05:53.347807 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81432fec-f12d-46f5-9b32-da0d8c9de227 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:53.411235 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81432fec-f12d-46f5-9b32-da0d8c9de227 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:53.416130 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03188f-5a7a-456c-b7b8-0937fbac71c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:53.416748 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03188f-5a7a-456c-b7b8-0937fbac71c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:53.417021 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03188f-5a7a-456c-b7b8-0937fbac71c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:53.417288 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03188f-5a7a-456c-b7b8-0937fbac71c0 admin admin] PATH_INFO: `/v3/users/67bacd00bac248ff9a28da0b827cb7c6` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:53.418452 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03188f-5a7a-456c-b7b8-0937fbac71c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67bacd00bac248ff9a28da0b827cb7c6)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:53.420358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03188f-5a7a-456c-b7b8-0937fbac71c0 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:53.421919 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:53.576304 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-cb03188f-5a7a-456c-b7b8-0937fbac71c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67bacd00bac248ff9a28da0b827cb7c6'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:53.588157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-cb03188f-5a7a-456c-b7b8-0937fbac71c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67bacd00bac248ff9a28da0b827cb7c6'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:53.588810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-cb03188f-5a7a-456c-b7b8-0937fbac71c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67bacd00bac248ff9a28da0b827cb7c6'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:53.589442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-cb03188f-5a7a-456c-b7b8-0937fbac71c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67bacd00bac248ff9a28da0b827cb7c6'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:53.596308 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-cb03188f-5a7a-456c-b7b8-0937fbac71c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67bacd00bac248ff9a28da0b827cb7c6'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:53.653125 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1297/2583] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:05:53 2022] DELETE /identity/v3/users/67bacd00bac248ff9a28da0b827cb7c6 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:53.658449 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6234d90-dcd7-4913-a5be-27676dca947e None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:53.658884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6234d90-dcd7-4913-a5be-27676dca947e None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:53.659281 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6234d90-dcd7-4913-a5be-27676dca947e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:53.679429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-c6234d90-dcd7-4913-a5be-27676dca947e None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:53.680659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-c6234d90-dcd7-4913-a5be-27676dca947e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:53.751888 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1287/2584] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:53.762000 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03188f-5a7a-456c-b7b8-0937fbac71c0 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:53.763589 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-cb03188f-5a7a-456c-b7b8-0937fbac71c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:53.820985 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03188f-5a7a-456c-b7b8-0937fbac71c0 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:53.824654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3c681-567d-43f3-936e-c51bf74faefe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:53.825345 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3c681-567d-43f3-936e-c51bf74faefe service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:53.825634 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3c681-567d-43f3-936e-c51bf74faefe service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:53.825895 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3c681-567d-43f3-936e-c51bf74faefe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:53.836172 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3c681-567d-43f3-936e-c51bf74faefe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:53.837787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3c681-567d-43f3-936e-c51bf74faefe service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:53.847508 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1298/2585] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:05:54.185264 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6234d90-dcd7-4913-a5be-27676dca947e None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:54.186681 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-c6234d90-dcd7-4913-a5be-27676dca947e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:54.238329 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:54.243422 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6234d90-dcd7-4913-a5be-27676dca947e None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:54.247128 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e15d8-8a73-4849-a607-c0c0cabf4aa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:54.247788 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e15d8-8a73-4849-a607-c0c0cabf4aa6 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:54.248067 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e15d8-8a73-4849-a607-c0c0cabf4aa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:54.248336 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e15d8-8a73-4849-a607-c0c0cabf4aa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:54.250140 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-2c0e15d8-8a73-4849-a607-c0c0cabf4aa6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:54.292390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3c681-567d-43f3-936e-c51bf74faefe service neutron] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:54.292696 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-d7f3c681-567d-43f3-936e-c51bf74faefe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:54.318861 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e15d8-8a73-4849-a607-c0c0cabf4aa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:54.320349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e15d8-8a73-4849-a607-c0c0cabf4aa6 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:54.332395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1288/2586] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:05:54.337462 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3c681-567d-43f3-936e-c51bf74faefe service neutron] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:54.342420 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a01c4-9a44-4b5c-9ad2-0c5087f93bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:54.344177 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a01c4-9a44-4b5c-9ad2-0c5087f93bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:54.344177 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a01c4-9a44-4b5c-9ad2-0c5087f93bed admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:54.344177 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a01c4-9a44-4b5c-9ad2-0c5087f93bed admin admin] PATH_INFO: `/v3/projects/71abfb62843d42948a956e6a8f397304` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:54.344728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a01c4-9a44-4b5c-9ad2-0c5087f93bed admin admin] RBAC: Authorizing `identity:delete_project(project_id=71abfb62843d42948a956e6a8f397304)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:54.346664 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a01c4-9a44-4b5c-9ad2-0c5087f93bed admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:54.465461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-708a01c4-9a44-4b5c-9ad2-0c5087f93bed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71abfb62843d42948a956e6a8f397304', 'request_id': 'req-708a01c4-9a44-4b5c-9ad2-0c5087f93bed'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:54.471041 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-708a01c4-9a44-4b5c-9ad2-0c5087f93bed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71abfb62843d42948a956e6a8f397304', 'request_id': 'req-708a01c4-9a44-4b5c-9ad2-0c5087f93bed'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:54.539913 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-708a01c4-9a44-4b5c-9ad2-0c5087f93bed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71abfb62843d42948a956e6a8f397304', 'request_id': 'req-708a01c4-9a44-4b5c-9ad2-0c5087f93bed'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:54.552135 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-708a01c4-9a44-4b5c-9ad2-0c5087f93bed admin admin] The token cache is being invalidate because project 71abfb62843d42948a956e6a8f397304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:05:54.552417 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-708a01c4-9a44-4b5c-9ad2-0c5087f93bed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:54.553067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-708a01c4-9a44-4b5c-9ad2-0c5087f93bed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:54.554560 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1299/2587] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:05:54 2022] DELETE /identity/v3/projects/71abfb62843d42948a956e6a8f397304 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:05:54.558603 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e15d8-8a73-4849-a607-c0c0cabf4aa6 service cinder] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:54.569046 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e15d8-8a73-4849-a607-c0c0cabf4aa6 service cinder] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:54.625982 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d5b8b-0e71-4594-bbc4-d094535a9dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:54.626561 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d5b8b-0e71-4594-bbc4-d094535a9dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:54.626843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d5b8b-0e71-4594-bbc4-d094535a9dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:54.627116 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d5b8b-0e71-4594-bbc4-d094535a9dd1 admin admin] PATH_INFO: `/v3/users/a22e3f0c06034c808e5c89811bd8b372` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:54.628298 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d5b8b-0e71-4594-bbc4-d094535a9dd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a22e3f0c06034c808e5c89811bd8b372)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:54.630317 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d5b8b-0e71-4594-bbc4-d094535a9dd1 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:54.833859 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-982d5b8b-0e71-4594-bbc4-d094535a9dd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a22e3f0c06034c808e5c89811bd8b372'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:54.845705 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-982d5b8b-0e71-4594-bbc4-d094535a9dd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a22e3f0c06034c808e5c89811bd8b372'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:54.846444 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-982d5b8b-0e71-4594-bbc4-d094535a9dd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a22e3f0c06034c808e5c89811bd8b372'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:54.853814 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-982d5b8b-0e71-4594-bbc4-d094535a9dd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a22e3f0c06034c808e5c89811bd8b372'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:54.939357 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-982d5b8b-0e71-4594-bbc4-d094535a9dd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a22e3f0c06034c808e5c89811bd8b372'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:54.945360 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1289/2588] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:05:54 2022] DELETE /identity/v3/users/a22e3f0c06034c808e5c89811bd8b372 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:55.353939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a01c4-9a44-4b5c-9ad2-0c5087f93bed admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:55.355520 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-708a01c4-9a44-4b5c-9ad2-0c5087f93bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:55.365481 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:55.369797 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a01c4-9a44-4b5c-9ad2-0c5087f93bed admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:55.428314 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde01472-7220-43c0-82b9-96d09b9c69ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:55.428941 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde01472-7220-43c0-82b9-96d09b9c69ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:55.429214 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde01472-7220-43c0-82b9-96d09b9c69ae admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:55.429498 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde01472-7220-43c0-82b9-96d09b9c69ae admin admin] PATH_INFO: `/v3/projects/559fde7f271a4b41950ea98c74b3020a` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:55.430844 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde01472-7220-43c0-82b9-96d09b9c69ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=559fde7f271a4b41950ea98c74b3020a)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:55.433342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde01472-7220-43c0-82b9-96d09b9c69ae admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:55.557930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-dde01472-7220-43c0-82b9-96d09b9c69ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '559fde7f271a4b41950ea98c74b3020a', 'request_id': 'req-dde01472-7220-43c0-82b9-96d09b9c69ae'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:55.563629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-dde01472-7220-43c0-82b9-96d09b9c69ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '559fde7f271a4b41950ea98c74b3020a', 'request_id': 'req-dde01472-7220-43c0-82b9-96d09b9c69ae'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:55.682835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-dde01472-7220-43c0-82b9-96d09b9c69ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '559fde7f271a4b41950ea98c74b3020a', 'request_id': 'req-dde01472-7220-43c0-82b9-96d09b9c69ae'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:55.695611 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-dde01472-7220-43c0-82b9-96d09b9c69ae admin admin] The token cache is being invalidate because project 559fde7f271a4b41950ea98c74b3020a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:05:55.695888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-dde01472-7220-43c0-82b9-96d09b9c69ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:55.696553 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-dde01472-7220-43c0-82b9-96d09b9c69ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:55.698032 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1300/2589] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:05:55 2022] DELETE /identity/v3/projects/559fde7f271a4b41950ea98c74b3020a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:55.703204 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b39e-88b7-4c60-8c5c-56b08dd0888a None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:55.704290 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b39e-88b7-4c60-8c5c-56b08dd0888a None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:55.704290 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b39e-88b7-4c60-8c5c-56b08dd0888a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:55.724350 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-0022b39e-88b7-4c60-8c5c-56b08dd0888a None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:55.727258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-0022b39e-88b7-4c60-8c5c-56b08dd0888a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:55.734995 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:55.801075 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1290/2590] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:55.819216 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af884a0e-fcee-4e82-9bcd-4cfa502198b4 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:55.819216 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af884a0e-fcee-4e82-9bcd-4cfa502198b4 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:55.819216 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af884a0e-fcee-4e82-9bcd-4cfa502198b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:55.830901 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-af884a0e-fcee-4e82-9bcd-4cfa502198b4 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:55.832107 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-af884a0e-fcee-4e82-9bcd-4cfa502198b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:55.840319 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1301/2591] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:55.844554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022b39e-88b7-4c60-8c5c-56b08dd0888a None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:55.854813 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022b39e-88b7-4c60-8c5c-56b08dd0888a None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:55.859485 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67589afc-ab21-4612-85d0-86b1724e8a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:55.860075 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67589afc-ab21-4612-85d0-86b1724e8a09 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:55.860354 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67589afc-ab21-4612-85d0-86b1724e8a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:55.860623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67589afc-ab21-4612-85d0-86b1724e8a09 admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:55.861262 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67589afc-ab21-4612-85d0-86b1724e8a09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:05:55.861565 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67589afc-ab21-4612-85d0-86b1724e8a09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:55.863191 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67589afc-ab21-4612-85d0-86b1724e8a09 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:55.875665 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1291/2592] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:05:55.880158 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af884a0e-fcee-4e82-9bcd-4cfa502198b4 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:55.889859 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af884a0e-fcee-4e82-9bcd-4cfa502198b4 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:55.899888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7826b-77a8-4d07-9cb3-37552ad335f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:55.899888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7826b-77a8-4d07-9cb3-37552ad335f1 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:55.899888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7826b-77a8-4d07-9cb3-37552ad335f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:55.899888 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7826b-77a8-4d07-9cb3-37552ad335f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:55.900565 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7826b-77a8-4d07-9cb3-37552ad335f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:55.900565 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7826b-77a8-4d07-9cb3-37552ad335f1 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:56.019922 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1302/2593] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:05:55 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:05:56.026969 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67589afc-ab21-4612-85d0-86b1724e8a09 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:56.037677 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67589afc-ab21-4612-85d0-86b1724e8a09 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:56.094005 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e992e52-6713-4fdb-8667-4c5802327bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:56.094643 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e992e52-6713-4fdb-8667-4c5802327bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:56.094917 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e992e52-6713-4fdb-8667-4c5802327bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:56.095182 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e992e52-6713-4fdb-8667-4c5802327bf2 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:56.095800 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e992e52-6713-4fdb-8667-4c5802327bf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:56.097764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e992e52-6713-4fdb-8667-4c5802327bf2 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:56.196237 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1292/2594] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:05:56 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:05:56.200273 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7826b-77a8-4d07-9cb3-37552ad335f1 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:56.211969 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7826b-77a8-4d07-9cb3-37552ad335f1 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:56.216630 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92b3aa-79a9-45e3-887a-ebc2882f36a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:56.217261 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92b3aa-79a9-45e3-887a-ebc2882f36a8 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:56.217532 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92b3aa-79a9-45e3-887a-ebc2882f36a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:56.217798 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92b3aa-79a9-45e3-887a-ebc2882f36a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:56.218548 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92b3aa-79a9-45e3-887a-ebc2882f36a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:56.220107 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92b3aa-79a9-45e3-887a-ebc2882f36a8 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:56.232247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1303/2595] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:05:56.236277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e992e52-6713-4fdb-8667-4c5802327bf2 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:56.246743 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e992e52-6713-4fdb-8667-4c5802327bf2 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:56.252064 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6ea37-7cf5-45cb-afa5-e4713f4b62a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:56.252632 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6ea37-7cf5-45cb-afa5-e4713f4b62a4 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:56.252901 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6ea37-7cf5-45cb-afa5-e4713f4b62a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:56.253165 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6ea37-7cf5-45cb-afa5-e4713f4b62a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:56.253796 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6ea37-7cf5-45cb-afa5-e4713f4b62a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:56.255555 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6ea37-7cf5-45cb-afa5-e4713f4b62a4 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:56.266867 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1293/2596] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:05:56.271532 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92b3aa-79a9-45e3-887a-ebc2882f36a8 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:56.281483 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92b3aa-79a9-45e3-887a-ebc2882f36a8 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:56.287100 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fd7d4-71fb-40de-a119-cfa88f133456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:56.287796 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fd7d4-71fb-40de-a119-cfa88f133456 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:56.288075 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fd7d4-71fb-40de-a119-cfa88f133456 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:56.288446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fd7d4-71fb-40de-a119-cfa88f133456 admin admin] PATH_INFO: `/v3/projects/fd233af457064e5682260e8c9bf43cf8/users/a3e1d65e6c2044b8b1ecf8aba4957c51/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:56.303733 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fd7d4-71fb-40de-a119-cfa88f133456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd233af457064e5682260e8c9bf43cf8, user_id=a3e1d65e6c2044b8b1ecf8aba4957c51, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:56.306485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fd7d4-71fb-40de-a119-cfa88f133456 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:56.408953 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1304/2597] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:05:56 2022] PUT /identity/v3/projects/fd233af457064e5682260e8c9bf43cf8/users/a3e1d65e6c2044b8b1ecf8aba4957c51/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:56.421301 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94591d83-f871-4708-91d3-e12f3f5630ad None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:56.421586 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94591d83-f871-4708-91d3-e12f3f5630ad None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:56.421861 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94591d83-f871-4708-91d3-e12f3f5630ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:56.449400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-94591d83-f871-4708-91d3-e12f3f5630ad None None] MFA Rules not processed for user `a3e1d65e6c2044b8b1ecf8aba4957c51`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:56.450760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-94591d83-f871-4708-91d3-e12f3f5630ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:56.513873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1294/2598] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:56.527185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fd7d4-71fb-40de-a119-cfa88f133456 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:56.528966 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ac0fd7d4-71fb-40de-a119-cfa88f133456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:56.562853 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:56.586049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fd7d4-71fb-40de-a119-cfa88f133456 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:56.589786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083e25e-f622-42a6-988c-e971eb82453d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:56.590422 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083e25e-f622-42a6-988c-e971eb82453d service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:56.590700 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083e25e-f622-42a6-988c-e971eb82453d service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:56.590971 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083e25e-f622-42a6-988c-e971eb82453d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:56.599599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083e25e-f622-42a6-988c-e971eb82453d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:56.601022 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083e25e-f622-42a6-988c-e971eb82453d service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:56.609551 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1305/2599] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:05:56.628399 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94591d83-f871-4708-91d3-e12f3f5630ad None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:56.641591 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:56.691357 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94591d83-f871-4708-91d3-e12f3f5630ad None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:56.696693 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a07c6-e210-4ae4-aafe-46f3a41e9018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:56.697375 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a07c6-e210-4ae4-aafe-46f3a41e9018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:56.697651 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a07c6-e210-4ae4-aafe-46f3a41e9018 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:56.697921 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a07c6-e210-4ae4-aafe-46f3a41e9018 admin admin] PATH_INFO: `/v3/users/a3e1d65e6c2044b8b1ecf8aba4957c51` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:56.699083 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a07c6-e210-4ae4-aafe-46f3a41e9018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3e1d65e6c2044b8b1ecf8aba4957c51)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:56.704232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a07c6-e210-4ae4-aafe-46f3a41e9018 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:56.850056 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-924a07c6-e210-4ae4-aafe-46f3a41e9018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3e1d65e6c2044b8b1ecf8aba4957c51'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:56.861973 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-924a07c6-e210-4ae4-aafe-46f3a41e9018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3e1d65e6c2044b8b1ecf8aba4957c51'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:56.862689 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-924a07c6-e210-4ae4-aafe-46f3a41e9018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3e1d65e6c2044b8b1ecf8aba4957c51'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:56.869612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-924a07c6-e210-4ae4-aafe-46f3a41e9018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3e1d65e6c2044b8b1ecf8aba4957c51'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:56.945530 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-924a07c6-e210-4ae4-aafe-46f3a41e9018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3e1d65e6c2044b8b1ecf8aba4957c51'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:56.951993 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1295/2600] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:05:56 2022] DELETE /identity/v3/users/a3e1d65e6c2044b8b1ecf8aba4957c51 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:56.956674 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89660591-3f05-4ce1-83ec-a7aae489f3eb None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:56.956981 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89660591-3f05-4ce1-83ec-a7aae489f3eb None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:56.957252 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89660591-3f05-4ce1-83ec-a7aae489f3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:56.977075 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-89660591-3f05-4ce1-83ec-a7aae489f3eb None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:56.978342 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-89660591-3f05-4ce1-83ec-a7aae489f3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:57.039878 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1306/2601] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:57.049824 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a07c6-e210-4ae4-aafe-46f3a41e9018 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:57.051282 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-924a07c6-e210-4ae4-aafe-46f3a41e9018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:57.111341 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a07c6-e210-4ae4-aafe-46f3a41e9018 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:57.115520 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495940da-8dde-417c-87ed-fa58ffbb0ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:57.116119 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495940da-8dde-417c-87ed-fa58ffbb0ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:57.116397 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495940da-8dde-417c-87ed-fa58ffbb0ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:57.116668 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495940da-8dde-417c-87ed-fa58ffbb0ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:57.125552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495940da-8dde-417c-87ed-fa58ffbb0ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:57.127059 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495940da-8dde-417c-87ed-fa58ffbb0ef2 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:57.137248 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1296/2602] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:05:57.541839 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89660591-3f05-4ce1-83ec-a7aae489f3eb None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:57.544002 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-89660591-3f05-4ce1-83ec-a7aae489f3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:57.556724 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89660591-3f05-4ce1-83ec-a7aae489f3eb None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:57.561645 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601f81e-f78e-4f9f-ae8a-3a3d55a1d3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:57.562417 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601f81e-f78e-4f9f-ae8a-3a3d55a1d3db admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:57.562562 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601f81e-f78e-4f9f-ae8a-3a3d55a1d3db admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:57.563016 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601f81e-f78e-4f9f-ae8a-3a3d55a1d3db admin admin] PATH_INFO: `/v3/projects/fd233af457064e5682260e8c9bf43cf8` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:57.564324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601f81e-f78e-4f9f-ae8a-3a3d55a1d3db admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd233af457064e5682260e8c9bf43cf8)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:57.566482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601f81e-f78e-4f9f-ae8a-3a3d55a1d3db admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:57.706188 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-4601f81e-f78e-4f9f-ae8a-3a3d55a1d3db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd233af457064e5682260e8c9bf43cf8', 'request_id': 'req-4601f81e-f78e-4f9f-ae8a-3a3d55a1d3db'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:57.711878 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-4601f81e-f78e-4f9f-ae8a-3a3d55a1d3db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd233af457064e5682260e8c9bf43cf8', 'request_id': 'req-4601f81e-f78e-4f9f-ae8a-3a3d55a1d3db'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:57.780184 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-4601f81e-f78e-4f9f-ae8a-3a3d55a1d3db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd233af457064e5682260e8c9bf43cf8', 'request_id': 'req-4601f81e-f78e-4f9f-ae8a-3a3d55a1d3db'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:57.794305 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-4601f81e-f78e-4f9f-ae8a-3a3d55a1d3db admin admin] The token cache is being invalidate because project fd233af457064e5682260e8c9bf43cf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:05:57.794596 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-4601f81e-f78e-4f9f-ae8a-3a3d55a1d3db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:57.795243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-4601f81e-f78e-4f9f-ae8a-3a3d55a1d3db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:57.796773 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1307/2603] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:05:57 2022] DELETE /identity/v3/projects/fd233af457064e5682260e8c9bf43cf8 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:57.801764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f13519-7164-409e-a672-8809d03e4285 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:57.802283 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f13519-7164-409e-a672-8809d03e4285 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:57.802388 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f13519-7164-409e-a672-8809d03e4285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:57.822786 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-f6f13519-7164-409e-a672-8809d03e4285 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:57.824000 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-f6f13519-7164-409e-a672-8809d03e4285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:57.856123 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:57.886282 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1297/2604] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:57.894165 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c4056-3542-41c8-a300-5d3d469d5fee None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:57.894377 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c4056-3542-41c8-a300-5d3d469d5fee None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:57.894646 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c4056-3542-41c8-a300-5d3d469d5fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:57.916694 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-6d0c4056-3542-41c8-a300-5d3d469d5fee None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:57.918024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-6d0c4056-3542-41c8-a300-5d3d469d5fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:57.926321 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1308/2605] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:57.930659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f13519-7164-409e-a672-8809d03e4285 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:57.940532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f13519-7164-409e-a672-8809d03e4285 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:57.945407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc682942-7140-45ab-8866-d0ac33f38bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:57.946000 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc682942-7140-45ab-8866-d0ac33f38bde admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:57.946310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc682942-7140-45ab-8866-d0ac33f38bde admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:57.946579 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc682942-7140-45ab-8866-d0ac33f38bde admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:57.947217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc682942-7140-45ab-8866-d0ac33f38bde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:05:57.947519 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc682942-7140-45ab-8866-d0ac33f38bde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:57.949503 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc682942-7140-45ab-8866-d0ac33f38bde admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:57.961671 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1298/2606] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:05:57.965986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c4056-3542-41c8-a300-5d3d469d5fee None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:57.975901 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c4056-3542-41c8-a300-5d3d469d5fee None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:57.980768 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78c4ac-44db-4e09-954a-35788c93f194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:57.981361 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78c4ac-44db-4e09-954a-35788c93f194 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:57.981635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78c4ac-44db-4e09-954a-35788c93f194 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:57.981894 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78c4ac-44db-4e09-954a-35788c93f194 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:57.982562 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78c4ac-44db-4e09-954a-35788c93f194 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:57.984477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78c4ac-44db-4e09-954a-35788c93f194 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:58.097962 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1309/2607] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:05:57 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:05:58.099960 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc682942-7140-45ab-8866-d0ac33f38bde admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:58.110097 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc682942-7140-45ab-8866-d0ac33f38bde admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:58.170026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeba994-5bfe-4c2d-bdb2-cc6483b97abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:58.170660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeba994-5bfe-4c2d-bdb2-cc6483b97abe admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:58.170939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeba994-5bfe-4c2d-bdb2-cc6483b97abe admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:58.171214 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeba994-5bfe-4c2d-bdb2-cc6483b97abe admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:58.171834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeba994-5bfe-4c2d-bdb2-cc6483b97abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:58.173985 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeba994-5bfe-4c2d-bdb2-cc6483b97abe admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:58.248345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1299/2608] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:05:58 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:05:58.252576 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78c4ac-44db-4e09-954a-35788c93f194 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:58.263441 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78c4ac-44db-4e09-954a-35788c93f194 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:58.268232 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b7e1f-7ad0-45f4-a3ba-ba48a7fcbbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:58.268821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b7e1f-7ad0-45f4-a3ba-ba48a7fcbbfc admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:58.269099 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b7e1f-7ad0-45f4-a3ba-ba48a7fcbbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:58.269372 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b7e1f-7ad0-45f4-a3ba-ba48a7fcbbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:58.270009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b7e1f-7ad0-45f4-a3ba-ba48a7fcbbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:58.272243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b7e1f-7ad0-45f4-a3ba-ba48a7fcbbfc admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:58.282895 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1310/2609] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:05:58.287041 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeba994-5bfe-4c2d-bdb2-cc6483b97abe admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:58.297485 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeba994-5bfe-4c2d-bdb2-cc6483b97abe admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:58.302335 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f823693-f2e5-4696-9d15-356cc1720ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:58.303076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f823693-f2e5-4696-9d15-356cc1720ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:58.303437 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f823693-f2e5-4696-9d15-356cc1720ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:58.303803 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f823693-f2e5-4696-9d15-356cc1720ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:58.304508 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f823693-f2e5-4696-9d15-356cc1720ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:58.306122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f823693-f2e5-4696-9d15-356cc1720ac9 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:58.317014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1300/2610] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:05:58.321828 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b7e1f-7ad0-45f4-a3ba-ba48a7fcbbfc admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:58.331864 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b7e1f-7ad0-45f4-a3ba-ba48a7fcbbfc admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:58.337144 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebee5ae-49a4-427a-8dbb-32fca2ce91f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:58.337886 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebee5ae-49a4-427a-8dbb-32fca2ce91f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:58.338193 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebee5ae-49a4-427a-8dbb-32fca2ce91f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:58.338447 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebee5ae-49a4-427a-8dbb-32fca2ce91f9 admin admin] PATH_INFO: `/v3/projects/992c984c373548a3949762f1a7377f11/users/083ff6902a8b461c94d9301c29ae3ca4/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:58.353499 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebee5ae-49a4-427a-8dbb-32fca2ce91f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=992c984c373548a3949762f1a7377f11, user_id=083ff6902a8b461c94d9301c29ae3ca4, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:58.356286 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebee5ae-49a4-427a-8dbb-32fca2ce91f9 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:58.358674 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:58.442904 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1311/2611] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:05:58 2022] PUT /identity/v3/projects/992c984c373548a3949762f1a7377f11/users/083ff6902a8b461c94d9301c29ae3ca4/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:58.454011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25863d99-262c-4a4e-ab8b-1184bac6a136 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:58.454320 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25863d99-262c-4a4e-ab8b-1184bac6a136 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:58.454587 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25863d99-262c-4a4e-ab8b-1184bac6a136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:58.481757 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-25863d99-262c-4a4e-ab8b-1184bac6a136 None None] MFA Rules not processed for user `083ff6902a8b461c94d9301c29ae3ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:58.482974 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-25863d99-262c-4a4e-ab8b-1184bac6a136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:58.548036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1301/2612] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:58.561354 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebee5ae-49a4-427a-8dbb-32fca2ce91f9 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:58.563258 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-0ebee5ae-49a4-427a-8dbb-32fca2ce91f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:58.619494 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebee5ae-49a4-427a-8dbb-32fca2ce91f9 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:58.623270 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15afe413-7c7e-4ad2-be33-19ad29e27568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:58.623896 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afe413-7c7e-4ad2-be33-19ad29e27568 service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:58.624172 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afe413-7c7e-4ad2-be33-19ad29e27568 service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:58.624443 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afe413-7c7e-4ad2-be33-19ad29e27568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:58.633733 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15afe413-7c7e-4ad2-be33-19ad29e27568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:58.635328 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15afe413-7c7e-4ad2-be33-19ad29e27568 service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:58.644665 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1312/2613] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:05:58.947484 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25863d99-262c-4a4e-ab8b-1184bac6a136 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:58.948970 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-25863d99-262c-4a4e-ab8b-1184bac6a136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:58.981401 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:05:59.015516 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25863d99-262c-4a4e-ab8b-1184bac6a136 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:59.019985 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efad673-d1f2-4a7d-af89-515ba6874836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:59.026607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efad673-d1f2-4a7d-af89-515ba6874836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:59.026607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efad673-d1f2-4a7d-af89-515ba6874836 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:59.026607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efad673-d1f2-4a7d-af89-515ba6874836 admin admin] PATH_INFO: `/v3/users/2f191183f2e44d83837459364dd8034d` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:59.026607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efad673-d1f2-4a7d-af89-515ba6874836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f191183f2e44d83837459364dd8034d)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:59.026607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efad673-d1f2-4a7d-af89-515ba6874836 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:59.244297 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7efad673-d1f2-4a7d-af89-515ba6874836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f191183f2e44d83837459364dd8034d'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:59.256312 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7efad673-d1f2-4a7d-af89-515ba6874836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f191183f2e44d83837459364dd8034d'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:59.256992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7efad673-d1f2-4a7d-af89-515ba6874836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f191183f2e44d83837459364dd8034d'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:59.263883 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7efad673-d1f2-4a7d-af89-515ba6874836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f191183f2e44d83837459364dd8034d'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:59.356801 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-7efad673-d1f2-4a7d-af89-515ba6874836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f191183f2e44d83837459364dd8034d'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:05:59.363551 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1302/2614] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:05:58 2022] DELETE /identity/v3/users/2f191183f2e44d83837459364dd8034d => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:05:59.368041 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53818768-c19f-4af7-abdb-28d187f3ce0d None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:59.368324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53818768-c19f-4af7-abdb-28d187f3ce0d None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:59.368593 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53818768-c19f-4af7-abdb-28d187f3ce0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:59.387297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-53818768-c19f-4af7-abdb-28d187f3ce0d None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:05:59.388510 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-53818768-c19f-4af7-abdb-28d187f3ce0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:59.449950 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1313/2615] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:05:59.460904 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efad673-d1f2-4a7d-af89-515ba6874836 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:59.462263 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-7efad673-d1f2-4a7d-af89-515ba6874836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:59.519388 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efad673-d1f2-4a7d-af89-515ba6874836 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:59.523559 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89342c-e167-42b6-8ca0-a7f13efd50f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:59.524163 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89342c-e167-42b6-8ca0-a7f13efd50f5 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:59.524440 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89342c-e167-42b6-8ca0-a7f13efd50f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:59.524710 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89342c-e167-42b6-8ca0-a7f13efd50f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:59.533796 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89342c-e167-42b6-8ca0-a7f13efd50f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:59.535435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89342c-e167-42b6-8ca0-a7f13efd50f5 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:05:59.545505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1303/2616] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:05:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:05:59.953196 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53818768-c19f-4af7-abdb-28d187f3ce0d None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:05:59.955027 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-53818768-c19f-4af7-abdb-28d187f3ce0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:05:59.967662 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53818768-c19f-4af7-abdb-28d187f3ce0d None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:05:59.972685 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecdc4d-263e-4630-8016-a654f11df293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:05:59.973392 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecdc4d-263e-4630-8016-a654f11df293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:05:59.973730 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecdc4d-263e-4630-8016-a654f11df293 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:05:59.974067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecdc4d-263e-4630-8016-a654f11df293 admin admin] PATH_INFO: `/v3/projects/9fccb80efbfc43668f4b3a54ee2a8b92` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:05:59.975272 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecdc4d-263e-4630-8016-a654f11df293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fccb80efbfc43668f4b3a54ee2a8b92)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:05:59.977257 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecdc4d-263e-4630-8016-a654f11df293 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:00.162681 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ddecdc4d-263e-4630-8016-a654f11df293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fccb80efbfc43668f4b3a54ee2a8b92', 'request_id': 'req-ddecdc4d-263e-4630-8016-a654f11df293'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:00.168090 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ddecdc4d-263e-4630-8016-a654f11df293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fccb80efbfc43668f4b3a54ee2a8b92', 'request_id': 'req-ddecdc4d-263e-4630-8016-a654f11df293'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:00.252671 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ddecdc4d-263e-4630-8016-a654f11df293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fccb80efbfc43668f4b3a54ee2a8b92', 'request_id': 'req-ddecdc4d-263e-4630-8016-a654f11df293'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:00.265459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ddecdc4d-263e-4630-8016-a654f11df293 admin admin] The token cache is being invalidate because project 9fccb80efbfc43668f4b3a54ee2a8b92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:06:00.265747 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ddecdc4d-263e-4630-8016-a654f11df293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:00.266389 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ddecdc4d-263e-4630-8016-a654f11df293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:00.268070 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1314/2617] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:05:59 2022] DELETE /identity/v3/projects/9fccb80efbfc43668f4b3a54ee2a8b92 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:00.271855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89342c-e167-42b6-8ca0-a7f13efd50f5 service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:00.281960 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89342c-e167-42b6-8ca0-a7f13efd50f5 service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:00.333198 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:00.343591 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee510ef-aa45-4fb2-aac8-2e9e253cfbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:00.344223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee510ef-aa45-4fb2-aac8-2e9e253cfbd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:00.344500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee510ef-aa45-4fb2-aac8-2e9e253cfbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:00.344766 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee510ef-aa45-4fb2-aac8-2e9e253cfbd3 admin admin] PATH_INFO: `/v3/users/640f8472322b4e8cb62809b66ee70e70` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:00.345895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee510ef-aa45-4fb2-aac8-2e9e253cfbd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=640f8472322b4e8cb62809b66ee70e70)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:00.347860 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee510ef-aa45-4fb2-aac8-2e9e253cfbd3 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:00.537685 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-eee510ef-aa45-4fb2-aac8-2e9e253cfbd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '640f8472322b4e8cb62809b66ee70e70'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:00.550132 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-eee510ef-aa45-4fb2-aac8-2e9e253cfbd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '640f8472322b4e8cb62809b66ee70e70'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:00.551033 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-eee510ef-aa45-4fb2-aac8-2e9e253cfbd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '640f8472322b4e8cb62809b66ee70e70'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:00.558188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-eee510ef-aa45-4fb2-aac8-2e9e253cfbd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '640f8472322b4e8cb62809b66ee70e70'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:00.637259 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-eee510ef-aa45-4fb2-aac8-2e9e253cfbd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '640f8472322b4e8cb62809b66ee70e70'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:00.645021 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1304/2618] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:06:00 2022] DELETE /identity/v3/users/640f8472322b4e8cb62809b66ee70e70 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:01.073973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecdc4d-263e-4630-8016-a654f11df293 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:01.075486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ddecdc4d-263e-4630-8016-a654f11df293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:01.090772 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecdc4d-263e-4630-8016-a654f11df293 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:01.109858 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:01.149546 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e39df3-0e0b-4d63-ae47-3ee2b6aa4d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:01.150219 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e39df3-0e0b-4d63-ae47-3ee2b6aa4d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:01.152813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e39df3-0e0b-4d63-ae47-3ee2b6aa4d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:01.152813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e39df3-0e0b-4d63-ae47-3ee2b6aa4d6e admin admin] PATH_INFO: `/v3/projects/a2092ad447e14384a454e65283eea4d2` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:01.152813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e39df3-0e0b-4d63-ae47-3ee2b6aa4d6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2092ad447e14384a454e65283eea4d2)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:01.153774 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e39df3-0e0b-4d63-ae47-3ee2b6aa4d6e admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:01.243777 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-69e39df3-0e0b-4d63-ae47-3ee2b6aa4d6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2092ad447e14384a454e65283eea4d2', 'request_id': 'req-69e39df3-0e0b-4d63-ae47-3ee2b6aa4d6e'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:01.249095 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-69e39df3-0e0b-4d63-ae47-3ee2b6aa4d6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2092ad447e14384a454e65283eea4d2', 'request_id': 'req-69e39df3-0e0b-4d63-ae47-3ee2b6aa4d6e'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:01.334873 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-69e39df3-0e0b-4d63-ae47-3ee2b6aa4d6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2092ad447e14384a454e65283eea4d2', 'request_id': 'req-69e39df3-0e0b-4d63-ae47-3ee2b6aa4d6e'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:01.347456 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-69e39df3-0e0b-4d63-ae47-3ee2b6aa4d6e admin admin] The token cache is being invalidate because project a2092ad447e14384a454e65283eea4d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:06:01.347747 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-69e39df3-0e0b-4d63-ae47-3ee2b6aa4d6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:01.348385 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-69e39df3-0e0b-4d63-ae47-3ee2b6aa4d6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:01.350589 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1315/2619] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:06:01 2022] DELETE /identity/v3/projects/a2092ad447e14384a454e65283eea4d2 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:01.354435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee510ef-aa45-4fb2-aac8-2e9e253cfbd3 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:01.355971 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-eee510ef-aa45-4fb2-aac8-2e9e253cfbd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:01.369266 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee510ef-aa45-4fb2-aac8-2e9e253cfbd3 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:01.425003 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cff59-0dd5-43f7-a05f-7d47c252ef75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:01.425628 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cff59-0dd5-43f7-a05f-7d47c252ef75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:01.425907 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cff59-0dd5-43f7-a05f-7d47c252ef75 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:01.426220 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cff59-0dd5-43f7-a05f-7d47c252ef75 admin admin] PATH_INFO: `/v3/users/b51cb087f30646b7a679774964dbc80a` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:01.427345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650cff59-0dd5-43f7-a05f-7d47c252ef75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b51cb087f30646b7a679774964dbc80a)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:01.429918 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650cff59-0dd5-43f7-a05f-7d47c252ef75 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:01.600677 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-650cff59-0dd5-43f7-a05f-7d47c252ef75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b51cb087f30646b7a679774964dbc80a'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:01.613881 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-650cff59-0dd5-43f7-a05f-7d47c252ef75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b51cb087f30646b7a679774964dbc80a'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:01.614599 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-650cff59-0dd5-43f7-a05f-7d47c252ef75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b51cb087f30646b7a679774964dbc80a'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:01.619726 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:01.621813 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-650cff59-0dd5-43f7-a05f-7d47c252ef75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b51cb087f30646b7a679774964dbc80a'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:01.682544 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-650cff59-0dd5-43f7-a05f-7d47c252ef75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b51cb087f30646b7a679774964dbc80a'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:01.688942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1305/2620] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:06:01 2022] DELETE /identity/v3/users/b51cb087f30646b7a679774964dbc80a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:06:02.227091 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e39df3-0e0b-4d63-ae47-3ee2b6aa4d6e admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:02.228708 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-69e39df3-0e0b-4d63-ae47-3ee2b6aa4d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:02.241860 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e39df3-0e0b-4d63-ae47-3ee2b6aa4d6e admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:02.297966 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ebe74-e8b4-441e-b686-2877193f8eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:02.298645 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ebe74-e8b4-441e-b686-2877193f8eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:02.299048 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ebe74-e8b4-441e-b686-2877193f8eff admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:02.299383 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ebe74-e8b4-441e-b686-2877193f8eff admin admin] PATH_INFO: `/v3/projects/58f692a39ee14bb4934ba868652b8967` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:02.301162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0ebe74-e8b4-441e-b686-2877193f8eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=58f692a39ee14bb4934ba868652b8967)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:02.303639 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0ebe74-e8b4-441e-b686-2877193f8eff admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:02.421300 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-5b0ebe74-e8b4-441e-b686-2877193f8eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58f692a39ee14bb4934ba868652b8967', 'request_id': 'req-5b0ebe74-e8b4-441e-b686-2877193f8eff'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:02.423254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:02.427146 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-5b0ebe74-e8b4-441e-b686-2877193f8eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58f692a39ee14bb4934ba868652b8967', 'request_id': 'req-5b0ebe74-e8b4-441e-b686-2877193f8eff'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:02.521919 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-5b0ebe74-e8b4-441e-b686-2877193f8eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58f692a39ee14bb4934ba868652b8967', 'request_id': 'req-5b0ebe74-e8b4-441e-b686-2877193f8eff'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:02.535209 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-5b0ebe74-e8b4-441e-b686-2877193f8eff admin admin] The token cache is being invalidate because project 58f692a39ee14bb4934ba868652b8967 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:06:02.535502 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-5b0ebe74-e8b4-441e-b686-2877193f8eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:02.536155 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-5b0ebe74-e8b4-441e-b686-2877193f8eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:02.544363 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1316/2621] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:06:02 2022] DELETE /identity/v3/projects/58f692a39ee14bb4934ba868652b8967 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:06.606952 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cff59-0dd5-43f7-a05f-7d47c252ef75 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:06.608413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-650cff59-0dd5-43f7-a05f-7d47c252ef75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:06.621152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cff59-0dd5-43f7-a05f-7d47c252ef75 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:06.680383 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dada9f-ed81-4ec2-80b2-b5a76bb9b1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:06.681562 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dada9f-ed81-4ec2-80b2-b5a76bb9b1c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:06.681873 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dada9f-ed81-4ec2-80b2-b5a76bb9b1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:06.682181 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dada9f-ed81-4ec2-80b2-b5a76bb9b1c8 admin admin] PATH_INFO: `/v3/users/1abf9df1c4ec43aaaa3875393d530d83` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:06.683313 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dada9f-ed81-4ec2-80b2-b5a76bb9b1c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1abf9df1c4ec43aaaa3875393d530d83)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:06.685313 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dada9f-ed81-4ec2-80b2-b5a76bb9b1c8 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:06.879743 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-13dada9f-ed81-4ec2-80b2-b5a76bb9b1c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1abf9df1c4ec43aaaa3875393d530d83'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:06.892551 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-13dada9f-ed81-4ec2-80b2-b5a76bb9b1c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1abf9df1c4ec43aaaa3875393d530d83'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:06.893271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-13dada9f-ed81-4ec2-80b2-b5a76bb9b1c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1abf9df1c4ec43aaaa3875393d530d83'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:06.900543 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-13dada9f-ed81-4ec2-80b2-b5a76bb9b1c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1abf9df1c4ec43aaaa3875393d530d83'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:07.003578 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-13dada9f-ed81-4ec2-80b2-b5a76bb9b1c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1abf9df1c4ec43aaaa3875393d530d83'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:07.010696 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1306/2622] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:06:06 2022] DELETE /identity/v3/users/1abf9df1c4ec43aaaa3875393d530d83 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:07.015157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697e841-eff7-4214-9753-61a52127a681 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:07.015689 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697e841-eff7-4214-9753-61a52127a681 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:07.015689 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697e841-eff7-4214-9753-61a52127a681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:07.035311 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-f697e841-eff7-4214-9753-61a52127a681 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:07.036532 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-f697e841-eff7-4214-9753-61a52127a681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:07.095785 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1317/2623] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:07.105918 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dada9f-ed81-4ec2-80b2-b5a76bb9b1c8 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:07.107345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-13dada9f-ed81-4ec2-80b2-b5a76bb9b1c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:07.162899 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dada9f-ed81-4ec2-80b2-b5a76bb9b1c8 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:07.167030 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae3ed8-ec0c-4a7f-ae30-1b2410f72ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:07.167636 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae3ed8-ec0c-4a7f-ae30-1b2410f72ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:07.167913 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae3ed8-ec0c-4a7f-ae30-1b2410f72ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:07.168187 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae3ed8-ec0c-4a7f-ae30-1b2410f72ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:07.177216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae3ed8-ec0c-4a7f-ae30-1b2410f72ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:07.178661 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae3ed8-ec0c-4a7f-ae30-1b2410f72ee6 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:07.188988 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1307/2624] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:06:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:06:07.599058 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697e841-eff7-4214-9753-61a52127a681 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:07.600449 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-f697e841-eff7-4214-9753-61a52127a681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:07.613271 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697e841-eff7-4214-9753-61a52127a681 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:07.618061 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e24d2-99c0-4ae2-8c7a-3119ec3bc450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:07.618738 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e24d2-99c0-4ae2-8c7a-3119ec3bc450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:07.619027 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e24d2-99c0-4ae2-8c7a-3119ec3bc450 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:07.619288 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e24d2-99c0-4ae2-8c7a-3119ec3bc450 admin admin] PATH_INFO: `/v3/projects/a9a21523cb9c4bc9ac00eb744b6a1ed2` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:07.620460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e24d2-99c0-4ae2-8c7a-3119ec3bc450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a21523cb9c4bc9ac00eb744b6a1ed2)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:07.622478 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e24d2-99c0-4ae2-8c7a-3119ec3bc450 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:07.746917 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f77e24d2-99c0-4ae2-8c7a-3119ec3bc450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a21523cb9c4bc9ac00eb744b6a1ed2', 'request_id': 'req-f77e24d2-99c0-4ae2-8c7a-3119ec3bc450'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:07.754015 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f77e24d2-99c0-4ae2-8c7a-3119ec3bc450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a21523cb9c4bc9ac00eb744b6a1ed2', 'request_id': 'req-f77e24d2-99c0-4ae2-8c7a-3119ec3bc450'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:07.836130 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f77e24d2-99c0-4ae2-8c7a-3119ec3bc450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a21523cb9c4bc9ac00eb744b6a1ed2', 'request_id': 'req-f77e24d2-99c0-4ae2-8c7a-3119ec3bc450'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:07.850876 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f77e24d2-99c0-4ae2-8c7a-3119ec3bc450 admin admin] The token cache is being invalidate because project a9a21523cb9c4bc9ac00eb744b6a1ed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:06:07.851160 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f77e24d2-99c0-4ae2-8c7a-3119ec3bc450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:07.851796 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f77e24d2-99c0-4ae2-8c7a-3119ec3bc450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:07.853297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1318/2625] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:06:07 2022] DELETE /identity/v3/projects/a9a21523cb9c4bc9ac00eb744b6a1ed2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:07.858189 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cee641-e750-4a79-ba3f-a6fedc663239 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:07.858687 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cee641-e750-4a79-ba3f-a6fedc663239 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:07.858785 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cee641-e750-4a79-ba3f-a6fedc663239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:07.877549 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-00cee641-e750-4a79-ba3f-a6fedc663239 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:07.878787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-00cee641-e750-4a79-ba3f-a6fedc663239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:07.884890 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:07.937916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1308/2626] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:06:07.945872 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d01fc-11b3-496a-8ae4-2bd64af5716d None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:07.951684 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d01fc-11b3-496a-8ae4-2bd64af5716d None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:07.951684 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d01fc-11b3-496a-8ae4-2bd64af5716d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:07.966922 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-2a8d01fc-11b3-496a-8ae4-2bd64af5716d None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:07.968129 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-2a8d01fc-11b3-496a-8ae4-2bd64af5716d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:07.975968 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1319/2627] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:07.984379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cee641-e750-4a79-ba3f-a6fedc663239 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:07.989935 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cee641-e750-4a79-ba3f-a6fedc663239 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:07.994726 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8114fb-50cb-4fe0-aa98-94d9ca308ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:07.995342 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8114fb-50cb-4fe0-aa98-94d9ca308ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:07.995629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8114fb-50cb-4fe0-aa98-94d9ca308ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:07.995901 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8114fb-50cb-4fe0-aa98-94d9ca308ce0 admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:07.996538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8114fb-50cb-4fe0-aa98-94d9ca308ce0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:06:07.996835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8114fb-50cb-4fe0-aa98-94d9ca308ce0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:07.998458 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8114fb-50cb-4fe0-aa98-94d9ca308ce0 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:08.010659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1309/2628] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:06:08.015224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d01fc-11b3-496a-8ae4-2bd64af5716d None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:08.024449 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d01fc-11b3-496a-8ae4-2bd64af5716d None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:08.034721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68f0cb-b161-4ed7-b37e-d25ff80dddae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:08.035380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68f0cb-b161-4ed7-b37e-d25ff80dddae admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:08.035661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68f0cb-b161-4ed7-b37e-d25ff80dddae admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:08.035974 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68f0cb-b161-4ed7-b37e-d25ff80dddae admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:08.036567 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68f0cb-b161-4ed7-b37e-d25ff80dddae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:08.038533 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68f0cb-b161-4ed7-b37e-d25ff80dddae admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:08.143524 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1320/2629] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:06:08 2022] POST /identity/v3/projects => generated 391 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:06:08.147836 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8114fb-50cb-4fe0-aa98-94d9ca308ce0 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:08.160238 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8114fb-50cb-4fe0-aa98-94d9ca308ce0 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:08.218008 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab33e4-8018-4475-b2c2-c33e70ff361a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:08.218555 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab33e4-8018-4475-b2c2-c33e70ff361a admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:08.218825 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab33e4-8018-4475-b2c2-c33e70ff361a admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:08.219119 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab33e4-8018-4475-b2c2-c33e70ff361a admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:08.219826 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab33e4-8018-4475-b2c2-c33e70ff361a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:08.221715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab33e4-8018-4475-b2c2-c33e70ff361a admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:08.317422 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1310/2630] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:06:08 2022] POST /identity/v3/users => generated 296 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:06:08.321710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68f0cb-b161-4ed7-b37e-d25ff80dddae admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:08.332835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68f0cb-b161-4ed7-b37e-d25ff80dddae admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:08.337852 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cba28b-5aa1-4cfb-8047-d131c137021d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:08.338489 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cba28b-5aa1-4cfb-8047-d131c137021d admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:08.338872 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cba28b-5aa1-4cfb-8047-d131c137021d admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:08.339145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cba28b-5aa1-4cfb-8047-d131c137021d admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:08.339779 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cba28b-5aa1-4cfb-8047-d131c137021d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:08.341363 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cba28b-5aa1-4cfb-8047-d131c137021d admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:08.351521 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1321/2631] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:06:08.355380 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab33e4-8018-4475-b2c2-c33e70ff361a admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:08.365373 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab33e4-8018-4475-b2c2-c33e70ff361a admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:08.370662 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828920ee-bf6b-4746-936d-8587b93a24c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:08.371261 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828920ee-bf6b-4746-936d-8587b93a24c1 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:08.371564 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828920ee-bf6b-4746-936d-8587b93a24c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:08.371838 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828920ee-bf6b-4746-936d-8587b93a24c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:08.372477 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828920ee-bf6b-4746-936d-8587b93a24c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:08.374152 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828920ee-bf6b-4746-936d-8587b93a24c1 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:08.385615 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1311/2632] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:06:08.389707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cba28b-5aa1-4cfb-8047-d131c137021d admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:08.399700 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cba28b-5aa1-4cfb-8047-d131c137021d admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:08.404426 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4353dd4-7b0e-4258-be9d-32c8d69227a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:08.405092 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4353dd4-7b0e-4258-be9d-32c8d69227a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:08.408402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4353dd4-7b0e-4258-be9d-32c8d69227a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:08.408402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4353dd4-7b0e-4258-be9d-32c8d69227a6 admin admin] PATH_INFO: `/v3/projects/fd14587756314460a5cc349e5b32876f/users/15f5028f1b89421b971151e96802d551/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:08.420478 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4353dd4-7b0e-4258-be9d-32c8d69227a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd14587756314460a5cc349e5b32876f, user_id=15f5028f1b89421b971151e96802d551, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:08.423197 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4353dd4-7b0e-4258-be9d-32c8d69227a6 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:08.479098 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:08.483513 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1322/2633] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:06:08 2022] PUT /identity/v3/projects/fd14587756314460a5cc349e5b32876f/users/15f5028f1b89421b971151e96802d551/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:08.493827 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b5678-b5d5-4636-843d-f5f5f99964ee None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:08.494655 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b5678-b5d5-4636-843d-f5f5f99964ee None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:08.494930 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b5678-b5d5-4636-843d-f5f5f99964ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:08.522219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-f97b5678-b5d5-4636-843d-f5f5f99964ee None None] MFA Rules not processed for user `15f5028f1b89421b971151e96802d551`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:08.523414 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-f97b5678-b5d5-4636-843d-f5f5f99964ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:08.587395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1312/2634] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:08.598422 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4353dd4-7b0e-4258-be9d-32c8d69227a6 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:08.600155 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-c4353dd4-7b0e-4258-be9d-32c8d69227a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:08.657648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4353dd4-7b0e-4258-be9d-32c8d69227a6 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:08.661446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73121eb-456a-4a49-9e21-21d56f3854a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:08.662050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73121eb-456a-4a49-9e21-21d56f3854a5 service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:08.662358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73121eb-456a-4a49-9e21-21d56f3854a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:08.662621 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73121eb-456a-4a49-9e21-21d56f3854a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:08.672147 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73121eb-456a-4a49-9e21-21d56f3854a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:08.673557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73121eb-456a-4a49-9e21-21d56f3854a5 service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:08.682860 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1323/2635] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:06:08 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:06:13.808929 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b5678-b5d5-4636-843d-f5f5f99964ee None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:13.810395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-f97b5678-b5d5-4636-843d-f5f5f99964ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:13.820184 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:13.884637 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b5678-b5d5-4636-843d-f5f5f99964ee None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:13.889918 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d7704-9f25-4644-be46-6d3a257aeaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:13.890603 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d7704-9f25-4644-be46-6d3a257aeaf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:13.890878 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d7704-9f25-4644-be46-6d3a257aeaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:13.891172 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d7704-9f25-4644-be46-6d3a257aeaf4 admin admin] PATH_INFO: `/v3/users/083ff6902a8b461c94d9301c29ae3ca4` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:13.892303 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d7704-9f25-4644-be46-6d3a257aeaf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=083ff6902a8b461c94d9301c29ae3ca4)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:13.894594 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d7704-9f25-4644-be46-6d3a257aeaf4 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:14.245667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-477d7704-9f25-4644-be46-6d3a257aeaf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '083ff6902a8b461c94d9301c29ae3ca4'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:14.257660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-477d7704-9f25-4644-be46-6d3a257aeaf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '083ff6902a8b461c94d9301c29ae3ca4'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:14.258374 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-477d7704-9f25-4644-be46-6d3a257aeaf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '083ff6902a8b461c94d9301c29ae3ca4'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:14.265201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-477d7704-9f25-4644-be46-6d3a257aeaf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '083ff6902a8b461c94d9301c29ae3ca4'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:14.363391 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-477d7704-9f25-4644-be46-6d3a257aeaf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '083ff6902a8b461c94d9301c29ae3ca4'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:14.373299 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1313/2636] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:06:13 2022] DELETE /identity/v3/users/083ff6902a8b461c94d9301c29ae3ca4 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:14.374428 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e74b60-eff6-4e48-b7cd-aceb44655575 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:14.374842 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e74b60-eff6-4e48-b7cd-aceb44655575 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:14.374973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e74b60-eff6-4e48-b7cd-aceb44655575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:14.394984 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-e3e74b60-eff6-4e48-b7cd-aceb44655575 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:14.397624 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-e3e74b60-eff6-4e48-b7cd-aceb44655575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:14.459297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1324/2637] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:06:14.469535 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d7704-9f25-4644-be46-6d3a257aeaf4 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:14.470978 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-477d7704-9f25-4644-be46-6d3a257aeaf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:14.531348 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d7704-9f25-4644-be46-6d3a257aeaf4 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:14.534930 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b8d60-074e-4249-aa2b-842b09627605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:14.535532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b8d60-074e-4249-aa2b-842b09627605 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:14.535807 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b8d60-074e-4249-aa2b-842b09627605 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:14.536075 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b8d60-074e-4249-aa2b-842b09627605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:14.545665 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b8d60-074e-4249-aa2b-842b09627605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:14.547252 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b8d60-074e-4249-aa2b-842b09627605 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:14.557375 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1314/2638] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:06:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:06:15.057461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e74b60-eff6-4e48-b7cd-aceb44655575 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:15.059814 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-e3e74b60-eff6-4e48-b7cd-aceb44655575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:15.082328 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e74b60-eff6-4e48-b7cd-aceb44655575 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:15.091893 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad9e6d-8f35-43f2-abcf-d84d3c9b5c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:15.092524 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad9e6d-8f35-43f2-abcf-d84d3c9b5c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:15.092797 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad9e6d-8f35-43f2-abcf-d84d3c9b5c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:15.093315 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad9e6d-8f35-43f2-abcf-d84d3c9b5c42 admin admin] PATH_INFO: `/v3/projects/992c984c373548a3949762f1a7377f11` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:15.094398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad9e6d-8f35-43f2-abcf-d84d3c9b5c42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=992c984c373548a3949762f1a7377f11)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:15.096343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad9e6d-8f35-43f2-abcf-d84d3c9b5c42 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:15.219551 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-81ad9e6d-8f35-43f2-abcf-d84d3c9b5c42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '992c984c373548a3949762f1a7377f11', 'request_id': 'req-81ad9e6d-8f35-43f2-abcf-d84d3c9b5c42'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:15.226330 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-81ad9e6d-8f35-43f2-abcf-d84d3c9b5c42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '992c984c373548a3949762f1a7377f11', 'request_id': 'req-81ad9e6d-8f35-43f2-abcf-d84d3c9b5c42'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:15.306456 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-81ad9e6d-8f35-43f2-abcf-d84d3c9b5c42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '992c984c373548a3949762f1a7377f11', 'request_id': 'req-81ad9e6d-8f35-43f2-abcf-d84d3c9b5c42'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:15.320366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-81ad9e6d-8f35-43f2-abcf-d84d3c9b5c42 admin admin] The token cache is being invalidate because project 992c984c373548a3949762f1a7377f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:06:15.320657 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-81ad9e6d-8f35-43f2-abcf-d84d3c9b5c42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:15.325455 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-81ad9e6d-8f35-43f2-abcf-d84d3c9b5c42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:15.325455 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1325/2639] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:06:15 2022] DELETE /identity/v3/projects/992c984c373548a3949762f1a7377f11 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:15.329178 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffef669-2c07-4a0a-b800-f88bc1eaf664 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:15.329691 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffef669-2c07-4a0a-b800-f88bc1eaf664 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:15.329820 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffef669-2c07-4a0a-b800-f88bc1eaf664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:15.350998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-1ffef669-2c07-4a0a-b800-f88bc1eaf664 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:15.352211 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-1ffef669-2c07-4a0a-b800-f88bc1eaf664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:15.379142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:15.418706 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1315/2640] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:15.426563 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dd7b1-8c59-4b25-a8f3-b340ce4ebfc3 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:15.427056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dd7b1-8c59-4b25-a8f3-b340ce4ebfc3 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:15.427183 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dd7b1-8c59-4b25-a8f3-b340ce4ebfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:15.447334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-d25dd7b1-8c59-4b25-a8f3-b340ce4ebfc3 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:15.448573 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-d25dd7b1-8c59-4b25-a8f3-b340ce4ebfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:15.456994 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1326/2641] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:15.461186 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffef669-2c07-4a0a-b800-f88bc1eaf664 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:15.470778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffef669-2c07-4a0a-b800-f88bc1eaf664 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:15.475537 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702670d-15ba-473d-8b1f-62a42d01f4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:15.476133 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702670d-15ba-473d-8b1f-62a42d01f4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:15.476453 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702670d-15ba-473d-8b1f-62a42d01f4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:15.476673 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702670d-15ba-473d-8b1f-62a42d01f4b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:15.477340 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702670d-15ba-473d-8b1f-62a42d01f4b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:06:15.477639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702670d-15ba-473d-8b1f-62a42d01f4b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:15.479261 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702670d-15ba-473d-8b1f-62a42d01f4b0 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:15.491450 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1316/2642] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:06:15.496474 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dd7b1-8c59-4b25-a8f3-b340ce4ebfc3 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:15.508480 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dd7b1-8c59-4b25-a8f3-b340ce4ebfc3 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:15.514822 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff349cb-2db0-45b3-84ac-77a08ff455e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:15.515674 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff349cb-2db0-45b3-84ac-77a08ff455e7 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:15.515952 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff349cb-2db0-45b3-84ac-77a08ff455e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:15.516339 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff349cb-2db0-45b3-84ac-77a08ff455e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:15.517009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff349cb-2db0-45b3-84ac-77a08ff455e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:15.519261 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff349cb-2db0-45b3-84ac-77a08ff455e7 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:15.602449 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:15.609812 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1327/2643] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:06:15 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:06:15.614154 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702670d-15ba-473d-8b1f-62a42d01f4b0 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:15.624926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702670d-15ba-473d-8b1f-62a42d01f4b0 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:15.683923 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec6956-da53-4cf1-bd9d-0fdcbd45b6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:15.684529 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec6956-da53-4cf1-bd9d-0fdcbd45b6df admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:15.684807 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec6956-da53-4cf1-bd9d-0fdcbd45b6df admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:15.686727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec6956-da53-4cf1-bd9d-0fdcbd45b6df admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:15.686727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec6956-da53-4cf1-bd9d-0fdcbd45b6df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:15.687647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec6956-da53-4cf1-bd9d-0fdcbd45b6df admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:15.780782 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1317/2644] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:06:15 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:06:15.784879 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff349cb-2db0-45b3-84ac-77a08ff455e7 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:15.795960 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff349cb-2db0-45b3-84ac-77a08ff455e7 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:15.801605 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930a378-725e-40d9-8ec2-677ccbf34c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:15.802243 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930a378-725e-40d9-8ec2-677ccbf34c95 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:15.802523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930a378-725e-40d9-8ec2-677ccbf34c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:15.802795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930a378-725e-40d9-8ec2-677ccbf34c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:15.805485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930a378-725e-40d9-8ec2-677ccbf34c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:15.805485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930a378-725e-40d9-8ec2-677ccbf34c95 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:15.815250 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1328/2645] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:06:15.819222 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec6956-da53-4cf1-bd9d-0fdcbd45b6df admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:15.829108 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec6956-da53-4cf1-bd9d-0fdcbd45b6df admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:15.834131 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2458b-d181-4aaa-a227-fa9406db70db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:15.834805 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2458b-d181-4aaa-a227-fa9406db70db admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:15.835084 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2458b-d181-4aaa-a227-fa9406db70db admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:15.835357 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2458b-d181-4aaa-a227-fa9406db70db admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:15.835991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2458b-d181-4aaa-a227-fa9406db70db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:15.837621 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2458b-d181-4aaa-a227-fa9406db70db admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:15.848602 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1318/2646] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:06:15.852756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930a378-725e-40d9-8ec2-677ccbf34c95 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:15.863833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930a378-725e-40d9-8ec2-677ccbf34c95 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:15.874446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d34458-d070-4b08-8632-cf038e4e6dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:15.874446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d34458-d070-4b08-8632-cf038e4e6dec admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:15.874446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d34458-d070-4b08-8632-cf038e4e6dec admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:15.874446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d34458-d070-4b08-8632-cf038e4e6dec admin admin] PATH_INFO: `/v3/projects/ccf49b2264dc4371b650cde686966826/users/b42f3ffc158f47f69dda4c012e4d365c/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:15.887121 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d34458-d070-4b08-8632-cf038e4e6dec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf49b2264dc4371b650cde686966826, user_id=b42f3ffc158f47f69dda4c012e4d365c, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:15.889743 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d34458-d070-4b08-8632-cf038e4e6dec admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:15.990933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1329/2647] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:06:15 2022] PUT /identity/v3/projects/ccf49b2264dc4371b650cde686966826/users/b42f3ffc158f47f69dda4c012e4d365c/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:15.995916 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b54bc1-b00e-43b6-b92d-02278ea2ad33 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:15.996209 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b54bc1-b00e-43b6-b92d-02278ea2ad33 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:15.996498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b54bc1-b00e-43b6-b92d-02278ea2ad33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:16.015447 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-72b54bc1-b00e-43b6-b92d-02278ea2ad33 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:16.016641 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-72b54bc1-b00e-43b6-b92d-02278ea2ad33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:16.087892 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1319/2648] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:16.098411 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d34458-d070-4b08-8632-cf038e4e6dec admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:16.100143 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-54d34458-d070-4b08-8632-cf038e4e6dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:16.156393 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d34458-d070-4b08-8632-cf038e4e6dec admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:16.160031 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b69956-e542-4c08-8e61-3357027680fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:16.160627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b69956-e542-4c08-8e61-3357027680fb service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:16.160900 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b69956-e542-4c08-8e61-3357027680fb service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:16.161165 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b69956-e542-4c08-8e61-3357027680fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:16.170005 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b69956-e542-4c08-8e61-3357027680fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:16.171441 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b69956-e542-4c08-8e61-3357027680fb service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:16.180816 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1330/2649] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:06:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:06:17.445887 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdddc0e-249a-4741-9f1c-86c54d3585cf None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:17.446412 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdddc0e-249a-4741-9f1c-86c54d3585cf None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:17.446853 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdddc0e-249a-4741-9f1c-86c54d3585cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:17.477308 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-4cdddc0e-249a-4741-9f1c-86c54d3585cf None None] MFA Rules not processed for user `b42f3ffc158f47f69dda4c012e4d365c`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:17.478596 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-4cdddc0e-249a-4741-9f1c-86c54d3585cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:17.503944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:17.546876 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1320/2650] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:17.557480 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b69956-e542-4c08-8e61-3357027680fb service neutron] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:17.559482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-d8b69956-e542-4c08-8e61-3357027680fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:17.623302 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b69956-e542-4c08-8e61-3357027680fb service neutron] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:17.626928 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285587d-1a7d-4299-834f-91d5e3e25484 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:17.627624 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285587d-1a7d-4299-834f-91d5e3e25484 service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:17.627778 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285587d-1a7d-4299-834f-91d5e3e25484 service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:17.628044 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285587d-1a7d-4299-834f-91d5e3e25484 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:17.637756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285587d-1a7d-4299-834f-91d5e3e25484 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:17.639215 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285587d-1a7d-4299-834f-91d5e3e25484 service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:17.655618 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdddc0e-249a-4741-9f1c-86c54d3585cf None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:17.656035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1331/2651] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:06:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:06:17.657130 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-4cdddc0e-249a-4741-9f1c-86c54d3585cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:17.670610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdddc0e-249a-4741-9f1c-86c54d3585cf None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:17.674349 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e949f-9b00-4e26-90c1-1faf96f0168c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:17.675120 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e949f-9b00-4e26-90c1-1faf96f0168c service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:17.675578 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e949f-9b00-4e26-90c1-1faf96f0168c service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:17.675847 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e949f-9b00-4e26-90c1-1faf96f0168c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:17.677526 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-032e949f-9b00-4e26-90c1-1faf96f0168c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:17.689482 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e949f-9b00-4e26-90c1-1faf96f0168c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:17.690928 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e949f-9b00-4e26-90c1-1faf96f0168c service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:17.702053 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1321/2652] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:06:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:06:19.453312 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dffc9e-1b39-4e76-a548-5f6aa25940d4 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:19.454314 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dffc9e-1b39-4e76-a548-5f6aa25940d4 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:19.454763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dffc9e-1b39-4e76-a548-5f6aa25940d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:19.476208 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-89dffc9e-1b39-4e76-a548-5f6aa25940d4 None None] MFA Rules not processed for user `b42f3ffc158f47f69dda4c012e4d365c`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:19.477564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-89dffc9e-1b39-4e76-a548-5f6aa25940d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:19.487069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1332/2653] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:20.207254 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e949f-9b00-4e26-90c1-1faf96f0168c service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:20.208688 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-032e949f-9b00-4e26-90c1-1faf96f0168c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:20.222538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e949f-9b00-4e26-90c1-1faf96f0168c service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:20.228828 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f9628-16c8-4631-9501-e017215e3e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:20.229556 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f9628-16c8-4631-9501-e017215e3e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:20.230511 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f9628-16c8-4631-9501-e017215e3e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:20.231510 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f9628-16c8-4631-9501-e017215e3e72 admin admin] PATH_INFO: `/v3/users/15f5028f1b89421b971151e96802d551` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:20.232792 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f9628-16c8-4631-9501-e017215e3e72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15f5028f1b89421b971151e96802d551)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:20.235345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f9628-16c8-4631-9501-e017215e3e72 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:20.434011 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-dc2f9628-16c8-4631-9501-e017215e3e72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15f5028f1b89421b971151e96802d551'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:20.446945 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-dc2f9628-16c8-4631-9501-e017215e3e72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15f5028f1b89421b971151e96802d551'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:20.453028 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-dc2f9628-16c8-4631-9501-e017215e3e72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15f5028f1b89421b971151e96802d551'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:20.461125 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-dc2f9628-16c8-4631-9501-e017215e3e72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15f5028f1b89421b971151e96802d551'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:20.568106 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-dc2f9628-16c8-4631-9501-e017215e3e72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15f5028f1b89421b971151e96802d551'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:20.583412 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1322/2654] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:06:20 2022] DELETE /identity/v3/users/15f5028f1b89421b971151e96802d551 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:20.588272 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584e888-98d0-423c-9021-e46e354d525b None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:20.588787 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584e888-98d0-423c-9021-e46e354d525b None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:20.588932 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584e888-98d0-423c-9021-e46e354d525b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:20.609909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-0584e888-98d0-423c-9021-e46e354d525b None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:20.611141 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-0584e888-98d0-423c-9021-e46e354d525b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:20.675756 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1333/2655] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:06:20.682435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f9628-16c8-4631-9501-e017215e3e72 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:20.684421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-dc2f9628-16c8-4631-9501-e017215e3e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:20.789624 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f9628-16c8-4631-9501-e017215e3e72 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:20.794875 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b03f9-b9b0-4c3a-a0b0-31e9943b6c1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:20.798054 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b03f9-b9b0-4c3a-a0b0-31e9943b6c1c service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:20.798054 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b03f9-b9b0-4c3a-a0b0-31e9943b6c1c service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:20.798054 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b03f9-b9b0-4c3a-a0b0-31e9943b6c1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:20.806751 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b03f9-b9b0-4c3a-a0b0-31e9943b6c1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:20.808864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b03f9-b9b0-4c3a-a0b0-31e9943b6c1c service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:20.820686 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1323/2656] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:06:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:06:21.408546 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584e888-98d0-423c-9021-e46e354d525b None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:21.414638 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-0584e888-98d0-423c-9021-e46e354d525b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:21.418013 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:21.425539 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584e888-98d0-423c-9021-e46e354d525b None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:21.431619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c15bb-e62a-417f-a6b4-9c9bc327491a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:21.432489 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c15bb-e62a-417f-a6b4-9c9bc327491a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:21.432824 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c15bb-e62a-417f-a6b4-9c9bc327491a admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:21.433105 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c15bb-e62a-417f-a6b4-9c9bc327491a admin admin] PATH_INFO: `/v3/projects/fd14587756314460a5cc349e5b32876f` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:21.434561 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c15bb-e62a-417f-a6b4-9c9bc327491a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd14587756314460a5cc349e5b32876f)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:21.436579 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c15bb-e62a-417f-a6b4-9c9bc327491a admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:21.449912 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b03f9-b9b0-4c3a-a0b0-31e9943b6c1c service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:21.451870 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-674b03f9-b9b0-4c3a-a0b0-31e9943b6c1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:21.485301 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:21.525304 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b03f9-b9b0-4c3a-a0b0-31e9943b6c1c service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:21.531419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b9191-bae9-4df2-983b-5f4b3857a520 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0061ce46df224f4491599ed10548b2ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:21.532101 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b9191-bae9-4df2-983b-5f4b3857a520 service placement] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:21.532382 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b9191-bae9-4df2-983b-5f4b3857a520 service placement] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:21.532651 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b9191-bae9-4df2-983b-5f4b3857a520 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:21.534419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-403b9191-bae9-4df2-983b-5f4b3857a520 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:21.547171 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b9191-bae9-4df2-983b-5f4b3857a520 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:21.548780 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b9191-bae9-4df2-983b-5f4b3857a520 service placement] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:21.559272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1324/2657] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:06:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:06:21.593272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b9191-bae9-4df2-983b-5f4b3857a520 service placement] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:21.594791 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-403b9191-bae9-4df2-983b-5f4b3857a520 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:21.599316 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-bc0c15bb-e62a-417f-a6b4-9c9bc327491a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd14587756314460a5cc349e5b32876f', 'request_id': 'req-bc0c15bb-e62a-417f-a6b4-9c9bc327491a'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:21.612415 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-bc0c15bb-e62a-417f-a6b4-9c9bc327491a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd14587756314460a5cc349e5b32876f', 'request_id': 'req-bc0c15bb-e62a-417f-a6b4-9c9bc327491a'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:21.614174 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b9191-bae9-4df2-983b-5f4b3857a520 service placement] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:21.675395 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e354a-4949-4e75-9134-3c76a47d4403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:21.676089 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e354a-4949-4e75-9134-3c76a47d4403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:21.676508 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e354a-4949-4e75-9134-3c76a47d4403 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:21.676781 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e354a-4949-4e75-9134-3c76a47d4403 admin admin] PATH_INFO: `/v3/users/06ed3b08376e460087fafc4fccfdd2a9` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:21.677978 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e354a-4949-4e75-9134-3c76a47d4403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06ed3b08376e460087fafc4fccfdd2a9)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:21.680077 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e354a-4949-4e75-9134-3c76a47d4403 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:21.716562 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-bc0c15bb-e62a-417f-a6b4-9c9bc327491a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd14587756314460a5cc349e5b32876f', 'request_id': 'req-bc0c15bb-e62a-417f-a6b4-9c9bc327491a'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:21.730650 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-bc0c15bb-e62a-417f-a6b4-9c9bc327491a admin admin] The token cache is being invalidate because project fd14587756314460a5cc349e5b32876f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:06:21.730939 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-bc0c15bb-e62a-417f-a6b4-9c9bc327491a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:21.731612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-bc0c15bb-e62a-417f-a6b4-9c9bc327491a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:21.733087 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1334/2658] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:06:21 2022] DELETE /identity/v3/projects/fd14587756314460a5cc349e5b32876f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:21.737937 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26969a90-30b1-4e23-b261-732ebb7ab865 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:21.738435 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26969a90-30b1-4e23-b261-732ebb7ab865 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:21.738774 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26969a90-30b1-4e23-b261-732ebb7ab865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:21.760493 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-26969a90-30b1-4e23-b261-732ebb7ab865 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:21.762481 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-26969a90-30b1-4e23-b261-732ebb7ab865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:21.771343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1335/2659] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:06:21.779945 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887c2a7-d11f-4e54-b322-bb0e2e5d864a None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:21.780161 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887c2a7-d11f-4e54-b322-bb0e2e5d864a None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:21.780439 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887c2a7-d11f-4e54-b322-bb0e2e5d864a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:21.804487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-8887c2a7-d11f-4e54-b322-bb0e2e5d864a None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:21.806186 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-8887c2a7-d11f-4e54-b322-bb0e2e5d864a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:21.816396 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1336/2660] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:06:21.821218 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887c2a7-d11f-4e54-b322-bb0e2e5d864a None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:21.834948 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887c2a7-d11f-4e54-b322-bb0e2e5d864a None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:21.842307 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d8c8f-9493-4c0f-a567-af099f66040a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:21.843052 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d8c8f-9493-4c0f-a567-af099f66040a admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:21.843458 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d8c8f-9493-4c0f-a567-af099f66040a admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:21.843760 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d8c8f-9493-4c0f-a567-af099f66040a admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:21.844507 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d8c8f-9493-4c0f-a567-af099f66040a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:06:21.844851 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d8c8f-9493-4c0f-a567-af099f66040a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:21.846982 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d8c8f-9493-4c0f-a567-af099f66040a admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:21.865161 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1337/2661] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:06:21.905246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d8c8f-9493-4c0f-a567-af099f66040a admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:21.916662 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d8c8f-9493-4c0f-a567-af099f66040a admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:21.921566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02d610-4d1d-4d0f-90df-3b4a334dc4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:21.922219 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02d610-4d1d-4d0f-90df-3b4a334dc4f9 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:21.922501 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02d610-4d1d-4d0f-90df-3b4a334dc4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:21.922774 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02d610-4d1d-4d0f-90df-3b4a334dc4f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:21.923391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02d610-4d1d-4d0f-90df-3b4a334dc4f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:21.925327 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02d610-4d1d-4d0f-90df-3b4a334dc4f9 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:22.095679 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-244e354a-4949-4e75-9134-3c76a47d4403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06ed3b08376e460087fafc4fccfdd2a9'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:22.100249 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1338/2662] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:06:21 2022] POST /identity/v3/projects => generated 397 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:06:22.101186 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02d610-4d1d-4d0f-90df-3b4a334dc4f9 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:22.109640 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-244e354a-4949-4e75-9134-3c76a47d4403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06ed3b08376e460087fafc4fccfdd2a9'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:22.110370 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-244e354a-4949-4e75-9134-3c76a47d4403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06ed3b08376e460087fafc4fccfdd2a9'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:22.117457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-244e354a-4949-4e75-9134-3c76a47d4403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06ed3b08376e460087fafc4fccfdd2a9'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:22.164949 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02d610-4d1d-4d0f-90df-3b4a334dc4f9 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:22.170424 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89561a-cd37-475c-a669-8ba5652b7431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:22.171059 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89561a-cd37-475c-a669-8ba5652b7431 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:22.171332 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89561a-cd37-475c-a669-8ba5652b7431 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:22.171628 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89561a-cd37-475c-a669-8ba5652b7431 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:22.172242 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89561a-cd37-475c-a669-8ba5652b7431 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:22.174213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89561a-cd37-475c-a669-8ba5652b7431 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:22.179198 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-244e354a-4949-4e75-9134-3c76a47d4403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06ed3b08376e460087fafc4fccfdd2a9'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:22.186322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1325/2663] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:06:21 2022] DELETE /identity/v3/users/06ed3b08376e460087fafc4fccfdd2a9 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:06:22.317459 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1339/2664] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:06:22 2022] POST /identity/v3/users => generated 299 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:06:22.321658 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e354a-4949-4e75-9134-3c76a47d4403 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:22.323100 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-244e354a-4949-4e75-9134-3c76a47d4403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:22.364342 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:22.388803 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e354a-4949-4e75-9134-3c76a47d4403 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:22.393467 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a2555-7c6b-4513-936b-d50d15e10bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:22.394071 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a2555-7c6b-4513-936b-d50d15e10bfd admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:22.394406 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a2555-7c6b-4513-936b-d50d15e10bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:22.394675 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a2555-7c6b-4513-936b-d50d15e10bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:22.395390 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a2555-7c6b-4513-936b-d50d15e10bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:22.396965 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a2555-7c6b-4513-936b-d50d15e10bfd admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:22.408874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1326/2665] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:06:22.413101 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89561a-cd37-475c-a669-8ba5652b7431 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:22.424844 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89561a-cd37-475c-a669-8ba5652b7431 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:22.430125 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581f672-c145-4434-905c-ddf83782d84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:22.430326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581f672-c145-4434-905c-ddf83782d84f admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:22.430572 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581f672-c145-4434-905c-ddf83782d84f admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:22.430841 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581f672-c145-4434-905c-ddf83782d84f admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:22.431481 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581f672-c145-4434-905c-ddf83782d84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:22.433081 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581f672-c145-4434-905c-ddf83782d84f admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:22.444782 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1340/2666] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:06:22.447825 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a2555-7c6b-4513-936b-d50d15e10bfd admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:22.458135 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581f672-c145-4434-905c-ddf83782d84f admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:22.463288 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-d581f672-c145-4434-905c-ddf83782d84f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:22.463442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a2555-7c6b-4513-936b-d50d15e10bfd admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:22.478271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181bd9e4-29a8-499e-ae04-8f4e4e5e291a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:22.479241 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bd9e4-29a8-499e-ae04-8f4e4e5e291a admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:22.481334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bd9e4-29a8-499e-ae04-8f4e4e5e291a admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:22.481788 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bd9e4-29a8-499e-ae04-8f4e4e5e291a admin admin] PATH_INFO: `/v3/projects/04fdd8d0be514085aa3a4cf93e9f7f4f/users/06f75e2917124b59bc0dcce7529dd2db/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:22.503381 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581f672-c145-4434-905c-ddf83782d84f admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:22.503381 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0b693-9a9d-4199-bff2-834b067fdee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:22.503381 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0b693-9a9d-4199-bff2-834b067fdee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:22.505358 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181bd9e4-29a8-499e-ae04-8f4e4e5e291a admin admin] RBAC: Authorizing `identity:create_grant(project_id=04fdd8d0be514085aa3a4cf93e9f7f4f, user_id=06f75e2917124b59bc0dcce7529dd2db, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:22.506428 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0b693-9a9d-4199-bff2-834b067fdee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:22.506725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0b693-9a9d-4199-bff2-834b067fdee5 admin admin] PATH_INFO: `/v3/projects/8bf23dfb10574079833d8defa2e10ed2` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:22.508015 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0b693-9a9d-4199-bff2-834b067fdee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf23dfb10574079833d8defa2e10ed2)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:22.510190 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181bd9e4-29a8-499e-ae04-8f4e4e5e291a admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:22.510341 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0b693-9a9d-4199-bff2-834b067fdee5 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:22.524031 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:22.586886 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1327/2667] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:06:22 2022] PUT /identity/v3/projects/04fdd8d0be514085aa3a4cf93e9f7f4f/users/06f75e2917124b59bc0dcce7529dd2db/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:22.597439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9f8aa-c6ed-4bd4-a05e-8dfb7ac746f7 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:22.597724 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9f8aa-c6ed-4bd4-a05e-8dfb7ac746f7 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:22.597993 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9f8aa-c6ed-4bd4-a05e-8dfb7ac746f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:22.629769 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-32e0b693-9a9d-4199-bff2-834b067fdee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf23dfb10574079833d8defa2e10ed2', 'request_id': 'req-32e0b693-9a9d-4199-bff2-834b067fdee5'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:22.632872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-c3f9f8aa-c6ed-4bd4-a05e-8dfb7ac746f7 None None] MFA Rules not processed for user `06f75e2917124b59bc0dcce7529dd2db`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:22.634201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-c3f9f8aa-c6ed-4bd4-a05e-8dfb7ac746f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:22.637187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-32e0b693-9a9d-4199-bff2-834b067fdee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf23dfb10574079833d8defa2e10ed2', 'request_id': 'req-32e0b693-9a9d-4199-bff2-834b067fdee5'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:22.699711 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-32e0b693-9a9d-4199-bff2-834b067fdee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf23dfb10574079833d8defa2e10ed2', 'request_id': 'req-32e0b693-9a9d-4199-bff2-834b067fdee5'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:22.701577 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1328/2668] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:22 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:06:22.713183 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9f8aa-c6ed-4bd4-a05e-8dfb7ac746f7 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:22.715224 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-c3f9f8aa-c6ed-4bd4-a05e-8dfb7ac746f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:22.715349 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-32e0b693-9a9d-4199-bff2-834b067fdee5 admin admin] The token cache is being invalidate because project 8bf23dfb10574079833d8defa2e10ed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:06:22.715564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-32e0b693-9a9d-4199-bff2-834b067fdee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:22.716222 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-32e0b693-9a9d-4199-bff2-834b067fdee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:22.717684 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1341/2669] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:06:22 2022] DELETE /identity/v3/projects/8bf23dfb10574079833d8defa2e10ed2 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:22.722405 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee3769-b24e-4c63-8c10-00610989c29f None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:22.726577 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee3769-b24e-4c63-8c10-00610989c29f None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:22.726577 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee3769-b24e-4c63-8c10-00610989c29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:22.743628 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-c9ee3769-b24e-4c63-8c10-00610989c29f None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:22.744996 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-c9ee3769-b24e-4c63-8c10-00610989c29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:22.788825 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9f8aa-c6ed-4bd4-a05e-8dfb7ac746f7 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:22.792990 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a818f-49ab-486c-b85c-bb7d96bc4116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:22.793599 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a818f-49ab-486c-b85c-bb7d96bc4116 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:22.794103 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a818f-49ab-486c-b85c-bb7d96bc4116 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:22.794374 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a818f-49ab-486c-b85c-bb7d96bc4116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:22.796303 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-a41a818f-49ab-486c-b85c-bb7d96bc4116 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:22.808790 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a818f-49ab-486c-b85c-bb7d96bc4116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:22.810359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a818f-49ab-486c-b85c-bb7d96bc4116 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:22.816090 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1342/2670] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:22.821965 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1329/2671] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:06:22 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:06:22.825007 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a963e2-8cce-479a-9004-b3af9d730c68 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:22.825545 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a963e2-8cce-479a-9004-b3af9d730c68 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:22.825998 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a963e2-8cce-479a-9004-b3af9d730c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:22.848290 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-40a963e2-8cce-479a-9004-b3af9d730c68 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:22.851740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-40a963e2-8cce-479a-9004-b3af9d730c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:22.864298 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1343/2672] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:06:22.865502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a818f-49ab-486c-b85c-bb7d96bc4116 service cinder] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:22.885918 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a818f-49ab-486c-b85c-bb7d96bc4116 service cinder] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:22.886770 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b7244-99c8-41ca-869d-3f277ad0cb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:22.887358 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b7244-99c8-41ca-869d-3f277ad0cb60 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:22.887671 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b7244-99c8-41ca-869d-3f277ad0cb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:22.887944 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b7244-99c8-41ca-869d-3f277ad0cb60 admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:22.888634 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b7244-99c8-41ca-869d-3f277ad0cb60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:06:22.888932 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b7244-99c8-41ca-869d-3f277ad0cb60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:22.890565 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b7244-99c8-41ca-869d-3f277ad0cb60 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:22.902843 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1330/2673] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:06:22.907244 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a963e2-8cce-479a-9004-b3af9d730c68 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:22.917766 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a963e2-8cce-479a-9004-b3af9d730c68 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:22.924083 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc9c79-6637-4d3f-bbe4-e0cdcfa49edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:22.924701 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc9c79-6637-4d3f-bbe4-e0cdcfa49edf admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:22.924980 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc9c79-6637-4d3f-bbe4-e0cdcfa49edf admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:22.925252 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc9c79-6637-4d3f-bbe4-e0cdcfa49edf admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:22.925891 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc9c79-6637-4d3f-bbe4-e0cdcfa49edf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:22.927988 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc9c79-6637-4d3f-bbe4-e0cdcfa49edf admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:23.058415 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1344/2674] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:06:22 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:06:23.062457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b7244-99c8-41ca-869d-3f277ad0cb60 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:23.072486 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b7244-99c8-41ca-869d-3f277ad0cb60 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:23.099855 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:23.138647 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ce513-6861-4386-99fa-a50d11b55492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:23.139424 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ce513-6861-4386-99fa-a50d11b55492 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:23.139732 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ce513-6861-4386-99fa-a50d11b55492 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:23.140108 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ce513-6861-4386-99fa-a50d11b55492 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:23.140757 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ce513-6861-4386-99fa-a50d11b55492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:23.142711 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ce513-6861-4386-99fa-a50d11b55492 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:23.254984 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1331/2675] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:06:23 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:06:23.258883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc9c79-6637-4d3f-bbe4-e0cdcfa49edf admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:23.269836 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc9c79-6637-4d3f-bbe4-e0cdcfa49edf admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:23.275638 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055494b-cd71-42ea-bb6d-4460f4a3946d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:23.284162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055494b-cd71-42ea-bb6d-4460f4a3946d admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:23.289523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055494b-cd71-42ea-bb6d-4460f4a3946d admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:23.289523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055494b-cd71-42ea-bb6d-4460f4a3946d admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:23.289523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055494b-cd71-42ea-bb6d-4460f4a3946d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:23.289523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055494b-cd71-42ea-bb6d-4460f4a3946d admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:23.302198 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1345/2676] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:06:23.306553 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ce513-6861-4386-99fa-a50d11b55492 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:23.318785 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ce513-6861-4386-99fa-a50d11b55492 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:23.324261 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d164eb-3d31-4ff2-8ff7-eee71c110c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:23.324876 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d164eb-3d31-4ff2-8ff7-eee71c110c0f admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:23.325177 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d164eb-3d31-4ff2-8ff7-eee71c110c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:23.325451 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d164eb-3d31-4ff2-8ff7-eee71c110c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:23.326113 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d164eb-3d31-4ff2-8ff7-eee71c110c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:23.327840 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d164eb-3d31-4ff2-8ff7-eee71c110c0f admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:23.341381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1332/2677] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:06:23.343715 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055494b-cd71-42ea-bb6d-4460f4a3946d admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:23.352813 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055494b-cd71-42ea-bb6d-4460f4a3946d admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:23.357520 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a49d4-5319-4ec1-8ffa-68644a7d791e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:23.358193 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a49d4-5319-4ec1-8ffa-68644a7d791e admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:23.358461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a49d4-5319-4ec1-8ffa-68644a7d791e admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:23.358726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a49d4-5319-4ec1-8ffa-68644a7d791e admin admin] PATH_INFO: `/v3/projects/8b47d62f20c843aeb01d2513855754a3/users/099c10e411474350a7aaca338967ecc4/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:23.374160 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a49d4-5319-4ec1-8ffa-68644a7d791e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b47d62f20c843aeb01d2513855754a3, user_id=099c10e411474350a7aaca338967ecc4, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:23.376984 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a49d4-5319-4ec1-8ffa-68644a7d791e admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:23.471348 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1346/2678] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:06:23 2022] PUT /identity/v3/projects/8b47d62f20c843aeb01d2513855754a3/users/099c10e411474350a7aaca338967ecc4/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:06:23.482301 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0c11b-8882-4beb-b426-875c45297e5c None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:23.482787 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0c11b-8882-4beb-b426-875c45297e5c None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:23.482895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0c11b-8882-4beb-b426-875c45297e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:23.511868 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-70d0c11b-8882-4beb-b426-875c45297e5c None None] MFA Rules not processed for user `099c10e411474350a7aaca338967ecc4`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:23.516093 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-70d0c11b-8882-4beb-b426-875c45297e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:23.597825 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1333/2679] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:23.604209 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a49d4-5319-4ec1-8ffa-68644a7d791e admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:23.608112 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-0c9a49d4-5319-4ec1-8ffa-68644a7d791e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:23.671372 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:23.713593 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a49d4-5319-4ec1-8ffa-68644a7d791e admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:23.716563 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762fb4f-8d67-4377-af0b-0cd844444d42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:23.717371 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762fb4f-8d67-4377-af0b-0cd844444d42 service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:23.717837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762fb4f-8d67-4377-af0b-0cd844444d42 service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:23.718374 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762fb4f-8d67-4377-af0b-0cd844444d42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:23.727964 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762fb4f-8d67-4377-af0b-0cd844444d42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:23.731167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762fb4f-8d67-4377-af0b-0cd844444d42 service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:23.742106 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1347/2680] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:06:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:06:28.918762 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0c11b-8882-4beb-b426-875c45297e5c None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:28.922914 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-70d0c11b-8882-4beb-b426-875c45297e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:28.990637 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0c11b-8882-4beb-b426-875c45297e5c None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:28.995231 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c64554-1bcf-4381-bae1-f05d7267aa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:28.995891 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c64554-1bcf-4381-bae1-f05d7267aa05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:28.996164 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c64554-1bcf-4381-bae1-f05d7267aa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:28.996434 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c64554-1bcf-4381-bae1-f05d7267aa05 admin admin] PATH_INFO: `/v3/users/06f75e2917124b59bc0dcce7529dd2db` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:28.997756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c64554-1bcf-4381-bae1-f05d7267aa05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06f75e2917124b59bc0dcce7529dd2db)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:29.000196 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c64554-1bcf-4381-bae1-f05d7267aa05 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:29.153079 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:29.161973 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-94c64554-1bcf-4381-bae1-f05d7267aa05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06f75e2917124b59bc0dcce7529dd2db'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:29.174688 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-94c64554-1bcf-4381-bae1-f05d7267aa05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06f75e2917124b59bc0dcce7529dd2db'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:29.175553 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-94c64554-1bcf-4381-bae1-f05d7267aa05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06f75e2917124b59bc0dcce7529dd2db'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:29.182609 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-94c64554-1bcf-4381-bae1-f05d7267aa05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06f75e2917124b59bc0dcce7529dd2db'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:29.238281 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-94c64554-1bcf-4381-bae1-f05d7267aa05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06f75e2917124b59bc0dcce7529dd2db'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:29.245026 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1334/2681] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:06:28 2022] DELETE /identity/v3/users/06f75e2917124b59bc0dcce7529dd2db => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:29.250430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc611b43-4e57-4a0c-bd97-015c9669af49 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:29.250430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc611b43-4e57-4a0c-bd97-015c9669af49 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:29.250430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc611b43-4e57-4a0c-bd97-015c9669af49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:29.268968 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-dc611b43-4e57-4a0c-bd97-015c9669af49 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:29.270213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-dc611b43-4e57-4a0c-bd97-015c9669af49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:29.330071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1348/2682] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:29.340942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c64554-1bcf-4381-bae1-f05d7267aa05 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:29.345932 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-94c64554-1bcf-4381-bae1-f05d7267aa05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:29.401141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c64554-1bcf-4381-bae1-f05d7267aa05 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:29.405552 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275623ac-9644-4f1e-8fce-a509b35d619e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:29.406246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275623ac-9644-4f1e-8fce-a509b35d619e service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:29.406535 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275623ac-9644-4f1e-8fce-a509b35d619e service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:29.406801 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275623ac-9644-4f1e-8fce-a509b35d619e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:29.415919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275623ac-9644-4f1e-8fce-a509b35d619e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:29.417962 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275623ac-9644-4f1e-8fce-a509b35d619e service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:29.427513 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1335/2683] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:06:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:06:29.886468 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc611b43-4e57-4a0c-bd97-015c9669af49 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:29.888438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-dc611b43-4e57-4a0c-bd97-015c9669af49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:29.908421 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc611b43-4e57-4a0c-bd97-015c9669af49 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:29.915074 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8dc93-b687-40e5-85ca-77852b540b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:29.915724 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8dc93-b687-40e5-85ca-77852b540b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:29.916058 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8dc93-b687-40e5-85ca-77852b540b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:29.916339 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8dc93-b687-40e5-85ca-77852b540b2d admin admin] PATH_INFO: `/v3/projects/04fdd8d0be514085aa3a4cf93e9f7f4f` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:29.918336 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8dc93-b687-40e5-85ca-77852b540b2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=04fdd8d0be514085aa3a4cf93e9f7f4f)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:29.920488 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8dc93-b687-40e5-85ca-77852b540b2d admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:30.164697 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-46b8dc93-b687-40e5-85ca-77852b540b2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04fdd8d0be514085aa3a4cf93e9f7f4f', 'request_id': 'req-46b8dc93-b687-40e5-85ca-77852b540b2d'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:30.171119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-46b8dc93-b687-40e5-85ca-77852b540b2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04fdd8d0be514085aa3a4cf93e9f7f4f', 'request_id': 'req-46b8dc93-b687-40e5-85ca-77852b540b2d'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:30.205357 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275623ac-9644-4f1e-8fce-a509b35d619e service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:30.205357 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-275623ac-9644-4f1e-8fce-a509b35d619e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:30.220073 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275623ac-9644-4f1e-8fce-a509b35d619e service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:30.250071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-46b8dc93-b687-40e5-85ca-77852b540b2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04fdd8d0be514085aa3a4cf93e9f7f4f', 'request_id': 'req-46b8dc93-b687-40e5-85ca-77852b540b2d'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:30.264659 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-46b8dc93-b687-40e5-85ca-77852b540b2d admin admin] The token cache is being invalidate because project 04fdd8d0be514085aa3a4cf93e9f7f4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:06:30.265302 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-46b8dc93-b687-40e5-85ca-77852b540b2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:30.265609 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-46b8dc93-b687-40e5-85ca-77852b540b2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:30.267789 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1349/2684] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:06:29 2022] DELETE /identity/v3/projects/04fdd8d0be514085aa3a4cf93e9f7f4f => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:30.273391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a06f9-4615-4039-bf80-de5bd8645111 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:30.274246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a06f9-4615-4039-bf80-de5bd8645111 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:30.274528 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a06f9-4615-4039-bf80-de5bd8645111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:30.291828 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb8c48-709f-4028-9e72-adb57451387c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:30.296054 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb8c48-709f-4028-9e72-adb57451387c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:30.296054 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb8c48-709f-4028-9e72-adb57451387c admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:30.296054 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb8c48-709f-4028-9e72-adb57451387c admin admin] PATH_INFO: `/v3/users/099c10e411474350a7aaca338967ecc4` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:30.296054 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb8c48-709f-4028-9e72-adb57451387c admin admin] RBAC: Authorizing `identity:delete_user(user_id=099c10e411474350a7aaca338967ecc4)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:30.296500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb8c48-709f-4028-9e72-adb57451387c admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:30.298832 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-c05a06f9-4615-4039-bf80-de5bd8645111 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:30.300875 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-c05a06f9-4615-4039-bf80-de5bd8645111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:30.310266 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1350/2685] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:06:30.319121 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08bcd6-a97e-48f7-85d5-5053e8c52933 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:30.319402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08bcd6-a97e-48f7-85d5-5053e8c52933 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:30.319677 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08bcd6-a97e-48f7-85d5-5053e8c52933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:30.341351 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-6c08bcd6-a97e-48f7-85d5-5053e8c52933 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:30.342602 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-6c08bcd6-a97e-48f7-85d5-5053e8c52933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:30.350844 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1351/2686] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:06:30.355442 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08bcd6-a97e-48f7-85d5-5053e8c52933 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:30.365217 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08bcd6-a97e-48f7-85d5-5053e8c52933 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:30.369958 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21255c7-c12f-44c2-a78a-fa11a5a0bcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:30.370631 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21255c7-c12f-44c2-a78a-fa11a5a0bcaa admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:30.370906 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21255c7-c12f-44c2-a78a-fa11a5a0bcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:30.371174 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21255c7-c12f-44c2-a78a-fa11a5a0bcaa admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:30.371815 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21255c7-c12f-44c2-a78a-fa11a5a0bcaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:06:30.372117 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21255c7-c12f-44c2-a78a-fa11a5a0bcaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:30.373695 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21255c7-c12f-44c2-a78a-fa11a5a0bcaa admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:30.388570 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1352/2687] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:06:30.392754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21255c7-c12f-44c2-a78a-fa11a5a0bcaa admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:30.406032 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21255c7-c12f-44c2-a78a-fa11a5a0bcaa admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:30.411275 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea626b-fa8a-4091-8bb0-dc49d39263c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:30.411862 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea626b-fa8a-4091-8bb0-dc49d39263c7 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:30.414310 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea626b-fa8a-4091-8bb0-dc49d39263c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:30.414310 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea626b-fa8a-4091-8bb0-dc49d39263c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:30.414310 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea626b-fa8a-4091-8bb0-dc49d39263c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:30.415151 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea626b-fa8a-4091-8bb0-dc49d39263c7 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:30.432130 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:30.488679 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c3eb8c48-709f-4028-9e72-adb57451387c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '099c10e411474350a7aaca338967ecc4'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:30.499154 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:30.503925 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c3eb8c48-709f-4028-9e72-adb57451387c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '099c10e411474350a7aaca338967ecc4'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:30.504663 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c3eb8c48-709f-4028-9e72-adb57451387c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '099c10e411474350a7aaca338967ecc4'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:30.513238 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c3eb8c48-709f-4028-9e72-adb57451387c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '099c10e411474350a7aaca338967ecc4'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:30.561641 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1353/2688] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:06:30 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:06:30.565950 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea626b-fa8a-4091-8bb0-dc49d39263c7 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:30.632228 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c3eb8c48-709f-4028-9e72-adb57451387c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '099c10e411474350a7aaca338967ecc4'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:30.635077 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea626b-fa8a-4091-8bb0-dc49d39263c7 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:30.642566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676d45f-3815-4801-a873-d2ebfd0e6acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:30.643211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676d45f-3815-4801-a873-d2ebfd0e6acd admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:30.643691 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676d45f-3815-4801-a873-d2ebfd0e6acd admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:30.643806 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676d45f-3815-4801-a873-d2ebfd0e6acd admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:30.644446 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1336/2689] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:06:30 2022] DELETE /identity/v3/users/099c10e411474350a7aaca338967ecc4 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:30.644564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8676d45f-3815-4801-a873-d2ebfd0e6acd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:30.646418 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8676d45f-3815-4801-a873-d2ebfd0e6acd admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:30.648864 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e83cd-cb0e-45ba-a60a-72358a077960 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:30.649333 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e83cd-cb0e-45ba-a60a-72358a077960 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:30.649665 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e83cd-cb0e-45ba-a60a-72358a077960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:30.677013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-a44e83cd-cb0e-45ba-a60a-72358a077960 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:30.678260 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-a44e83cd-cb0e-45ba-a60a-72358a077960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:30.746221 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1337/2690] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:06:30.756267 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e83cd-cb0e-45ba-a60a-72358a077960 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:30.757821 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-a44e83cd-cb0e-45ba-a60a-72358a077960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:30.780148 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1354/2691] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:06:30 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:06:30.786547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676d45f-3815-4801-a873-d2ebfd0e6acd admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:30.788797 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-8676d45f-3815-4801-a873-d2ebfd0e6acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:30.803331 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676d45f-3815-4801-a873-d2ebfd0e6acd admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:30.808687 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41d00d-9c08-4a1d-b754-cc58bc31cc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:30.809386 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41d00d-9c08-4a1d-b754-cc58bc31cc49 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:30.809658 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41d00d-9c08-4a1d-b754-cc58bc31cc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:30.809926 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41d00d-9c08-4a1d-b754-cc58bc31cc49 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:30.810577 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41d00d-9c08-4a1d-b754-cc58bc31cc49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:30.812202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41d00d-9c08-4a1d-b754-cc58bc31cc49 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:30.822166 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1355/2692] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:06:30.822322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e83cd-cb0e-45ba-a60a-72358a077960 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:30.826742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41d00d-9c08-4a1d-b754-cc58bc31cc49 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:30.828691 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a389d-44c2-48b6-9ee3-4b7f2febc7ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:30.829334 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a389d-44c2-48b6-9ee3-4b7f2febc7ae service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:30.829612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a389d-44c2-48b6-9ee3-4b7f2febc7ae service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:30.829915 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a389d-44c2-48b6-9ee3-4b7f2febc7ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:30.837108 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41d00d-9c08-4a1d-b754-cc58bc31cc49 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:30.840364 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a389d-44c2-48b6-9ee3-4b7f2febc7ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:30.841799 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a389d-44c2-48b6-9ee3-4b7f2febc7ae service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:30.843000 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f686959-e01f-48da-99b6-f43988b3adb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:30.843672 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f686959-e01f-48da-99b6-f43988b3adb0 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:30.844006 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f686959-e01f-48da-99b6-f43988b3adb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:30.844294 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f686959-e01f-48da-99b6-f43988b3adb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:30.844960 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f686959-e01f-48da-99b6-f43988b3adb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:30.847058 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f686959-e01f-48da-99b6-f43988b3adb0 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:30.852708 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1338/2693] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:06:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:06:30.861680 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1356/2694] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:06:30.863094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a389d-44c2-48b6-9ee3-4b7f2febc7ae service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:30.873125 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a389d-44c2-48b6-9ee3-4b7f2febc7ae service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:30.877836 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577896b1-ef1b-4d61-b23d-e1a531222dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:30.878501 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577896b1-ef1b-4d61-b23d-e1a531222dd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:30.878776 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577896b1-ef1b-4d61-b23d-e1a531222dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:30.879045 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577896b1-ef1b-4d61-b23d-e1a531222dd5 admin admin] PATH_INFO: `/v3/projects/bba7887b39ca4dfebd870443d5d53286/users/56a3d8f90c8b4957b774d2d06b76d47c/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:30.898542 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577896b1-ef1b-4d61-b23d-e1a531222dd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba7887b39ca4dfebd870443d5d53286, user_id=56a3d8f90c8b4957b774d2d06b76d47c, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:30.901375 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577896b1-ef1b-4d61-b23d-e1a531222dd5 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:31.018133 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1339/2695] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:06:30 2022] PUT /identity/v3/projects/bba7887b39ca4dfebd870443d5d53286/users/56a3d8f90c8b4957b774d2d06b76d47c/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:06:31.023273 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efee070-c381-4018-bca2-fdf89576e1c2 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:31.023441 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efee070-c381-4018-bca2-fdf89576e1c2 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:31.023712 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efee070-c381-4018-bca2-fdf89576e1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:31.044443 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-5efee070-c381-4018-bca2-fdf89576e1c2 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:31.045752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-5efee070-c381-4018-bca2-fdf89576e1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:31.106678 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1357/2696] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:31.115958 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577896b1-ef1b-4d61-b23d-e1a531222dd5 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:31.117829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-577896b1-ef1b-4d61-b23d-e1a531222dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:31.199248 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577896b1-ef1b-4d61-b23d-e1a531222dd5 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:31.205151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cde0ff-ae97-4295-bc3d-54ab173514ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:31.205859 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cde0ff-ae97-4295-bc3d-54ab173514ef service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:31.206750 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cde0ff-ae97-4295-bc3d-54ab173514ef service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:31.206750 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cde0ff-ae97-4295-bc3d-54ab173514ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:31.222449 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cde0ff-ae97-4295-bc3d-54ab173514ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:31.222449 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cde0ff-ae97-4295-bc3d-54ab173514ef service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:31.229964 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1340/2697] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:06:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:06:31.317600 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:31.419390 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efee070-c381-4018-bca2-fdf89576e1c2 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:31.421067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-5efee070-c381-4018-bca2-fdf89576e1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:31.433926 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efee070-c381-4018-bca2-fdf89576e1c2 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:31.439481 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f87622-4fc7-4f1f-9dd5-138702cd1710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:31.440295 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f87622-4fc7-4f1f-9dd5-138702cd1710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:31.440651 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f87622-4fc7-4f1f-9dd5-138702cd1710 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:31.441128 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f87622-4fc7-4f1f-9dd5-138702cd1710 admin admin] PATH_INFO: `/v3/projects/8b47d62f20c843aeb01d2513855754a3` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:31.442889 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f87622-4fc7-4f1f-9dd5-138702cd1710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b47d62f20c843aeb01d2513855754a3)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:31.445140 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f87622-4fc7-4f1f-9dd5-138702cd1710 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:31.571071 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-87f87622-4fc7-4f1f-9dd5-138702cd1710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b47d62f20c843aeb01d2513855754a3', 'request_id': 'req-87f87622-4fc7-4f1f-9dd5-138702cd1710'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:31.577382 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-87f87622-4fc7-4f1f-9dd5-138702cd1710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b47d62f20c843aeb01d2513855754a3', 'request_id': 'req-87f87622-4fc7-4f1f-9dd5-138702cd1710'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:31.579552 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:31.661488 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-87f87622-4fc7-4f1f-9dd5-138702cd1710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b47d62f20c843aeb01d2513855754a3', 'request_id': 'req-87f87622-4fc7-4f1f-9dd5-138702cd1710'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:31.673316 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-87f87622-4fc7-4f1f-9dd5-138702cd1710 admin admin] The token cache is being invalidate because project 8b47d62f20c843aeb01d2513855754a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:06:31.673687 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-87f87622-4fc7-4f1f-9dd5-138702cd1710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:31.674952 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-87f87622-4fc7-4f1f-9dd5-138702cd1710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:31.677427 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1358/2698] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:06:31 2022] DELETE /identity/v3/projects/8b47d62f20c843aeb01d2513855754a3 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:31.682074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa686b0-ac42-4dbc-884e-8b62d4819b85 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:31.682369 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa686b0-ac42-4dbc-884e-8b62d4819b85 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:31.682737 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa686b0-ac42-4dbc-884e-8b62d4819b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:31.703169 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-3aa686b0-ac42-4dbc-884e-8b62d4819b85 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:31.704387 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-3aa686b0-ac42-4dbc-884e-8b62d4819b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:31.766067 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1341/2699] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:31.775154 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46ed36-d842-4bca-be80-32ada114638a None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:31.775447 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46ed36-d842-4bca-be80-32ada114638a None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:31.775728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46ed36-d842-4bca-be80-32ada114638a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:31.796082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-ae46ed36-d842-4bca-be80-32ada114638a None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:31.797299 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ae46ed36-d842-4bca-be80-32ada114638a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:31.805267 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1359/2700] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:31.811337 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa686b0-ac42-4dbc-884e-8b62d4819b85 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:31.820859 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa686b0-ac42-4dbc-884e-8b62d4819b85 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:31.825488 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227859f-f99d-44cf-94f7-c33445514c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:31.826119 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227859f-f99d-44cf-94f7-c33445514c3d admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:31.826403 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227859f-f99d-44cf-94f7-c33445514c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:31.827228 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227859f-f99d-44cf-94f7-c33445514c3d admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:31.827351 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227859f-f99d-44cf-94f7-c33445514c3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:06:31.827614 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227859f-f99d-44cf-94f7-c33445514c3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:31.829220 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227859f-f99d-44cf-94f7-c33445514c3d admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:31.842488 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1342/2701] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:06:31.847140 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46ed36-d842-4bca-be80-32ada114638a None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:31.858021 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46ed36-d842-4bca-be80-32ada114638a None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:31.863410 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f051d8-d74c-41e0-9598-6883e4e9f698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:31.864031 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f051d8-d74c-41e0-9598-6883e4e9f698 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:31.864304 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f051d8-d74c-41e0-9598-6883e4e9f698 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:31.864580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f051d8-d74c-41e0-9598-6883e4e9f698 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:31.865205 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f051d8-d74c-41e0-9598-6883e4e9f698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:31.867274 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f051d8-d74c-41e0-9598-6883e4e9f698 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:31.955427 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1360/2702] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:06:31 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:06:31.960035 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227859f-f99d-44cf-94f7-c33445514c3d admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:31.972162 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227859f-f99d-44cf-94f7-c33445514c3d admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:32.031429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f27ea0-d66e-4d41-b487-91363978cbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:32.032096 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f27ea0-d66e-4d41-b487-91363978cbd5 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:32.037449 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f27ea0-d66e-4d41-b487-91363978cbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:32.037449 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f27ea0-d66e-4d41-b487-91363978cbd5 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:32.037449 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f27ea0-d66e-4d41-b487-91363978cbd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:32.037449 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f27ea0-d66e-4d41-b487-91363978cbd5 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:32.114121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1343/2703] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:06:31 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:06:32.117937 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f051d8-d74c-41e0-9598-6883e4e9f698 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:32.130010 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f051d8-d74c-41e0-9598-6883e4e9f698 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:32.134965 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0591e66-d6b3-4a3e-8e42-0d537f3415cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:32.135578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0591e66-d6b3-4a3e-8e42-0d537f3415cb admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:32.135858 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0591e66-d6b3-4a3e-8e42-0d537f3415cb admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:32.136152 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0591e66-d6b3-4a3e-8e42-0d537f3415cb admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:32.137355 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0591e66-d6b3-4a3e-8e42-0d537f3415cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:32.139027 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0591e66-d6b3-4a3e-8e42-0d537f3415cb admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:32.149574 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1361/2704] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:06:32.153494 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f27ea0-d66e-4d41-b487-91363978cbd5 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:32.163568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f27ea0-d66e-4d41-b487-91363978cbd5 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:32.168425 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0eeaa1-6469-4804-8fe9-6adf0c3840c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:32.169040 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0eeaa1-6469-4804-8fe9-6adf0c3840c9 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:32.169322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0eeaa1-6469-4804-8fe9-6adf0c3840c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:32.169597 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0eeaa1-6469-4804-8fe9-6adf0c3840c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:32.171682 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0eeaa1-6469-4804-8fe9-6adf0c3840c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:32.171925 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0eeaa1-6469-4804-8fe9-6adf0c3840c9 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:32.182902 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1344/2705] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:06:32.187660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0591e66-d6b3-4a3e-8e42-0d537f3415cb admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:32.199491 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0591e66-d6b3-4a3e-8e42-0d537f3415cb admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:32.204363 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f28285-866d-4782-9e5a-fd8e1ee596a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:32.205021 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f28285-866d-4782-9e5a-fd8e1ee596a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:32.205303 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f28285-866d-4782-9e5a-fd8e1ee596a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:32.205577 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f28285-866d-4782-9e5a-fd8e1ee596a7 admin admin] PATH_INFO: `/v3/projects/04328be52aee48208d660f4a01584768/users/f7a5fdeff8a14dc184330e7403391c19/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:32.220769 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f28285-866d-4782-9e5a-fd8e1ee596a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04328be52aee48208d660f4a01584768, user_id=f7a5fdeff8a14dc184330e7403391c19, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:32.223550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f28285-866d-4782-9e5a-fd8e1ee596a7 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:32.311007 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1362/2706] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:06:32 2022] PUT /identity/v3/projects/04328be52aee48208d660f4a01584768/users/f7a5fdeff8a14dc184330e7403391c19/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:32.324823 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909be5b-4439-4a2d-acde-510e86c243f0 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:32.325700 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909be5b-4439-4a2d-acde-510e86c243f0 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:32.325979 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909be5b-4439-4a2d-acde-510e86c243f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:32.361516 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-d909be5b-4439-4a2d-acde-510e86c243f0 None None] MFA Rules not processed for user `f7a5fdeff8a14dc184330e7403391c19`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:32.362919 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-d909be5b-4439-4a2d-acde-510e86c243f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:32.434732 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1345/2707] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:32.460352 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f28285-866d-4782-9e5a-fd8e1ee596a7 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:32.462148 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-f6f28285-866d-4782-9e5a-fd8e1ee596a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:32.468637 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909be5b-4439-4a2d-acde-510e86c243f0 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:32.470072 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-d909be5b-4439-4a2d-acde-510e86c243f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:32.528276 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909be5b-4439-4a2d-acde-510e86c243f0 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:32.532194 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3f4ef-fbcb-492a-bfe5-5e2cdf386fe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:32.532834 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3f4ef-fbcb-492a-bfe5-5e2cdf386fe6 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:32.533138 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3f4ef-fbcb-492a-bfe5-5e2cdf386fe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:32.533336 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3f4ef-fbcb-492a-bfe5-5e2cdf386fe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:32.535288 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-8ee3f4ef-fbcb-492a-bfe5-5e2cdf386fe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:32.555362 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f28285-866d-4782-9e5a-fd8e1ee596a7 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:32.561291 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fb39a-f14a-461a-950d-d3e53b3f6974 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:32.561908 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fb39a-f14a-461a-950d-d3e53b3f6974 service nova] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:32.562217 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fb39a-f14a-461a-950d-d3e53b3f6974 service nova] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:32.562490 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fb39a-f14a-461a-950d-d3e53b3f6974 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:32.571522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fb39a-f14a-461a-950d-d3e53b3f6974 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:32.573168 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fb39a-f14a-461a-950d-d3e53b3f6974 service nova] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:32.582946 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1363/2708] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:06:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:06:32.598907 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3f4ef-fbcb-492a-bfe5-5e2cdf386fe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:32.600379 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3f4ef-fbcb-492a-bfe5-5e2cdf386fe6 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:32.614889 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1346/2709] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:06:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:06:32.860377 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fb39a-f14a-461a-950d-d3e53b3f6974 service nova] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:32.872104 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fb39a-f14a-461a-950d-d3e53b3f6974 service nova] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:32.878593 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac5ba4-5fcb-44db-8ac3-f69d7f452e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:32.879594 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac5ba4-5fcb-44db-8ac3-f69d7f452e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:32.879868 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac5ba4-5fcb-44db-8ac3-f69d7f452e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:32.880324 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac5ba4-5fcb-44db-8ac3-f69d7f452e60 admin admin] PATH_INFO: `/v3/users/f7a5fdeff8a14dc184330e7403391c19` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:32.881915 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac5ba4-5fcb-44db-8ac3-f69d7f452e60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7a5fdeff8a14dc184330e7403391c19)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:32.883999 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac5ba4-5fcb-44db-8ac3-f69d7f452e60 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:33.115763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-edac5ba4-5fcb-44db-8ac3-f69d7f452e60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7a5fdeff8a14dc184330e7403391c19'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:33.136002 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-edac5ba4-5fcb-44db-8ac3-f69d7f452e60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7a5fdeff8a14dc184330e7403391c19'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:33.136002 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-edac5ba4-5fcb-44db-8ac3-f69d7f452e60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7a5fdeff8a14dc184330e7403391c19'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:33.136002 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-edac5ba4-5fcb-44db-8ac3-f69d7f452e60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7a5fdeff8a14dc184330e7403391c19'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:33.141510 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-edac5ba4-5fcb-44db-8ac3-f69d7f452e60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7a5fdeff8a14dc184330e7403391c19'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:33.214994 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1364/2710] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:06:32 2022] DELETE /identity/v3/users/f7a5fdeff8a14dc184330e7403391c19 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:33.219725 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51482c06-6ef6-46ab-a26d-509b3f02531f None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:33.220013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51482c06-6ef6-46ab-a26d-509b3f02531f None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:33.220290 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51482c06-6ef6-46ab-a26d-509b3f02531f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:33.240612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-51482c06-6ef6-46ab-a26d-509b3f02531f None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:33.241869 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-51482c06-6ef6-46ab-a26d-509b3f02531f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:33.298872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:33.317080 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1347/2711] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:33.328908 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac5ba4-5fcb-44db-8ac3-f69d7f452e60 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:33.330315 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-edac5ba4-5fcb-44db-8ac3-f69d7f452e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:33.402726 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac5ba4-5fcb-44db-8ac3-f69d7f452e60 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:33.406849 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1cff71-04a3-4cfe-abe0-c810af4a3865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:33.407750 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cff71-04a3-4cfe-abe0-c810af4a3865 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:33.408130 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cff71-04a3-4cfe-abe0-c810af4a3865 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:33.408475 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cff71-04a3-4cfe-abe0-c810af4a3865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:33.421890 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1cff71-04a3-4cfe-abe0-c810af4a3865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:33.423492 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1cff71-04a3-4cfe-abe0-c810af4a3865 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:33.434205 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1365/2712] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:06:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:06:33.588282 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=87 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:34.166003 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51482c06-6ef6-46ab-a26d-509b3f02531f None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:34.168760 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-51482c06-6ef6-46ab-a26d-509b3f02531f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:34.187390 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51482c06-6ef6-46ab-a26d-509b3f02531f None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:34.194049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc0bc6-ddac-4018-a1f1-40f8eace3bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:34.195626 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc0bc6-ddac-4018-a1f1-40f8eace3bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:34.195928 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc0bc6-ddac-4018-a1f1-40f8eace3bba admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:34.196202 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc0bc6-ddac-4018-a1f1-40f8eace3bba admin admin] PATH_INFO: `/v3/projects/04328be52aee48208d660f4a01584768` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:34.197345 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc0bc6-ddac-4018-a1f1-40f8eace3bba admin admin] RBAC: Authorizing `identity:delete_project(project_id=04328be52aee48208d660f4a01584768)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:34.200932 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc0bc6-ddac-4018-a1f1-40f8eace3bba admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:34.317578 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-eedc0bc6-ddac-4018-a1f1-40f8eace3bba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04328be52aee48208d660f4a01584768', 'request_id': 'req-eedc0bc6-ddac-4018-a1f1-40f8eace3bba'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:34.324450 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-eedc0bc6-ddac-4018-a1f1-40f8eace3bba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04328be52aee48208d660f4a01584768', 'request_id': 'req-eedc0bc6-ddac-4018-a1f1-40f8eace3bba'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:34.353230 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-eedc0bc6-ddac-4018-a1f1-40f8eace3bba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04328be52aee48208d660f4a01584768', 'request_id': 'req-eedc0bc6-ddac-4018-a1f1-40f8eace3bba'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:34.364659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:34.418627 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-eedc0bc6-ddac-4018-a1f1-40f8eace3bba admin admin] The token cache is being invalidate because project 04328be52aee48208d660f4a01584768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:06:34.418627 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-eedc0bc6-ddac-4018-a1f1-40f8eace3bba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:34.418627 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-eedc0bc6-ddac-4018-a1f1-40f8eace3bba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:34.418627 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1348/2713] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:06:34 2022] DELETE /identity/v3/projects/04328be52aee48208d660f4a01584768 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:34.420063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086a3b4-986c-4cba-bb8a-4fa2330a9555 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:34.420343 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086a3b4-986c-4cba-bb8a-4fa2330a9555 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:34.421151 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086a3b4-986c-4cba-bb8a-4fa2330a9555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:34.450845 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-8086a3b4-986c-4cba-bb8a-4fa2330a9555 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:34.452513 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-8086a3b4-986c-4cba-bb8a-4fa2330a9555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:34.529799 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1366/2714] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:34.537969 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50774a0-fb13-46da-9c5d-d8b919e61a42 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:34.538414 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50774a0-fb13-46da-9c5d-d8b919e61a42 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:34.538694 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50774a0-fb13-46da-9c5d-d8b919e61a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:34.570726 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-b50774a0-fb13-46da-9c5d-d8b919e61a42 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:34.572482 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-b50774a0-fb13-46da-9c5d-d8b919e61a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:34.584701 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1349/2715] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:34.585948 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086a3b4-986c-4cba-bb8a-4fa2330a9555 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:34.600952 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086a3b4-986c-4cba-bb8a-4fa2330a9555 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:34.607335 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6afc3c-d602-4bbd-a1fc-a3c353463ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:34.607970 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6afc3c-d602-4bbd-a1fc-a3c353463ccf admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:34.608398 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6afc3c-d602-4bbd-a1fc-a3c353463ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:34.608831 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6afc3c-d602-4bbd-a1fc-a3c353463ccf admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:34.609852 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6afc3c-d602-4bbd-a1fc-a3c353463ccf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:06:34.610718 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6afc3c-d602-4bbd-a1fc-a3c353463ccf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:34.613825 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6afc3c-d602-4bbd-a1fc-a3c353463ccf admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:34.629812 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1367/2716] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:06:34.634761 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50774a0-fb13-46da-9c5d-d8b919e61a42 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:34.645292 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50774a0-fb13-46da-9c5d-d8b919e61a42 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:34.650905 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972587a-dcac-4e1f-b48a-806626805f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:34.651623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972587a-dcac-4e1f-b48a-806626805f7c admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:34.652497 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972587a-dcac-4e1f-b48a-806626805f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:34.652827 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972587a-dcac-4e1f-b48a-806626805f7c admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:34.653524 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972587a-dcac-4e1f-b48a-806626805f7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:34.655612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972587a-dcac-4e1f-b48a-806626805f7c admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:34.752858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1350/2717] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:06:34 2022] POST /identity/v3/projects => generated 405 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:06:34.753307 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6afc3c-d602-4bbd-a1fc-a3c353463ccf admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:34.763767 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6afc3c-d602-4bbd-a1fc-a3c353463ccf admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:34.862456 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bafc2-7c59-4d20-80ae-5ef347a8b085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:34.863900 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bafc2-7c59-4d20-80ae-5ef347a8b085 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:34.864279 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bafc2-7c59-4d20-80ae-5ef347a8b085 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:34.864732 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bafc2-7c59-4d20-80ae-5ef347a8b085 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:34.866291 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bafc2-7c59-4d20-80ae-5ef347a8b085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:34.869928 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bafc2-7c59-4d20-80ae-5ef347a8b085 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:34.982936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1368/2718] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:06:34 2022] POST /identity/v3/users => generated 303 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:06:34.984675 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972587a-dcac-4e1f-b48a-806626805f7c admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:34.996679 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972587a-dcac-4e1f-b48a-806626805f7c admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:35.002283 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1889e7-16d5-49d4-826d-50e1cd7918e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:35.003000 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1889e7-16d5-49d4-826d-50e1cd7918e4 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:35.003283 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1889e7-16d5-49d4-826d-50e1cd7918e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:35.003554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1889e7-16d5-49d4-826d-50e1cd7918e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:35.004201 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1889e7-16d5-49d4-826d-50e1cd7918e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:35.006443 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1889e7-16d5-49d4-826d-50e1cd7918e4 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:35.021010 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1351/2719] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:06:35.025527 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:35.041413 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bafc2-7c59-4d20-80ae-5ef347a8b085 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:35.058160 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bafc2-7c59-4d20-80ae-5ef347a8b085 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:35.065276 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae3f50-36a9-4e4e-8ab3-1b15a068450c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:35.066233 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae3f50-36a9-4e4e-8ab3-1b15a068450c admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:35.066501 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae3f50-36a9-4e4e-8ab3-1b15a068450c admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:35.066860 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae3f50-36a9-4e4e-8ab3-1b15a068450c admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:35.067573 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae3f50-36a9-4e4e-8ab3-1b15a068450c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:35.069437 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae3f50-36a9-4e4e-8ab3-1b15a068450c admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:35.086786 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1369/2720] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:06:35.091353 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1889e7-16d5-49d4-826d-50e1cd7918e4 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:35.105182 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1889e7-16d5-49d4-826d-50e1cd7918e4 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:35.112741 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488df33-e474-4b49-9fce-730c5191708f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:35.113727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488df33-e474-4b49-9fce-730c5191708f admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:35.114121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488df33-e474-4b49-9fce-730c5191708f admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:35.114584 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488df33-e474-4b49-9fce-730c5191708f admin admin] PATH_INFO: `/v3/projects/d15578328879487f9d150fded2fdba8e/users/f8e665d69ef3436ab7fa7b39fba8c939/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:35.133687 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488df33-e474-4b49-9fce-730c5191708f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d15578328879487f9d150fded2fdba8e, user_id=f8e665d69ef3436ab7fa7b39fba8c939, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:35.139143 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488df33-e474-4b49-9fce-730c5191708f admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:35.228839 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1352/2721] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:06:35 2022] PUT /identity/v3/projects/d15578328879487f9d150fded2fdba8e/users/f8e665d69ef3436ab7fa7b39fba8c939/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:06:35.235666 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70327e1c-62a6-4a54-9711-04dc7bb50aca None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:35.236285 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70327e1c-62a6-4a54-9711-04dc7bb50aca None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:35.236722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70327e1c-62a6-4a54-9711-04dc7bb50aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:35.275703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-70327e1c-62a6-4a54-9711-04dc7bb50aca None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:35.280145 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-70327e1c-62a6-4a54-9711-04dc7bb50aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:35.366853 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1370/2722] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:35.379117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488df33-e474-4b49-9fce-730c5191708f admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:35.381232 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-c488df33-e474-4b49-9fce-730c5191708f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:35.520883 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488df33-e474-4b49-9fce-730c5191708f admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:35.527751 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802eb89-1a99-4fc4-acc2-678b5e427f07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:35.529607 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802eb89-1a99-4fc4-acc2-678b5e427f07 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:35.530217 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802eb89-1a99-4fc4-acc2-678b5e427f07 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:35.530754 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802eb89-1a99-4fc4-acc2-678b5e427f07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:35.544284 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802eb89-1a99-4fc4-acc2-678b5e427f07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:35.546604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802eb89-1a99-4fc4-acc2-678b5e427f07 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:35.575267 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1353/2723] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:06:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:06:36.888506 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919da47-19ed-4b1a-8383-db044f5b408f None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:36.888971 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919da47-19ed-4b1a-8383-db044f5b408f None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:36.889056 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919da47-19ed-4b1a-8383-db044f5b408f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:36.918396 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-9919da47-19ed-4b1a-8383-db044f5b408f None None] MFA Rules not processed for user `f8e665d69ef3436ab7fa7b39fba8c939`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:36.919747 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-9919da47-19ed-4b1a-8383-db044f5b408f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:37.012463 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1371/2724] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:36 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:37.016680 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802eb89-1a99-4fc4-acc2-678b5e427f07 service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:37.027535 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802eb89-1a99-4fc4-acc2-678b5e427f07 service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:37.032610 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e30208-4f89-41b4-9652-d404c00f68ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:37.033325 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e30208-4f89-41b4-9652-d404c00f68ed admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:37.036432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e30208-4f89-41b4-9652-d404c00f68ed admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:37.036432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e30208-4f89-41b4-9652-d404c00f68ed admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:37.036432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e30208-4f89-41b4-9652-d404c00f68ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:37.037133 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e30208-4f89-41b4-9652-d404c00f68ed admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:37.192731 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1354/2725] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:06:37 2022] POST /identity/v3/projects => generated 405 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:06:37.197034 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919da47-19ed-4b1a-8383-db044f5b408f None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:37.211285 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919da47-19ed-4b1a-8383-db044f5b408f None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:37.330413 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfac3b8-eb12-47eb-9007-32a3778a0952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:37.330413 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfac3b8-eb12-47eb-9007-32a3778a0952 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:37.330965 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfac3b8-eb12-47eb-9007-32a3778a0952 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:37.331322 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfac3b8-eb12-47eb-9007-32a3778a0952 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:37.332312 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfac3b8-eb12-47eb-9007-32a3778a0952 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:37.334435 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfac3b8-eb12-47eb-9007-32a3778a0952 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:37.416738 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1372/2726] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:06:37 2022] POST /identity/v3/users => generated 309 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:06:37.421347 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e30208-4f89-41b4-9652-d404c00f68ed admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:37.434060 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e30208-4f89-41b4-9652-d404c00f68ed admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:37.441001 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad7a99-aed9-4b6d-9483-283ff6a2cae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:37.441650 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad7a99-aed9-4b6d-9483-283ff6a2cae7 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:37.442272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad7a99-aed9-4b6d-9483-283ff6a2cae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:37.444116 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad7a99-aed9-4b6d-9483-283ff6a2cae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:37.444116 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad7a99-aed9-4b6d-9483-283ff6a2cae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:37.445594 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad7a99-aed9-4b6d-9483-283ff6a2cae7 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:37.461096 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1355/2727] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:06:37.465089 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfac3b8-eb12-47eb-9007-32a3778a0952 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:37.479026 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfac3b8-eb12-47eb-9007-32a3778a0952 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:37.484867 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572b71f-98a1-4646-96db-59169b136e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:37.485777 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572b71f-98a1-4646-96db-59169b136e20 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:37.485777 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572b71f-98a1-4646-96db-59169b136e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:37.486187 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572b71f-98a1-4646-96db-59169b136e20 admin admin] PATH_INFO: `/v3/projects/fd8c736059e148e58fd2a06e7e6a4742/users/e7ee774bf75a47569e6ab89ed68df8df/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:37.492306 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:37.508508 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572b71f-98a1-4646-96db-59169b136e20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd8c736059e148e58fd2a06e7e6a4742, user_id=e7ee774bf75a47569e6ab89ed68df8df, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:37.513954 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572b71f-98a1-4646-96db-59169b136e20 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:37.619032 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1373/2728] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:06:37 2022] PUT /identity/v3/projects/fd8c736059e148e58fd2a06e7e6a4742/users/e7ee774bf75a47569e6ab89ed68df8df/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:37.620240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad7a99-aed9-4b6d-9483-283ff6a2cae7 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:37.643823 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad7a99-aed9-4b6d-9483-283ff6a2cae7 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:37.721081 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:37.791287 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5f872-2dad-4a7e-a108-a8327942e402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:37.794332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5f872-2dad-4a7e-a108-a8327942e402 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:37.794332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5f872-2dad-4a7e-a108-a8327942e402 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:37.794332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5f872-2dad-4a7e-a108-a8327942e402 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:37.794332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5f872-2dad-4a7e-a108-a8327942e402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:37.795076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5f872-2dad-4a7e-a108-a8327942e402 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:37.809371 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1356/2729] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:06:37.811743 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572b71f-98a1-4646-96db-59169b136e20 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:37.834727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572b71f-98a1-4646-96db-59169b136e20 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:37.844387 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699d5df-41dd-4e05-849a-0e7b289a90e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:37.845344 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699d5df-41dd-4e05-849a-0e7b289a90e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:37.845629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699d5df-41dd-4e05-849a-0e7b289a90e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:37.845906 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699d5df-41dd-4e05-849a-0e7b289a90e2 admin admin] PATH_INFO: `/v3/projects/fd8c736059e148e58fd2a06e7e6a4742/users/e7ee774bf75a47569e6ab89ed68df8df/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:37.848609 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699d5df-41dd-4e05-849a-0e7b289a90e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd8c736059e148e58fd2a06e7e6a4742, user_id=e7ee774bf75a47569e6ab89ed68df8df, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:37.852502 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699d5df-41dd-4e05-849a-0e7b289a90e2 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:37.905250 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1374/2730] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:06:37 2022] PUT /identity/v3/projects/fd8c736059e148e58fd2a06e7e6a4742/users/e7ee774bf75a47569e6ab89ed68df8df/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:40.311222 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b3ebd-9a55-4214-acd1-5919d2bb101d None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:40.311731 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b3ebd-9a55-4214-acd1-5919d2bb101d None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:40.311845 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b3ebd-9a55-4214-acd1-5919d2bb101d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:40.347286 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-f46b3ebd-9a55-4214-acd1-5919d2bb101d None None] MFA Rules not processed for user `e7ee774bf75a47569e6ab89ed68df8df`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:40.348513 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-f46b3ebd-9a55-4214-acd1-5919d2bb101d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:40.434679 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1357/2731] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:40 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:40.557064 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b2621-ebd2-4aa1-b84d-f85527ee0a9f None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:40.557064 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b2621-ebd2-4aa1-b84d-f85527ee0a9f None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:40.557064 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b2621-ebd2-4aa1-b84d-f85527ee0a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:40.559432 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e073a-2a1c-4d3d-affd-0b63062cd59a None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:40.560109 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e073a-2a1c-4d3d-affd-0b63062cd59a None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:40.560471 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e073a-2a1c-4d3d-affd-0b63062cd59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:40.601889 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-663b2621-ebd2-4aa1-b84d-f85527ee0a9f None None] MFA Rules not processed for user `b42f3ffc158f47f69dda4c012e4d365c`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:40.605973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-663b2621-ebd2-4aa1-b84d-f85527ee0a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:40.629277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-d04e073a-2a1c-4d3d-affd-0b63062cd59a None None] MFA Rules not processed for user `56a3d8f90c8b4957b774d2d06b76d47c`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:40.632466 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-d04e073a-2a1c-4d3d-affd-0b63062cd59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:40.705847 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1375/2732] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:40.732779 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1358/2733] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:40.744326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b2621-ebd2-4aa1-b84d-f85527ee0a9f None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:40.747982 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-663b2621-ebd2-4aa1-b84d-f85527ee0a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:40.860516 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b2621-ebd2-4aa1-b84d-f85527ee0a9f None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:40.868268 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f54a74-5747-4c9b-8b3c-c3a992a46319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:40.869045 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f54a74-5747-4c9b-8b3c-c3a992a46319 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:40.869326 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f54a74-5747-4c9b-8b3c-c3a992a46319 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:40.869600 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f54a74-5747-4c9b-8b3c-c3a992a46319 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:40.870383 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f54a74-5747-4c9b-8b3c-c3a992a46319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:40.872482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f54a74-5747-4c9b-8b3c-c3a992a46319 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:41.038039 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1376/2734] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:06:40 2022] POST /identity/v3/projects => generated 383 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:06:41.041687 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e073a-2a1c-4d3d-affd-0b63062cd59a None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:41.053848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e073a-2a1c-4d3d-affd-0b63062cd59a None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:41.110707 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:41.143007 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf677bc-f3a0-4178-86ca-1baa7d3bf9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:41.143657 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf677bc-f3a0-4178-86ca-1baa7d3bf9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:41.143939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf677bc-f3a0-4178-86ca-1baa7d3bf9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:41.144215 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf677bc-f3a0-4178-86ca-1baa7d3bf9e5 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:41.144863 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf677bc-f3a0-4178-86ca-1baa7d3bf9e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:41.146835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf677bc-f3a0-4178-86ca-1baa7d3bf9e5 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:41.205665 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f54a74-5747-4c9b-8b3c-c3a992a46319 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:41.263468 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1359/2735] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:06:41 2022] POST /identity/v3/users => generated 298 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:06:41.266892 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf677bc-f3a0-4178-86ca-1baa7d3bf9e5 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:41.285263 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf677bc-f3a0-4178-86ca-1baa7d3bf9e5 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:41.292119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f54a74-5747-4c9b-8b3c-c3a992a46319 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:41.314568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90658625-09c0-4cc3-9eb1-8d10852bb77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:41.314568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90658625-09c0-4cc3-9eb1-8d10852bb77d admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:41.314568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90658625-09c0-4cc3-9eb1-8d10852bb77d admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:41.314568 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90658625-09c0-4cc3-9eb1-8d10852bb77d admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:41.315583 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90658625-09c0-4cc3-9eb1-8d10852bb77d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:41.317025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90658625-09c0-4cc3-9eb1-8d10852bb77d admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:41.321041 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbab79-a305-415b-97f2-3beda88e15a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:41.321871 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbab79-a305-415b-97f2-3beda88e15a7 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:41.322372 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbab79-a305-415b-97f2-3beda88e15a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:41.322641 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbab79-a305-415b-97f2-3beda88e15a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:41.328412 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-78fbab79-a305-415b-97f2-3beda88e15a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:41.346361 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1360/2736] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:06:41.347243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90658625-09c0-4cc3-9eb1-8d10852bb77d admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:41.355226 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbab79-a305-415b-97f2-3beda88e15a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:41.358254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbab79-a305-415b-97f2-3beda88e15a7 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:41.368788 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90658625-09c0-4cc3-9eb1-8d10852bb77d admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:41.374418 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda1854-b6d5-4bef-84f8-020ec254db23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:41.375091 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda1854-b6d5-4bef-84f8-020ec254db23 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:41.375469 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda1854-b6d5-4bef-84f8-020ec254db23 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:41.375890 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda1854-b6d5-4bef-84f8-020ec254db23 admin admin] PATH_INFO: `/v3/projects/95006e05552d4ffdb53dd47a045fc2e2/users/80f6c99a2b5444a0a67c5708c3e46178/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:41.381835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1377/2737] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:06:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:06:41.394778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda1854-b6d5-4bef-84f8-020ec254db23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95006e05552d4ffdb53dd47a045fc2e2, user_id=80f6c99a2b5444a0a67c5708c3e46178, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:41.397645 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda1854-b6d5-4bef-84f8-020ec254db23 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:41.485724 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1361/2738] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:06:41 2022] PUT /identity/v3/projects/95006e05552d4ffdb53dd47a045fc2e2/users/80f6c99a2b5444a0a67c5708c3e46178/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:41.489528 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbab79-a305-415b-97f2-3beda88e15a7 service neutron] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:41.500141 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:41.511304 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbab79-a305-415b-97f2-3beda88e15a7 service neutron] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:41.621119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71522ee9-dcfb-40f8-9703-1b4a054bfa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:41.621768 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71522ee9-dcfb-40f8-9703-1b4a054bfa7b admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:41.622014 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71522ee9-dcfb-40f8-9703-1b4a054bfa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:41.622479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71522ee9-dcfb-40f8-9703-1b4a054bfa7b admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:41.623298 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71522ee9-dcfb-40f8-9703-1b4a054bfa7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:41.624718 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71522ee9-dcfb-40f8-9703-1b4a054bfa7b admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:41.636185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1378/2739] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:06:41.640549 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda1854-b6d5-4bef-84f8-020ec254db23 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:41.662862 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda1854-b6d5-4bef-84f8-020ec254db23 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:41.669282 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d983e97-97d9-43b3-9586-31df7388ae52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:41.670524 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d983e97-97d9-43b3-9586-31df7388ae52 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:41.670980 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d983e97-97d9-43b3-9586-31df7388ae52 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:41.679385 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d983e97-97d9-43b3-9586-31df7388ae52 admin admin] PATH_INFO: `/v3/projects/95006e05552d4ffdb53dd47a045fc2e2/users/80f6c99a2b5444a0a67c5708c3e46178/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:41.679385 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d983e97-97d9-43b3-9586-31df7388ae52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95006e05552d4ffdb53dd47a045fc2e2, user_id=80f6c99a2b5444a0a67c5708c3e46178, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:41.679385 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d983e97-97d9-43b3-9586-31df7388ae52 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:41.705433 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1362/2740] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:06:41 2022] PUT /identity/v3/projects/95006e05552d4ffdb53dd47a045fc2e2/users/80f6c99a2b5444a0a67c5708c3e46178/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:43.273699 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71522ee9-dcfb-40f8-9703-1b4a054bfa7b admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:43.286368 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71522ee9-dcfb-40f8-9703-1b4a054bfa7b admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:43.405136 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c24f4-8c2c-4390-b30f-f264d4fc26d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:43.406768 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c24f4-8c2c-4390-b30f-f264d4fc26d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:43.407107 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c24f4-8c2c-4390-b30f-f264d4fc26d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:43.407386 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c24f4-8c2c-4390-b30f-f264d4fc26d6 admin admin] PATH_INFO: `/v3/users/f8e665d69ef3436ab7fa7b39fba8c939` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:43.408947 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c24f4-8c2c-4390-b30f-f264d4fc26d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8e665d69ef3436ab7fa7b39fba8c939)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:43.411085 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c24f4-8c2c-4390-b30f-f264d4fc26d6 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:43.662814 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-d19c24f4-8c2c-4390-b30f-f264d4fc26d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8e665d69ef3436ab7fa7b39fba8c939'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:43.676806 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-d19c24f4-8c2c-4390-b30f-f264d4fc26d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8e665d69ef3436ab7fa7b39fba8c939'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:43.677588 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-d19c24f4-8c2c-4390-b30f-f264d4fc26d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8e665d69ef3436ab7fa7b39fba8c939'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:43.678298 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-d19c24f4-8c2c-4390-b30f-f264d4fc26d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8e665d69ef3436ab7fa7b39fba8c939'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:43.685955 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-d19c24f4-8c2c-4390-b30f-f264d4fc26d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8e665d69ef3436ab7fa7b39fba8c939'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:43.802268 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1379/2741] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:06:43 2022] DELETE /identity/v3/users/f8e665d69ef3436ab7fa7b39fba8c939 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:44.292471 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d983e97-97d9-43b3-9586-31df7388ae52 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:44.294861 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-0d983e97-97d9-43b3-9586-31df7388ae52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:44.316717 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d983e97-97d9-43b3-9586-31df7388ae52 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:44.427542 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995450f5-0e2b-473d-818d-76020b8398ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:44.438166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995450f5-0e2b-473d-818d-76020b8398ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:44.438166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995450f5-0e2b-473d-818d-76020b8398ce admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:44.438166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995450f5-0e2b-473d-818d-76020b8398ce admin admin] PATH_INFO: `/v3/projects/d15578328879487f9d150fded2fdba8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:44.438166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995450f5-0e2b-473d-818d-76020b8398ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=d15578328879487f9d150fded2fdba8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:44.438166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995450f5-0e2b-473d-818d-76020b8398ce admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:44.559038 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-995450f5-0e2b-473d-818d-76020b8398ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd15578328879487f9d150fded2fdba8e', 'request_id': 'req-995450f5-0e2b-473d-818d-76020b8398ce'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:44.565987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-995450f5-0e2b-473d-818d-76020b8398ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd15578328879487f9d150fded2fdba8e', 'request_id': 'req-995450f5-0e2b-473d-818d-76020b8398ce'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:44.595404 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-995450f5-0e2b-473d-818d-76020b8398ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd15578328879487f9d150fded2fdba8e', 'request_id': 'req-995450f5-0e2b-473d-818d-76020b8398ce'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:44.673036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-995450f5-0e2b-473d-818d-76020b8398ce admin admin] The token cache is being invalidate because project d15578328879487f9d150fded2fdba8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:06:44.673646 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-995450f5-0e2b-473d-818d-76020b8398ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:44.675294 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-995450f5-0e2b-473d-818d-76020b8398ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:44.677069 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1363/2742] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:06:44 2022] DELETE /identity/v3/projects/d15578328879487f9d150fded2fdba8e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:44.681526 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c24f4-8c2c-4390-b30f-f264d4fc26d6 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:44.693973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c24f4-8c2c-4390-b30f-f264d4fc26d6 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:44.726162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:44.794230 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe9c56-bd78-4316-86a0-2f8197234a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:44.795069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe9c56-bd78-4316-86a0-2f8197234a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:44.795378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe9c56-bd78-4316-86a0-2f8197234a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:44.795654 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe9c56-bd78-4316-86a0-2f8197234a79 admin admin] PATH_INFO: `/v3/users/e7ee774bf75a47569e6ab89ed68df8df` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:44.797300 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe9c56-bd78-4316-86a0-2f8197234a79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ee774bf75a47569e6ab89ed68df8df)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:44.798870 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe9c56-bd78-4316-86a0-2f8197234a79 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:44.865492 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995450f5-0e2b-473d-818d-76020b8398ce admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:44.867162 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-995450f5-0e2b-473d-818d-76020b8398ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:44.888459 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995450f5-0e2b-473d-818d-76020b8398ce admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:44.901112 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22dd2b-c5c9-4e99-9cdb-e3121963d871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:44.901776 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22dd2b-c5c9-4e99-9cdb-e3121963d871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:44.902055 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22dd2b-c5c9-4e99-9cdb-e3121963d871 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:44.903001 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22dd2b-c5c9-4e99-9cdb-e3121963d871 admin admin] PATH_INFO: `/v3/users/19f08b443c1049cbabbc4f1435bbbaee` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:44.907659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22dd2b-c5c9-4e99-9cdb-e3121963d871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19f08b443c1049cbabbc4f1435bbbaee)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:44.910043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22dd2b-c5c9-4e99-9cdb-e3121963d871 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:44.943307 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:45.029898 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-49fe9c56-bd78-4316-86a0-2f8197234a79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ee774bf75a47569e6ab89ed68df8df'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:45.057426 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-49fe9c56-bd78-4316-86a0-2f8197234a79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ee774bf75a47569e6ab89ed68df8df'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:45.058582 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-49fe9c56-bd78-4316-86a0-2f8197234a79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ee774bf75a47569e6ab89ed68df8df'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:45.058907 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-49fe9c56-bd78-4316-86a0-2f8197234a79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ee774bf75a47569e6ab89ed68df8df'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:45.067744 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-49fe9c56-bd78-4316-86a0-2f8197234a79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ee774bf75a47569e6ab89ed68df8df'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:45.137243 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ca22dd2b-c5c9-4e99-9cdb-e3121963d871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19f08b443c1049cbabbc4f1435bbbaee'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:45.159143 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ca22dd2b-c5c9-4e99-9cdb-e3121963d871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19f08b443c1049cbabbc4f1435bbbaee'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:45.162161 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1380/2743] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:06:44 2022] DELETE /identity/v3/users/e7ee774bf75a47569e6ab89ed68df8df => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:45.162297 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ca22dd2b-c5c9-4e99-9cdb-e3121963d871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19f08b443c1049cbabbc4f1435bbbaee'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:45.177493 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ca22dd2b-c5c9-4e99-9cdb-e3121963d871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19f08b443c1049cbabbc4f1435bbbaee'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:45.245246 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-ca22dd2b-c5c9-4e99-9cdb-e3121963d871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19f08b443c1049cbabbc4f1435bbbaee'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:45.258358 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1364/2744] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:06:44 2022] DELETE /identity/v3/users/19f08b443c1049cbabbc4f1435bbbaee => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:45.671181 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe9c56-bd78-4316-86a0-2f8197234a79 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:45.672837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-49fe9c56-bd78-4316-86a0-2f8197234a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:45.695249 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22dd2b-c5c9-4e99-9cdb-e3121963d871 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:45.697191 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-ca22dd2b-c5c9-4e99-9cdb-e3121963d871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:45.831086 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22dd2b-c5c9-4e99-9cdb-e3121963d871 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:45.831086 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803268c-100f-4f67-9d3f-e83966942317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:45.831086 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803268c-100f-4f67-9d3f-e83966942317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:45.831086 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803268c-100f-4f67-9d3f-e83966942317 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:45.831405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803268c-100f-4f67-9d3f-e83966942317 admin admin] PATH_INFO: `/v3/projects/cdf1953d04194acca61384eea7cf891e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:45.831405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803268c-100f-4f67-9d3f-e83966942317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdf1953d04194acca61384eea7cf891e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:45.836829 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803268c-100f-4f67-9d3f-e83966942317 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:45.854389 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe9c56-bd78-4316-86a0-2f8197234a79 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:45.867929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269d84d-e517-4dc2-b7dd-628f5d1d28e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:45.868602 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269d84d-e517-4dc2-b7dd-628f5d1d28e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:45.868872 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269d84d-e517-4dc2-b7dd-628f5d1d28e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:45.869149 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269d84d-e517-4dc2-b7dd-628f5d1d28e3 admin admin] PATH_INFO: `/v3/projects/fd8c736059e148e58fd2a06e7e6a4742` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:45.870535 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269d84d-e517-4dc2-b7dd-628f5d1d28e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd8c736059e148e58fd2a06e7e6a4742)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:45.875332 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269d84d-e517-4dc2-b7dd-628f5d1d28e3 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:45.974595 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-2803268c-100f-4f67-9d3f-e83966942317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdf1953d04194acca61384eea7cf891e', 'request_id': 'req-2803268c-100f-4f67-9d3f-e83966942317'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:45.980302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-2803268c-100f-4f67-9d3f-e83966942317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdf1953d04194acca61384eea7cf891e', 'request_id': 'req-2803268c-100f-4f67-9d3f-e83966942317'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:45.987184 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-2803268c-100f-4f67-9d3f-e83966942317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdf1953d04194acca61384eea7cf891e', 'request_id': 'req-2803268c-100f-4f67-9d3f-e83966942317'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:46.067515 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-9269d84d-e517-4dc2-b7dd-628f5d1d28e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd8c736059e148e58fd2a06e7e6a4742', 'request_id': 'req-9269d84d-e517-4dc2-b7dd-628f5d1d28e3'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:46.079479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-9269d84d-e517-4dc2-b7dd-628f5d1d28e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd8c736059e148e58fd2a06e7e6a4742', 'request_id': 'req-9269d84d-e517-4dc2-b7dd-628f5d1d28e3'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:46.115020 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-2803268c-100f-4f67-9d3f-e83966942317 admin admin] The token cache is being invalidate because project cdf1953d04194acca61384eea7cf891e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:06:46.115374 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-2803268c-100f-4f67-9d3f-e83966942317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:46.116264 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-2803268c-100f-4f67-9d3f-e83966942317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:46.122172 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1365/2745] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:06:45 2022] DELETE /identity/v3/projects/cdf1953d04194acca61384eea7cf891e => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:46.123390 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803268c-100f-4f67-9d3f-e83966942317 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:46.125184 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-2803268c-100f-4f67-9d3f-e83966942317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:46.183020 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-9269d84d-e517-4dc2-b7dd-628f5d1d28e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd8c736059e148e58fd2a06e7e6a4742', 'request_id': 'req-9269d84d-e517-4dc2-b7dd-628f5d1d28e3'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:46.204043 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-9269d84d-e517-4dc2-b7dd-628f5d1d28e3 admin admin] The token cache is being invalidate because project fd8c736059e148e58fd2a06e7e6a4742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:06:46.204043 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-9269d84d-e517-4dc2-b7dd-628f5d1d28e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:46.205960 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-9269d84d-e517-4dc2-b7dd-628f5d1d28e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:46.211389 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1381/2746] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:06:45 2022] DELETE /identity/v3/projects/fd8c736059e148e58fd2a06e7e6a4742 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:46.216500 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25852ad-cfdf-4a7b-8c9f-dbb61a8e118e None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:46.217877 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25852ad-cfdf-4a7b-8c9f-dbb61a8e118e None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:46.222023 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25852ad-cfdf-4a7b-8c9f-dbb61a8e118e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:46.248780 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803268c-100f-4f67-9d3f-e83966942317 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:46.257017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-f25852ad-cfdf-4a7b-8c9f-dbb61a8e118e None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:46.258455 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-f25852ad-cfdf-4a7b-8c9f-dbb61a8e118e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:46.355001 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a806c0-d561-440b-8cf7-7de799a430d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:46.355786 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a806c0-d561-440b-8cf7-7de799a430d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:46.356062 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a806c0-d561-440b-8cf7-7de799a430d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:46.356341 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a806c0-d561-440b-8cf7-7de799a430d5 admin admin] PATH_INFO: `/v3/users/beef98b1395842f29d8761dac7aaa31d` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:46.357578 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a806c0-d561-440b-8cf7-7de799a430d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beef98b1395842f29d8761dac7aaa31d)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:46.360356 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a806c0-d561-440b-8cf7-7de799a430d5 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:46.404244 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1382/2747] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:46.405627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1795104-74ec-49f8-8d76-2eaa2b63ddef None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:46.405916 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1795104-74ec-49f8-8d76-2eaa2b63ddef None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:46.406233 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1795104-74ec-49f8-8d76-2eaa2b63ddef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:46.437592 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-c1795104-74ec-49f8-8d76-2eaa2b63ddef None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:46.438952 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-c1795104-74ec-49f8-8d76-2eaa2b63ddef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:46.459895 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1383/2748] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:46.466619 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1795104-74ec-49f8-8d76-2eaa2b63ddef None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:46.478486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1795104-74ec-49f8-8d76-2eaa2b63ddef None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:46.486770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8caf8-9a25-4ab4-9e80-a8f52ccd732b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:46.487617 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8caf8-9a25-4ab4-9e80-a8f52ccd732b admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:46.487890 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8caf8-9a25-4ab4-9e80-a8f52ccd732b admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:46.488160 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8caf8-9a25-4ab4-9e80-a8f52ccd732b admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:46.489618 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8caf8-9a25-4ab4-9e80-a8f52ccd732b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:06:46.489934 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8caf8-9a25-4ab4-9e80-a8f52ccd732b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:46.493134 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8caf8-9a25-4ab4-9e80-a8f52ccd732b admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:46.507721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1384/2749] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:06:46.513329 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8caf8-9a25-4ab4-9e80-a8f52ccd732b admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:46.530729 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8caf8-9a25-4ab4-9e80-a8f52ccd732b admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:46.540164 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fc837-ba3e-430c-9a99-22738cb2a28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:46.544365 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fc837-ba3e-430c-9a99-22738cb2a28a admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:46.545066 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:46.545925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fc837-ba3e-430c-9a99-22738cb2a28a admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:46.546288 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fc837-ba3e-430c-9a99-22738cb2a28a admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:46.547090 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8fc837-ba3e-430c-9a99-22738cb2a28a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:46.549927 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8fc837-ba3e-430c-9a99-22738cb2a28a admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:46.567378 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-e3a806c0-d561-440b-8cf7-7de799a430d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beef98b1395842f29d8761dac7aaa31d'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:46.598558 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-e3a806c0-d561-440b-8cf7-7de799a430d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beef98b1395842f29d8761dac7aaa31d'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:46.599305 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-e3a806c0-d561-440b-8cf7-7de799a430d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beef98b1395842f29d8761dac7aaa31d'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:46.614995 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-e3a806c0-d561-440b-8cf7-7de799a430d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beef98b1395842f29d8761dac7aaa31d'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:46.635337 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1385/2750] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:06:46 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:06:46.637405 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fc837-ba3e-430c-9a99-22738cb2a28a admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:46.708371 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-e3a806c0-d561-440b-8cf7-7de799a430d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beef98b1395842f29d8761dac7aaa31d'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:46.718240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1366/2751] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:06:46 2022] DELETE /identity/v3/users/beef98b1395842f29d8761dac7aaa31d => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:06:46.757389 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fc837-ba3e-430c-9a99-22738cb2a28a admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:46.822322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:46.905454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad819858-edd9-491b-9440-e46043b3cef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:46.906609 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad819858-edd9-491b-9440-e46043b3cef1 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:46.907102 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad819858-edd9-491b-9440-e46043b3cef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:46.907392 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad819858-edd9-491b-9440-e46043b3cef1 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:46.908049 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad819858-edd9-491b-9440-e46043b3cef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:46.910305 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad819858-edd9-491b-9440-e46043b3cef1 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:47.074333 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a806c0-d561-440b-8cf7-7de799a430d5 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:47.076277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-e3a806c0-d561-440b-8cf7-7de799a430d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:47.079149 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1386/2752] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:06:46 2022] POST /identity/v3/users => generated 283 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:06:47.108015 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a806c0-d561-440b-8cf7-7de799a430d5 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:47.114766 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eacfb03-f4a8-45bd-b4a8-cfe74a564c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:47.115774 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacfb03-f4a8-45bd-b4a8-cfe74a564c25 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:47.116685 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacfb03-f4a8-45bd-b4a8-cfe74a564c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:47.117255 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacfb03-f4a8-45bd-b4a8-cfe74a564c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:47.118474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eacfb03-f4a8-45bd-b4a8-cfe74a564c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:47.123096 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eacfb03-f4a8-45bd-b4a8-cfe74a564c25 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:47.143760 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad819858-edd9-491b-9440-e46043b3cef1 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:47.154363 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1367/2753] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:06:47.157198 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad819858-edd9-491b-9440-e46043b3cef1 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:47.163338 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6b143-01b7-4010-9103-d6d38a25b969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:47.164728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6b143-01b7-4010-9103-d6d38a25b969 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:47.165348 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6b143-01b7-4010-9103-d6d38a25b969 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:47.166069 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6b143-01b7-4010-9103-d6d38a25b969 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:47.167213 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6b143-01b7-4010-9103-d6d38a25b969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:47.169872 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6b143-01b7-4010-9103-d6d38a25b969 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:47.188490 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1387/2754] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:06:47.194975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eacfb03-f4a8-45bd-b4a8-cfe74a564c25 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:47.215153 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eacfb03-f4a8-45bd-b4a8-cfe74a564c25 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:47.228871 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dcb5f-1a5b-49de-adf8-59de33957d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:47.229841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dcb5f-1a5b-49de-adf8-59de33957d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:47.231053 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dcb5f-1a5b-49de-adf8-59de33957d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:47.231415 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dcb5f-1a5b-49de-adf8-59de33957d31 admin admin] PATH_INFO: `/v3/projects/5f62ddf4881d45f9b891d45ca0093c6e/users/504ad6d2029c4ddd804ae4ba133a238e/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:47.251219 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3dcb5f-1a5b-49de-adf8-59de33957d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f62ddf4881d45f9b891d45ca0093c6e, user_id=504ad6d2029c4ddd804ae4ba133a238e, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:47.255550 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3dcb5f-1a5b-49de-adf8-59de33957d31 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:47.351228 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2b159-3b8e-49bc-8dad-8cee97e453a3 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:47.351534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2b159-3b8e-49bc-8dad-8cee97e453a3 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:47.351833 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2b159-3b8e-49bc-8dad-8cee97e453a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:47.352001 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1368/2755] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:06:47 2022] PUT /identity/v3/projects/5f62ddf4881d45f9b891d45ca0093c6e/users/504ad6d2029c4ddd804ae4ba133a238e/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:47.412693 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-cda2b159-3b8e-49bc-8dad-8cee97e453a3 None None] MFA Rules not processed for user `504ad6d2029c4ddd804ae4ba133a238e`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:47.414912 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-cda2b159-3b8e-49bc-8dad-8cee97e453a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:47.450925 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dcb5f-1a5b-49de-adf8-59de33957d31 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:47.453597 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-aa3dcb5f-1a5b-49de-adf8-59de33957d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:47.515717 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1388/2756] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:47.523155 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2b159-3b8e-49bc-8dad-8cee97e453a3 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:47.569688 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dcb5f-1a5b-49de-adf8-59de33957d31 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:47.588845 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac95688-f1ea-4078-9c32-4ac7544d9539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:47.589517 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac95688-f1ea-4078-9c32-4ac7544d9539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:47.589902 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac95688-f1ea-4078-9c32-4ac7544d9539 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:47.596618 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac95688-f1ea-4078-9c32-4ac7544d9539 admin admin] PATH_INFO: `/v3/projects/b26f8dcb4bdb4881bb8192b8426763ab` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:47.598451 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac95688-f1ea-4078-9c32-4ac7544d9539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b26f8dcb4bdb4881bb8192b8426763ab)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:47.600417 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac95688-f1ea-4078-9c32-4ac7544d9539 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:47.664484 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2b159-3b8e-49bc-8dad-8cee97e453a3 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:47.678866 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6458044-9e43-4e58-b293-f97f033550e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:47.681106 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6458044-9e43-4e58-b293-f97f033550e8 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:47.681489 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6458044-9e43-4e58-b293-f97f033550e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:47.681863 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6458044-9e43-4e58-b293-f97f033550e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:47.684446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6458044-9e43-4e58-b293-f97f033550e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:47.689772 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6458044-9e43-4e58-b293-f97f033550e8 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:47.796438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-bac95688-f1ea-4078-9c32-4ac7544d9539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b26f8dcb4bdb4881bb8192b8426763ab', 'request_id': 'req-bac95688-f1ea-4078-9c32-4ac7544d9539'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:47.802764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1389/2757] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:06:47 2022] POST /identity/v3/projects => generated 365 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:06:47.804528 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-bac95688-f1ea-4078-9c32-4ac7544d9539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b26f8dcb4bdb4881bb8192b8426763ab', 'request_id': 'req-bac95688-f1ea-4078-9c32-4ac7544d9539'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:47.807321 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6458044-9e43-4e58-b293-f97f033550e8 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:47.822685 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-bac95688-f1ea-4078-9c32-4ac7544d9539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b26f8dcb4bdb4881bb8192b8426763ab', 'request_id': 'req-bac95688-f1ea-4078-9c32-4ac7544d9539'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:47.923109 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6458044-9e43-4e58-b293-f97f033550e8 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:47.927784 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-bac95688-f1ea-4078-9c32-4ac7544d9539 admin admin] The token cache is being invalidate because project b26f8dcb4bdb4881bb8192b8426763ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:06:47.928076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-bac95688-f1ea-4078-9c32-4ac7544d9539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:47.929858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-bac95688-f1ea-4078-9c32-4ac7544d9539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:06:47.942124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1369/2758] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:06:47 2022] DELETE /identity/v3/projects/b26f8dcb4bdb4881bb8192b8426763ab => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:06:47.942802 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1b9e9-beeb-4b45-b74f-2cacbfb89af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:47.942802 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1b9e9-beeb-4b45-b74f-2cacbfb89af7 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:47.942802 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1b9e9-beeb-4b45-b74f-2cacbfb89af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:47.942802 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1b9e9-beeb-4b45-b74f-2cacbfb89af7 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:47.943104 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1b9e9-beeb-4b45-b74f-2cacbfb89af7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:47.943104 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1b9e9-beeb-4b45-b74f-2cacbfb89af7 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:48.071371 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1390/2759] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:06:47 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:06:48.075204 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac95688-f1ea-4078-9c32-4ac7544d9539 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:48.076785 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-bac95688-f1ea-4078-9c32-4ac7544d9539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:48.126559 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:48.189351 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac95688-f1ea-4078-9c32-4ac7544d9539 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:48.194535 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b05dcd-ecab-4f9a-9a63-2cd4546b2b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:48.195340 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b05dcd-ecab-4f9a-9a63-2cd4546b2b96 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:48.199560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b05dcd-ecab-4f9a-9a63-2cd4546b2b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:48.199560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b05dcd-ecab-4f9a-9a63-2cd4546b2b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:48.199560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b05dcd-ecab-4f9a-9a63-2cd4546b2b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:48.199560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b05dcd-ecab-4f9a-9a63-2cd4546b2b96 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:48.216983 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1370/2760] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:06:48.223575 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1b9e9-beeb-4b45-b74f-2cacbfb89af7 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:48.229226 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:48.245606 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1b9e9-beeb-4b45-b74f-2cacbfb89af7 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:48.251550 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2d8d7-a72c-4365-945e-b065d51ca027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:48.252592 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2d8d7-a72c-4365-945e-b065d51ca027 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:48.252975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2d8d7-a72c-4365-945e-b065d51ca027 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:48.253420 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2d8d7-a72c-4365-945e-b065d51ca027 admin admin] PATH_INFO: `/v3/projects/d0d85057201147bb9a000da6a14427be/users/588a0d6ef26f476995d7631d48cc537e/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:48.272310 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2d8d7-a72c-4365-945e-b065d51ca027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d85057201147bb9a000da6a14427be, user_id=588a0d6ef26f476995d7631d48cc537e, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:48.275376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2d8d7-a72c-4365-945e-b065d51ca027 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:48.364098 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1391/2761] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:06:48 2022] PUT /identity/v3/projects/d0d85057201147bb9a000da6a14427be/users/588a0d6ef26f476995d7631d48cc537e/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:48.365810 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b05dcd-ecab-4f9a-9a63-2cd4546b2b96 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:48.381229 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b05dcd-ecab-4f9a-9a63-2cd4546b2b96 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:48.476150 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c27af3-4657-42f6-b078-a5364456541d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:48.476863 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c27af3-4657-42f6-b078-a5364456541d admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:48.477204 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c27af3-4657-42f6-b078-a5364456541d admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:48.477535 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c27af3-4657-42f6-b078-a5364456541d admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:48.478440 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c27af3-4657-42f6-b078-a5364456541d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:48.480885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c27af3-4657-42f6-b078-a5364456541d admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:48.497649 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1371/2762] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:06:48.500525 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2d8d7-a72c-4365-945e-b065d51ca027 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:48.513031 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2d8d7-a72c-4365-945e-b065d51ca027 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:48.518039 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db02687-32a7-4ab8-8350-faeb8229118a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:48.518870 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db02687-32a7-4ab8-8350-faeb8229118a admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:48.519152 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db02687-32a7-4ab8-8350-faeb8229118a admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:48.519430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db02687-32a7-4ab8-8350-faeb8229118a admin admin] PATH_INFO: `/v3/projects/d0d85057201147bb9a000da6a14427be/users/588a0d6ef26f476995d7631d48cc537e/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:48.521453 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db02687-32a7-4ab8-8350-faeb8229118a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d85057201147bb9a000da6a14427be, user_id=588a0d6ef26f476995d7631d48cc537e, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:48.524168 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db02687-32a7-4ab8-8350-faeb8229118a admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:48.536896 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1392/2763] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:06:48 2022] PUT /identity/v3/projects/d0d85057201147bb9a000da6a14427be/users/588a0d6ef26f476995d7631d48cc537e/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:06:48.548225 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecabbb2-c047-4caf-a8b2-2e0cd0b5584f None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:48.548697 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecabbb2-c047-4caf-a8b2-2e0cd0b5584f None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:48.548965 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecabbb2-c047-4caf-a8b2-2e0cd0b5584f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:48.587496 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-3ecabbb2-c047-4caf-a8b2-2e0cd0b5584f None None] MFA Rules not processed for user `588a0d6ef26f476995d7631d48cc537e`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:48.588952 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-3ecabbb2-c047-4caf-a8b2-2e0cd0b5584f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:48.730727 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1372/2764] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:48.743068 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db02687-32a7-4ab8-8350-faeb8229118a admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:48.744883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-8db02687-32a7-4ab8-8350-faeb8229118a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:48.812162 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db02687-32a7-4ab8-8350-faeb8229118a admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:48.816387 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6ec22-9769-4a9c-8f53-a281923b5845 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:48.817138 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6ec22-9769-4a9c-8f53-a281923b5845 service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:48.817403 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6ec22-9769-4a9c-8f53-a281923b5845 service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:48.817672 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6ec22-9769-4a9c-8f53-a281923b5845 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:48.833303 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6ec22-9769-4a9c-8f53-a281923b5845 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:48.833303 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6ec22-9769-4a9c-8f53-a281923b5845 service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:48.841755 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1393/2765] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:06:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:06:49.093835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecabbb2-c047-4caf-a8b2-2e0cd0b5584f None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:49.121189 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecabbb2-c047-4caf-a8b2-2e0cd0b5584f None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:49.126107 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed3740-4b9f-4a5e-b32f-4ae96e6466e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:49.126890 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed3740-4b9f-4a5e-b32f-4ae96e6466e9 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:49.127175 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed3740-4b9f-4a5e-b32f-4ae96e6466e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:49.127446 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed3740-4b9f-4a5e-b32f-4ae96e6466e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:49.129685 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-7fed3740-4b9f-4a5e-b32f-4ae96e6466e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:49.236978 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed3740-4b9f-4a5e-b32f-4ae96e6466e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:49.238967 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed3740-4b9f-4a5e-b32f-4ae96e6466e9 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:49.249903 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1373/2766] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:06:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:06:49.297066 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:49.326381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:49.360468 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5d454-8614-4b50-8e2c-d9f48d3879cc None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:49.360779 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5d454-8614-4b50-8e2c-d9f48d3879cc None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:49.361090 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5d454-8614-4b50-8e2c-d9f48d3879cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:49.394185 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-faf5d454-8614-4b50-8e2c-d9f48d3879cc None None] MFA Rules not processed for user `80f6c99a2b5444a0a67c5708c3e46178`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:49.395456 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-faf5d454-8614-4b50-8e2c-d9f48d3879cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:49.475914 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1394/2767] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:06:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:49.489817 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed3740-4b9f-4a5e-b32f-4ae96e6466e9 service cinder] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:49.491423 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-7fed3740-4b9f-4a5e-b32f-4ae96e6466e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:49.553154 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed3740-4b9f-4a5e-b32f-4ae96e6466e9 service cinder] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:49.556835 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aab34b-9f51-4daf-864f-c5eb5a08b3e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7791be968594cea9c32b51a7b3454b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:49.557437 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aab34b-9f51-4daf-864f-c5eb5a08b3e9 service glance] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:49.557715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aab34b-9f51-4daf-864f-c5eb5a08b3e9 service glance] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:49.558029 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aab34b-9f51-4daf-864f-c5eb5a08b3e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:49.560337 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-33aab34b-9f51-4daf-864f-c5eb5a08b3e9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:49.625681 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aab34b-9f51-4daf-864f-c5eb5a08b3e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:49.635400 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aab34b-9f51-4daf-864f-c5eb5a08b3e9 service glance] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:49.639322 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1374/2768] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:06:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:06:49.925111 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f01863-a9b0-46cf-a38d-09832ba8b63b None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:49.926547 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f01863-a9b0-46cf-a38d-09832ba8b63b None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:49.927063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f01863-a9b0-46cf-a38d-09832ba8b63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:49.948997 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-b2f01863-a9b0-46cf-a38d-09832ba8b63b None None] MFA Rules not processed for user `d392c30328a3491bb186bd7b55f4d99c`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:06:49.951184 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-b2f01863-a9b0-46cf-a38d-09832ba8b63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:49.956983 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:50.014428 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1395/2769] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Aug 11 10:06:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:06:50.114467 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=100 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:06:50.177498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aab34b-9f51-4daf-864f-c5eb5a08b3e9 service glance] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:06:50.179054 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-33aab34b-9f51-4daf-864f-c5eb5a08b3e9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:06:50.253220 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aab34b-9f51-4daf-864f-c5eb5a08b3e9 service glance] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:06:50.258015 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad289e0-86fa-452c-95dd-32f98954957b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e3b1c5aec94673b391210ae51d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:06:50.258699 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad289e0-86fa-452c-95dd-32f98954957b service swift] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:06:50.259107 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad289e0-86fa-452c-95dd-32f98954957b service swift] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:06:50.259234 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad289e0-86fa-452c-95dd-32f98954957b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:06:50.269925 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad289e0-86fa-452c-95dd-32f98954957b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:06:50.272083 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad289e0-86fa-452c-95dd-32f98954957b service swift] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:06:50.283398 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1375/2770] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Aug 11 10:06:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 10:07:00.035166 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f01863-a9b0-46cf-a38d-09832ba8b63b None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:00.134975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f01863-a9b0-46cf-a38d-09832ba8b63b None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:00.141566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af28098-991c-424b-a542-4440ba8676ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:00.144893 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af28098-991c-424b-a542-4440ba8676ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:00.144893 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af28098-991c-424b-a542-4440ba8676ce admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:00.144893 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af28098-991c-424b-a542-4440ba8676ce admin admin] PATH_INFO: `/v3/users/504ad6d2029c4ddd804ae4ba133a238e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:00.144893 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af28098-991c-424b-a542-4440ba8676ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=504ad6d2029c4ddd804ae4ba133a238e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:00.145913 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af28098-991c-424b-a542-4440ba8676ce admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:00.313336 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=55 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:00.346762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-1af28098-991c-424b-a542-4440ba8676ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '504ad6d2029c4ddd804ae4ba133a238e'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:00.363462 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-1af28098-991c-424b-a542-4440ba8676ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '504ad6d2029c4ddd804ae4ba133a238e'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:00.363462 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-1af28098-991c-424b-a542-4440ba8676ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '504ad6d2029c4ddd804ae4ba133a238e'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:00.363462 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-1af28098-991c-424b-a542-4440ba8676ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '504ad6d2029c4ddd804ae4ba133a238e'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:00.367975 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-1af28098-991c-424b-a542-4440ba8676ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '504ad6d2029c4ddd804ae4ba133a238e'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:00.457503 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1396/2771] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:07:00 2022] DELETE /identity/v3/users/504ad6d2029c4ddd804ae4ba133a238e => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:00.462351 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df70cd9-a8ee-482e-98ea-a301337a570d None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:00.462631 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df70cd9-a8ee-482e-98ea-a301337a570d None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:00.462900 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df70cd9-a8ee-482e-98ea-a301337a570d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:00.482929 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-4df70cd9-a8ee-482e-98ea-a301337a570d None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:00.484151 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-4df70cd9-a8ee-482e-98ea-a301337a570d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:00.543961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1376/2772] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:07:00.554176 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af28098-991c-424b-a542-4440ba8676ce admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:00.555613 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-1af28098-991c-424b-a542-4440ba8676ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:00.591776 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:00.614000 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af28098-991c-424b-a542-4440ba8676ce admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:00.617673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d4a64-2c59-4f26-a9c1-096531de2fbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:00.618349 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d4a64-2c59-4f26-a9c1-096531de2fbe service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:00.618626 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d4a64-2c59-4f26-a9c1-096531de2fbe service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:00.618894 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d4a64-2c59-4f26-a9c1-096531de2fbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:00.628718 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d4a64-2c59-4f26-a9c1-096531de2fbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:00.630188 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d4a64-2c59-4f26-a9c1-096531de2fbe service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:00.640426 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1397/2773] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:07:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:07:01.002318 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e36d6-86bc-4e7b-a862-b7e4c26d5338 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:01.002605 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e36d6-86bc-4e7b-a862-b7e4c26d5338 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:01.002886 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e36d6-86bc-4e7b-a862-b7e4c26d5338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:01.026436 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-391e36d6-86bc-4e7b-a862-b7e4c26d5338 None None] MFA Rules not processed for user `56a3d8f90c8b4957b774d2d06b76d47c`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:01.027749 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-391e36d6-86bc-4e7b-a862-b7e4c26d5338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:01.092850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1377/2774] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:07:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:07:01.173435 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d4a64-2c59-4f26-a9c1-096531de2fbe service neutron] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:01.180497 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-bb8d4a64-2c59-4f26-a9c1-096531de2fbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:01.190648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d4a64-2c59-4f26-a9c1-096531de2fbe service neutron] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:01.196081 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bab590-b666-46a0-af84-a7848fc85009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:01.196828 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bab590-b666-46a0-af84-a7848fc85009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:01.197723 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bab590-b666-46a0-af84-a7848fc85009 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:01.198019 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bab590-b666-46a0-af84-a7848fc85009 admin admin] PATH_INFO: `/v3/projects/5f62ddf4881d45f9b891d45ca0093c6e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:01.201437 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bab590-b666-46a0-af84-a7848fc85009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f62ddf4881d45f9b891d45ca0093c6e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:01.203411 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bab590-b666-46a0-af84-a7848fc85009 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:01.334814 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f2bab590-b666-46a0-af84-a7848fc85009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f62ddf4881d45f9b891d45ca0093c6e', 'request_id': 'req-f2bab590-b666-46a0-af84-a7848fc85009'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:01.341220 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f2bab590-b666-46a0-af84-a7848fc85009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f62ddf4881d45f9b891d45ca0093c6e', 'request_id': 'req-f2bab590-b666-46a0-af84-a7848fc85009'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:01.416895 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f2bab590-b666-46a0-af84-a7848fc85009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f62ddf4881d45f9b891d45ca0093c6e', 'request_id': 'req-f2bab590-b666-46a0-af84-a7848fc85009'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:01.429268 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f2bab590-b666-46a0-af84-a7848fc85009 admin admin] The token cache is being invalidate because project 5f62ddf4881d45f9b891d45ca0093c6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:07:01.429557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f2bab590-b666-46a0-af84-a7848fc85009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:01.430224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f2bab590-b666-46a0-af84-a7848fc85009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:01.431705 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1398/2775] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:07:01 2022] DELETE /identity/v3/projects/5f62ddf4881d45f9b891d45ca0093c6e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:01.436247 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e36d6-86bc-4e7b-a862-b7e4c26d5338 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:01.449381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e36d6-86bc-4e7b-a862-b7e4c26d5338 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:01.510202 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e03ec3-c367-4684-abd8-25870a58cf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:01.510830 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e03ec3-c367-4684-abd8-25870a58cf87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:01.511105 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e03ec3-c367-4684-abd8-25870a58cf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:01.511373 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e03ec3-c367-4684-abd8-25870a58cf87 admin admin] PATH_INFO: `/v3/users/588a0d6ef26f476995d7631d48cc537e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:01.513100 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e03ec3-c367-4684-abd8-25870a58cf87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=588a0d6ef26f476995d7631d48cc537e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:01.515061 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e03ec3-c367-4684-abd8-25870a58cf87 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:01.693149 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c7e03ec3-c367-4684-abd8-25870a58cf87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '588a0d6ef26f476995d7631d48cc537e'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:01.695117 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:01.705819 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c7e03ec3-c367-4684-abd8-25870a58cf87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '588a0d6ef26f476995d7631d48cc537e'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:01.706588 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c7e03ec3-c367-4684-abd8-25870a58cf87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '588a0d6ef26f476995d7631d48cc537e'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:01.713621 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c7e03ec3-c367-4684-abd8-25870a58cf87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '588a0d6ef26f476995d7631d48cc537e'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:01.803998 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c7e03ec3-c367-4684-abd8-25870a58cf87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '588a0d6ef26f476995d7631d48cc537e'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:01.823089 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1378/2776] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:07:01 2022] DELETE /identity/v3/users/588a0d6ef26f476995d7631d48cc537e => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:02.245629 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bab590-b666-46a0-af84-a7848fc85009 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:02.247660 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-f2bab590-b666-46a0-af84-a7848fc85009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:02.263258 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bab590-b666-46a0-af84-a7848fc85009 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:02.325289 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38014ec-608f-48e1-95a0-f0fb0e623942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:02.325631 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38014ec-608f-48e1-95a0-f0fb0e623942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:02.326029 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38014ec-608f-48e1-95a0-f0fb0e623942 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:02.326254 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38014ec-608f-48e1-95a0-f0fb0e623942 admin admin] PATH_INFO: `/v3/projects/d0d85057201147bb9a000da6a14427be` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:02.327533 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38014ec-608f-48e1-95a0-f0fb0e623942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0d85057201147bb9a000da6a14427be)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:02.329625 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38014ec-608f-48e1-95a0-f0fb0e623942 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:02.458487 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-a38014ec-608f-48e1-95a0-f0fb0e623942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0d85057201147bb9a000da6a14427be', 'request_id': 'req-a38014ec-608f-48e1-95a0-f0fb0e623942'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:02.464000 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-a38014ec-608f-48e1-95a0-f0fb0e623942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0d85057201147bb9a000da6a14427be', 'request_id': 'req-a38014ec-608f-48e1-95a0-f0fb0e623942'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:02.467375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:02.559834 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-a38014ec-608f-48e1-95a0-f0fb0e623942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0d85057201147bb9a000da6a14427be', 'request_id': 'req-a38014ec-608f-48e1-95a0-f0fb0e623942'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:02.577210 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-a38014ec-608f-48e1-95a0-f0fb0e623942 admin admin] The token cache is being invalidate because project d0d85057201147bb9a000da6a14427be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:07:02.577503 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-a38014ec-608f-48e1-95a0-f0fb0e623942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:02.578202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-a38014ec-608f-48e1-95a0-f0fb0e623942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:02.580414 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1399/2777] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:07:02 2022] DELETE /identity/v3/projects/d0d85057201147bb9a000da6a14427be => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:02.585478 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a6658-a1c3-431f-b92e-f2de5abd07f4 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:02.586588 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a6658-a1c3-431f-b92e-f2de5abd07f4 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:02.587448 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a6658-a1c3-431f-b92e-f2de5abd07f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:02.739511 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-7b5a6658-a1c3-431f-b92e-f2de5abd07f4 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:02.739511 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-7b5a6658-a1c3-431f-b92e-f2de5abd07f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:02.804461 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1379/2778] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:07:02.815160 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63561e7a-8895-4c1e-8ab0-6aa8195ba7fa None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:02.815452 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63561e7a-8895-4c1e-8ab0-6aa8195ba7fa None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:02.815728 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63561e7a-8895-4c1e-8ab0-6aa8195ba7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:02.836911 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-63561e7a-8895-4c1e-8ab0-6aa8195ba7fa None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:02.838473 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-63561e7a-8895-4c1e-8ab0-6aa8195ba7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:02.847556 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1400/2779] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:07:02.852037 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a6658-a1c3-431f-b92e-f2de5abd07f4 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:02.862423 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a6658-a1c3-431f-b92e-f2de5abd07f4 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:02.867289 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71078185-bcc2-4f52-9bca-031ff3ca5794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:02.867886 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71078185-bcc2-4f52-9bca-031ff3ca5794 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:02.868158 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71078185-bcc2-4f52-9bca-031ff3ca5794 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:02.868421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71078185-bcc2-4f52-9bca-031ff3ca5794 admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:02.869249 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71078185-bcc2-4f52-9bca-031ff3ca5794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:07:02.869549 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71078185-bcc2-4f52-9bca-031ff3ca5794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:02.871164 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71078185-bcc2-4f52-9bca-031ff3ca5794 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:02.884034 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1380/2780] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:07:02.888725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63561e7a-8895-4c1e-8ab0-6aa8195ba7fa None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:02.898363 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63561e7a-8895-4c1e-8ab0-6aa8195ba7fa None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:02.907485 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425d9ba-dd20-4f92-9ca5-f3c0b7ffcd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:02.908661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425d9ba-dd20-4f92-9ca5-f3c0b7ffcd7b admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:02.908661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425d9ba-dd20-4f92-9ca5-f3c0b7ffcd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:02.908860 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425d9ba-dd20-4f92-9ca5-f3c0b7ffcd7b admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:02.909592 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425d9ba-dd20-4f92-9ca5-f3c0b7ffcd7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:02.911599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425d9ba-dd20-4f92-9ca5-f3c0b7ffcd7b admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:03.039790 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1401/2781] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:07:02 2022] POST /identity/v3/projects => generated 361 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:07:03.044630 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71078185-bcc2-4f52-9bca-031ff3ca5794 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:03.054486 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71078185-bcc2-4f52-9bca-031ff3ca5794 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:03.110167 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7498d-284d-4321-ada2-7b26f5477cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:03.110763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7498d-284d-4321-ada2-7b26f5477cbf admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:03.111040 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7498d-284d-4321-ada2-7b26f5477cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:03.111308 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7498d-284d-4321-ada2-7b26f5477cbf admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:03.111963 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7498d-284d-4321-ada2-7b26f5477cbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:03.113856 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7498d-284d-4321-ada2-7b26f5477cbf admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:03.211704 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1381/2782] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:07:03 2022] POST /identity/v3/users => generated 281 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:07:03.215798 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425d9ba-dd20-4f92-9ca5-f3c0b7ffcd7b admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:03.225930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425d9ba-dd20-4f92-9ca5-f3c0b7ffcd7b admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:03.230578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cd588-a6b6-435f-a98e-9c6cf26bd9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:03.231732 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cd588-a6b6-435f-a98e-9c6cf26bd9da admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:03.232005 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cd588-a6b6-435f-a98e-9c6cf26bd9da admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:03.232410 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cd588-a6b6-435f-a98e-9c6cf26bd9da admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:03.232929 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cd588-a6b6-435f-a98e-9c6cf26bd9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:03.234580 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cd588-a6b6-435f-a98e-9c6cf26bd9da admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:03.244389 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1402/2783] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:07:03.248905 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7498d-284d-4321-ada2-7b26f5477cbf admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:03.258942 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7498d-284d-4321-ada2-7b26f5477cbf admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:03.263520 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98bb32-1349-44e1-8233-2cb0eb1de408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:03.264108 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98bb32-1349-44e1-8233-2cb0eb1de408 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:03.264383 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98bb32-1349-44e1-8233-2cb0eb1de408 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:03.264649 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98bb32-1349-44e1-8233-2cb0eb1de408 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:03.265327 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98bb32-1349-44e1-8233-2cb0eb1de408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:03.267144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98bb32-1349-44e1-8233-2cb0eb1de408 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:03.277071 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1382/2784] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:07:03.281653 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cd588-a6b6-435f-a98e-9c6cf26bd9da admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:03.292292 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cd588-a6b6-435f-a98e-9c6cf26bd9da admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:03.297521 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01f754-3466-46fa-873c-ed358d4d1621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:03.298224 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01f754-3466-46fa-873c-ed358d4d1621 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:03.298503 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01f754-3466-46fa-873c-ed358d4d1621 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:03.298774 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01f754-3466-46fa-873c-ed358d4d1621 admin admin] PATH_INFO: `/v3/projects/33adcd7e0aa34623918ca872428956aa/users/2003255b3d7e455599d945e869405beb/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:03.316302 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01f754-3466-46fa-873c-ed358d4d1621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33adcd7e0aa34623918ca872428956aa, user_id=2003255b3d7e455599d945e869405beb, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:03.319065 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01f754-3466-46fa-873c-ed358d4d1621 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:03.389011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1403/2785] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:07:03 2022] PUT /identity/v3/projects/33adcd7e0aa34623918ca872428956aa/users/2003255b3d7e455599d945e869405beb/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:03.399472 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4d3d9-3c9f-42ff-b2db-5dca2665c5e9 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:03.399776 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4d3d9-3c9f-42ff-b2db-5dca2665c5e9 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:03.400056 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4d3d9-3c9f-42ff-b2db-5dca2665c5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:03.427720 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-9ed4d3d9-3c9f-42ff-b2db-5dca2665c5e9 None None] MFA Rules not processed for user `2003255b3d7e455599d945e869405beb`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:03.428926 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-9ed4d3d9-3c9f-42ff-b2db-5dca2665c5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:03.447429 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:03.497306 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1383/2786] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:07:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:07:03.506597 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01f754-3466-46fa-873c-ed358d4d1621 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:03.571798 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01f754-3466-46fa-873c-ed358d4d1621 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:03.577007 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a475e0-de55-4d43-86d7-499c7b2f5d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:03.577599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a475e0-de55-4d43-86d7-499c7b2f5d31 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:03.577870 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a475e0-de55-4d43-86d7-499c7b2f5d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:03.578166 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a475e0-de55-4d43-86d7-499c7b2f5d31 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:03.578774 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a475e0-de55-4d43-86d7-499c7b2f5d31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:03.580648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a475e0-de55-4d43-86d7-499c7b2f5d31 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:03.687366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1404/2787] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:07:03 2022] POST /identity/v3/projects => generated 365 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:07:03.691211 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4d3d9-3c9f-42ff-b2db-5dca2665c5e9 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:03.701994 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4d3d9-3c9f-42ff-b2db-5dca2665c5e9 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:03.757691 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd91f8b-87e9-40f3-9cc7-c7828e6be453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:03.758253 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd91f8b-87e9-40f3-9cc7-c7828e6be453 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:03.758532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd91f8b-87e9-40f3-9cc7-c7828e6be453 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:03.758800 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd91f8b-87e9-40f3-9cc7-c7828e6be453 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:03.759424 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd91f8b-87e9-40f3-9cc7-c7828e6be453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:03.761309 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd91f8b-87e9-40f3-9cc7-c7828e6be453 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:03.851633 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1384/2788] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:07:03 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:07:03.855698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a475e0-de55-4d43-86d7-499c7b2f5d31 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:03.866781 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a475e0-de55-4d43-86d7-499c7b2f5d31 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:03.871389 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817ff6c-b2cf-477f-a4be-a71838450fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:03.871984 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817ff6c-b2cf-477f-a4be-a71838450fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:03.872259 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817ff6c-b2cf-477f-a4be-a71838450fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:03.872529 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817ff6c-b2cf-477f-a4be-a71838450fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:03.873160 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817ff6c-b2cf-477f-a4be-a71838450fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:03.874772 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817ff6c-b2cf-477f-a4be-a71838450fc7 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:03.885433 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1405/2789] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:07:03.889651 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd91f8b-87e9-40f3-9cc7-c7828e6be453 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:03.900242 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd91f8b-87e9-40f3-9cc7-c7828e6be453 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:03.905381 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f3353-f65e-476a-bc1d-f5ae6cde4056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:03.906019 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f3353-f65e-476a-bc1d-f5ae6cde4056 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:03.906323 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f3353-f65e-476a-bc1d-f5ae6cde4056 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:03.908898 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f3353-f65e-476a-bc1d-f5ae6cde4056 admin admin] PATH_INFO: `/v3/projects/706324154684417c910bbd64efe26657/users/a15362d18d98466b903ab4b4466627f9/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:03.921556 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f3353-f65e-476a-bc1d-f5ae6cde4056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=706324154684417c910bbd64efe26657, user_id=a15362d18d98466b903ab4b4466627f9, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:03.924617 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f3353-f65e-476a-bc1d-f5ae6cde4056 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:04.074988 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1385/2790] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:07:03 2022] PUT /identity/v3/projects/706324154684417c910bbd64efe26657/users/a15362d18d98466b903ab4b4466627f9/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:04.079165 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817ff6c-b2cf-477f-a4be-a71838450fc7 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:04.089308 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817ff6c-b2cf-477f-a4be-a71838450fc7 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:04.145846 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4d2ad-d349-40eb-9991-6f5bc4958f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:04.146482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4d2ad-d349-40eb-9991-6f5bc4958f16 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:04.146760 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4d2ad-d349-40eb-9991-6f5bc4958f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:04.147032 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4d2ad-d349-40eb-9991-6f5bc4958f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:04.147678 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4d2ad-d349-40eb-9991-6f5bc4958f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:04.149263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4d2ad-d349-40eb-9991-6f5bc4958f16 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:04.150578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:04.159684 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1406/2791] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:07:04.164068 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f3353-f65e-476a-bc1d-f5ae6cde4056 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:04.174730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f3353-f65e-476a-bc1d-f5ae6cde4056 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:04.179363 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376c81f-491e-484c-ba12-84961fbd385a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:04.180017 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376c81f-491e-484c-ba12-84961fbd385a admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:04.183378 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376c81f-491e-484c-ba12-84961fbd385a admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:04.183378 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376c81f-491e-484c-ba12-84961fbd385a admin admin] PATH_INFO: `/v3/projects/706324154684417c910bbd64efe26657/users/a15362d18d98466b903ab4b4466627f9/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:04.183378 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376c81f-491e-484c-ba12-84961fbd385a admin admin] RBAC: Authorizing `identity:create_grant(project_id=706324154684417c910bbd64efe26657, user_id=a15362d18d98466b903ab4b4466627f9, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:04.185756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376c81f-491e-484c-ba12-84961fbd385a admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:04.197077 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1386/2792] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:07:04 2022] PUT /identity/v3/projects/706324154684417c910bbd64efe26657/users/a15362d18d98466b903ab4b4466627f9/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:04.207282 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05769f55-1878-4e19-89f7-11cda46f810a None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:04.207567 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05769f55-1878-4e19-89f7-11cda46f810a None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:04.207852 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05769f55-1878-4e19-89f7-11cda46f810a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:04.238306 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-05769f55-1878-4e19-89f7-11cda46f810a None None] MFA Rules not processed for user `a15362d18d98466b903ab4b4466627f9`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:04.239568 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-05769f55-1878-4e19-89f7-11cda46f810a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:04.325910 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1407/2793] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:07:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:07:04.343229 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376c81f-491e-484c-ba12-84961fbd385a admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:04.345076 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-1376c81f-491e-484c-ba12-84961fbd385a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:04.437446 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8cd3d-018d-4224-9a3f-46acf10b66d5 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:04.437722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8cd3d-018d-4224-9a3f-46acf10b66d5 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:04.438036 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8cd3d-018d-4224-9a3f-46acf10b66d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:04.440817 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376c81f-491e-484c-ba12-84961fbd385a admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:04.444435 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f16266-31cd-48f3-8006-e87ddcc8d148 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:04.445036 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f16266-31cd-48f3-8006-e87ddcc8d148 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:04.445365 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f16266-31cd-48f3-8006-e87ddcc8d148 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:04.445642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f16266-31cd-48f3-8006-e87ddcc8d148 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:04.458679 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-5cd8cd3d-018d-4224-9a3f-46acf10b66d5 None None] MFA Rules not processed for user `d392c30328a3491bb186bd7b55f4d99c`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:04.459968 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-5cd8cd3d-018d-4224-9a3f-46acf10b66d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:04.464316 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:04.477176 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f16266-31cd-48f3-8006-e87ddcc8d148 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:04.478674 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f16266-31cd-48f3-8006-e87ddcc8d148 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:04.490930 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1387/2794] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:07:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:07:04.519130 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1408/2795] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Aug 11 10:07:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:07:04.533652 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f16266-31cd-48f3-8006-e87ddcc8d148 service cinder] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:04.535142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-96f16266-31cd-48f3-8006-e87ddcc8d148 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:04.607842 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f16266-31cd-48f3-8006-e87ddcc8d148 service cinder] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:04.612995 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fddd51-d861-4595-b482-493e8038759c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e3b1c5aec94673b391210ae51d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:04.613603 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fddd51-d861-4595-b482-493e8038759c service swift] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:04.613877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fddd51-d861-4595-b482-493e8038759c service swift] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:04.614172 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fddd51-d861-4595-b482-493e8038759c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:04.625142 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fddd51-d861-4595-b482-493e8038759c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:04.627102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fddd51-d861-4595-b482-493e8038759c service swift] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:04.636095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1388/2796] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Aug 11 10:07:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 10:07:04.774269 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8cd3d-018d-4224-9a3f-46acf10b66d5 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:04.810299 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8cd3d-018d-4224-9a3f-46acf10b66d5 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:04.814798 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bac88c-99e2-494a-b4b0-ad5bbcbdc24c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:04.815989 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bac88c-99e2-494a-b4b0-ad5bbcbdc24c service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:04.816581 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bac88c-99e2-494a-b4b0-ad5bbcbdc24c service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:04.817103 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bac88c-99e2-494a-b4b0-ad5bbcbdc24c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:04.905090 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bac88c-99e2-494a-b4b0-ad5bbcbdc24c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:04.907166 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bac88c-99e2-494a-b4b0-ad5bbcbdc24c service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:04.915582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795e5d6-75f5-42cc-b78a-3cc70d8913a2 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:04.916951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795e5d6-75f5-42cc-b78a-3cc70d8913a2 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:04.917467 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795e5d6-75f5-42cc-b78a-3cc70d8913a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:04.922558 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1409/2797] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:07:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:07:04.952439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-5795e5d6-75f5-42cc-b78a-3cc70d8913a2 None None] MFA Rules not processed for user `d392c30328a3491bb186bd7b55f4d99c`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:04.958992 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-5795e5d6-75f5-42cc-b78a-3cc70d8913a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:04.992259 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1389/2798] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Aug 11 10:07:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:07:05.009410 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bac88c-99e2-494a-b4b0-ad5bbcbdc24c service cinder] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:05.035508 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bac88c-99e2-494a-b4b0-ad5bbcbdc24c service cinder] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:05.044443 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb7f56-c3f1-4023-8afd-ba4cd6b30acc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e3b1c5aec94673b391210ae51d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:05.046251 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb7f56-c3f1-4023-8afd-ba4cd6b30acc service swift] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:05.046763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb7f56-c3f1-4023-8afd-ba4cd6b30acc service swift] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:05.047128 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb7f56-c3f1-4023-8afd-ba4cd6b30acc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:05.069191 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb7f56-c3f1-4023-8afd-ba4cd6b30acc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:05.071369 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb7f56-c3f1-4023-8afd-ba4cd6b30acc service swift] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:05.093146 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1410/2799] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Aug 11 10:07:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 10:07:08.986642 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795e5d6-75f5-42cc-b78a-3cc70d8913a2 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:09.143806 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795e5d6-75f5-42cc-b78a-3cc70d8913a2 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:09.148624 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa30a2-f8ba-4cf7-b143-b9efbe2ffc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:09.149262 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa30a2-f8ba-4cf7-b143-b9efbe2ffc78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:09.149532 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa30a2-f8ba-4cf7-b143-b9efbe2ffc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:09.149796 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa30a2-f8ba-4cf7-b143-b9efbe2ffc78 admin admin] PATH_INFO: `/v3/users/2003255b3d7e455599d945e869405beb` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:09.152189 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa30a2-f8ba-4cf7-b143-b9efbe2ffc78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2003255b3d7e455599d945e869405beb)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:09.152994 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa30a2-f8ba-4cf7-b143-b9efbe2ffc78 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:09.360907 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:09.384735 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-e7fa30a2-f8ba-4cf7-b143-b9efbe2ffc78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2003255b3d7e455599d945e869405beb'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:09.411637 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-e7fa30a2-f8ba-4cf7-b143-b9efbe2ffc78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2003255b3d7e455599d945e869405beb'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:09.413178 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-e7fa30a2-f8ba-4cf7-b143-b9efbe2ffc78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2003255b3d7e455599d945e869405beb'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:09.428112 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-e7fa30a2-f8ba-4cf7-b143-b9efbe2ffc78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2003255b3d7e455599d945e869405beb'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:09.514439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-e7fa30a2-f8ba-4cf7-b143-b9efbe2ffc78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2003255b3d7e455599d945e869405beb'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:09.529784 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1390/2800] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:07:08 2022] DELETE /identity/v3/users/2003255b3d7e455599d945e869405beb => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:09.535841 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcb7f5-06c3-4d38-b2c5-d03530bd792a None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:09.536367 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcb7f5-06c3-4d38-b2c5-d03530bd792a None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:09.536367 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcb7f5-06c3-4d38-b2c5-d03530bd792a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:09.547029 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:09.611661 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-31bcb7f5-06c3-4d38-b2c5-d03530bd792a None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:09.613345 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-31bcb7f5-06c3-4d38-b2c5-d03530bd792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:09.756477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1411/2801] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:07:09.763524 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa30a2-f8ba-4cf7-b143-b9efbe2ffc78 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:09.765133 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-e7fa30a2-f8ba-4cf7-b143-b9efbe2ffc78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:09.892308 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa30a2-f8ba-4cf7-b143-b9efbe2ffc78 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:09.896863 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371f416-387b-4f91-b72e-03a7b329db81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:09.897880 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371f416-387b-4f91-b72e-03a7b329db81 service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:09.898410 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371f416-387b-4f91-b72e-03a7b329db81 service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:09.898848 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371f416-387b-4f91-b72e-03a7b329db81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:09.916169 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371f416-387b-4f91-b72e-03a7b329db81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:09.919705 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371f416-387b-4f91-b72e-03a7b329db81 service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:09.931913 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1391/2802] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:07:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:07:10.821064 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcb7f5-06c3-4d38-b2c5-d03530bd792a None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:10.823718 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-31bcb7f5-06c3-4d38-b2c5-d03530bd792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:10.846282 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcb7f5-06c3-4d38-b2c5-d03530bd792a None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:10.853710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298edf52-85d1-49a7-9842-04031c927dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:10.854400 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298edf52-85d1-49a7-9842-04031c927dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:10.854677 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298edf52-85d1-49a7-9842-04031c927dce admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:10.854950 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298edf52-85d1-49a7-9842-04031c927dce admin admin] PATH_INFO: `/v3/projects/33adcd7e0aa34623918ca872428956aa` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:10.857871 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298edf52-85d1-49a7-9842-04031c927dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=33adcd7e0aa34623918ca872428956aa)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:10.861237 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298edf52-85d1-49a7-9842-04031c927dce admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:11.049328 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-298edf52-85d1-49a7-9842-04031c927dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33adcd7e0aa34623918ca872428956aa', 'request_id': 'req-298edf52-85d1-49a7-9842-04031c927dce'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:11.063356 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-298edf52-85d1-49a7-9842-04031c927dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33adcd7e0aa34623918ca872428956aa', 'request_id': 'req-298edf52-85d1-49a7-9842-04031c927dce'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:11.147473 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-298edf52-85d1-49a7-9842-04031c927dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33adcd7e0aa34623918ca872428956aa', 'request_id': 'req-298edf52-85d1-49a7-9842-04031c927dce'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:11.170843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-298edf52-85d1-49a7-9842-04031c927dce admin admin] The token cache is being invalidate because project 33adcd7e0aa34623918ca872428956aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:07:11.171157 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-298edf52-85d1-49a7-9842-04031c927dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:11.171852 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-298edf52-85d1-49a7-9842-04031c927dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:11.173557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1412/2803] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:07:10 2022] DELETE /identity/v3/projects/33adcd7e0aa34623918ca872428956aa => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:11.177941 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371f416-387b-4f91-b72e-03a7b329db81 service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:11.195075 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371f416-387b-4f91-b72e-03a7b329db81 service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:11.312079 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fc987-3aa4-47d4-bf57-78b825cceba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:11.312079 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fc987-3aa4-47d4-bf57-78b825cceba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:11.312079 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fc987-3aa4-47d4-bf57-78b825cceba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:11.312079 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fc987-3aa4-47d4-bf57-78b825cceba1 admin admin] PATH_INFO: `/v3/users/a15362d18d98466b903ab4b4466627f9` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:11.312519 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fc987-3aa4-47d4-bf57-78b825cceba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a15362d18d98466b903ab4b4466627f9)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:11.314731 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fc987-3aa4-47d4-bf57-78b825cceba1 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:12.384852 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-f15fc987-3aa4-47d4-bf57-78b825cceba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a15362d18d98466b903ab4b4466627f9'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:12.392512 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:12.397728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-f15fc987-3aa4-47d4-bf57-78b825cceba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a15362d18d98466b903ab4b4466627f9'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:12.398443 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-f15fc987-3aa4-47d4-bf57-78b825cceba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a15362d18d98466b903ab4b4466627f9'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:12.406668 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-f15fc987-3aa4-47d4-bf57-78b825cceba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a15362d18d98466b903ab4b4466627f9'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:12.508721 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-f15fc987-3aa4-47d4-bf57-78b825cceba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a15362d18d98466b903ab4b4466627f9'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:12.515948 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1392/2804] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:07:11 2022] DELETE /identity/v3/users/a15362d18d98466b903ab4b4466627f9 => generated 0 bytes in 1339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:07:13.412679 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298edf52-85d1-49a7-9842-04031c927dce admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:13.415209 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-298edf52-85d1-49a7-9842-04031c927dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:13.440705 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298edf52-85d1-49a7-9842-04031c927dce admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:13.547847 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b984e4-61ec-471d-99a8-4208c1695ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:13.548915 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b984e4-61ec-471d-99a8-4208c1695ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:13.549511 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b984e4-61ec-471d-99a8-4208c1695ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:13.549941 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b984e4-61ec-471d-99a8-4208c1695ac5 admin admin] PATH_INFO: `/v3/projects/706324154684417c910bbd64efe26657` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:13.551259 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b984e4-61ec-471d-99a8-4208c1695ac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=706324154684417c910bbd64efe26657)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:13.560457 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b984e4-61ec-471d-99a8-4208c1695ac5 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:13.613772 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:13.799616 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e5b984e4-61ec-471d-99a8-4208c1695ac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '706324154684417c910bbd64efe26657', 'request_id': 'req-e5b984e4-61ec-471d-99a8-4208c1695ac5'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:13.818525 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e5b984e4-61ec-471d-99a8-4208c1695ac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '706324154684417c910bbd64efe26657', 'request_id': 'req-e5b984e4-61ec-471d-99a8-4208c1695ac5'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:13.886053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e5b984e4-61ec-471d-99a8-4208c1695ac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '706324154684417c910bbd64efe26657', 'request_id': 'req-e5b984e4-61ec-471d-99a8-4208c1695ac5'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:13.902528 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e5b984e4-61ec-471d-99a8-4208c1695ac5 admin admin] The token cache is being invalidate because project 706324154684417c910bbd64efe26657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:07:13.903824 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e5b984e4-61ec-471d-99a8-4208c1695ac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:13.904853 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-e5b984e4-61ec-471d-99a8-4208c1695ac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:13.912353 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1413/2805] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:07:13 2022] DELETE /identity/v3/projects/706324154684417c910bbd64efe26657 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:13.912550 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeda7fc-433a-49f5-9e28-541500bbf55a None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:13.913052 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeda7fc-433a-49f5-9e28-541500bbf55a None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:13.913144 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeda7fc-433a-49f5-9e28-541500bbf55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:13.975665 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-eaeda7fc-433a-49f5-9e28-541500bbf55a None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:13.977025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-eaeda7fc-433a-49f5-9e28-541500bbf55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:14.050378 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1393/2806] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:07:14.060584 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77d71e-0fc2-4a9e-9754-2e2688fe7605 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:14.061427 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77d71e-0fc2-4a9e-9754-2e2688fe7605 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:14.061774 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77d71e-0fc2-4a9e-9754-2e2688fe7605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:14.092811 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-1a77d71e-0fc2-4a9e-9754-2e2688fe7605 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:14.094190 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-1a77d71e-0fc2-4a9e-9754-2e2688fe7605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:14.109865 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1414/2807] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:07:14.110115 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeda7fc-433a-49f5-9e28-541500bbf55a None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:14.120680 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeda7fc-433a-49f5-9e28-541500bbf55a None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:14.140638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0adaaef-7976-4513-a84f-1c0cd78e305a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:14.140638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adaaef-7976-4513-a84f-1c0cd78e305a admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:14.140987 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adaaef-7976-4513-a84f-1c0cd78e305a admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:14.141089 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adaaef-7976-4513-a84f-1c0cd78e305a admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:14.141766 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adaaef-7976-4513-a84f-1c0cd78e305a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:07:14.142067 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adaaef-7976-4513-a84f-1c0cd78e305a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:14.143898 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adaaef-7976-4513-a84f-1c0cd78e305a admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:14.165556 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1394/2808] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:07:14.171490 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77d71e-0fc2-4a9e-9754-2e2688fe7605 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:14.184817 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77d71e-0fc2-4a9e-9754-2e2688fe7605 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:14.195703 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609acd7-abc8-4260-b02b-0a207257d85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:14.196638 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609acd7-abc8-4260-b02b-0a207257d85e admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:14.197064 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609acd7-abc8-4260-b02b-0a207257d85e admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:14.197653 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609acd7-abc8-4260-b02b-0a207257d85e admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:14.198821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609acd7-abc8-4260-b02b-0a207257d85e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:14.201589 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609acd7-abc8-4260-b02b-0a207257d85e admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:14.651315 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1415/2809] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:07:14 2022] POST /identity/v3/projects => generated 387 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:07:14.661368 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0adaaef-7976-4513-a84f-1c0cd78e305a admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:14.672297 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0adaaef-7976-4513-a84f-1c0cd78e305a admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:14.788240 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f688d7-6c0e-4705-8631-319028bbb68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:14.789027 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f688d7-6c0e-4705-8631-319028bbb68c admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:14.789225 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f688d7-6c0e-4705-8631-319028bbb68c admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:14.789502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f688d7-6c0e-4705-8631-319028bbb68c admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:14.790332 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f688d7-6c0e-4705-8631-319028bbb68c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:14.792392 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f688d7-6c0e-4705-8631-319028bbb68c admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:14.888867 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1395/2810] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:07:14 2022] POST /identity/v3/users => generated 294 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:07:14.893679 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609acd7-abc8-4260-b02b-0a207257d85e admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:14.910676 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609acd7-abc8-4260-b02b-0a207257d85e admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:14.927391 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb2ab2-6b53-41af-adf7-f0bbdb7efd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:14.929110 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb2ab2-6b53-41af-adf7-f0bbdb7efd87 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:14.930123 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb2ab2-6b53-41af-adf7-f0bbdb7efd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:14.935761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb2ab2-6b53-41af-adf7-f0bbdb7efd87 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:14.935761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb2ab2-6b53-41af-adf7-f0bbdb7efd87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:14.935761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb2ab2-6b53-41af-adf7-f0bbdb7efd87 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:14.953542 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1416/2811] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:07:14.957398 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f688d7-6c0e-4705-8631-319028bbb68c admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:14.975188 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f688d7-6c0e-4705-8631-319028bbb68c admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:14.984223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6c34c-680f-4eae-8763-d2f165e10d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:14.986012 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6c34c-680f-4eae-8763-d2f165e10d14 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:14.986982 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6c34c-680f-4eae-8763-d2f165e10d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:14.987585 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6c34c-680f-4eae-8763-d2f165e10d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:14.989302 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6c34c-680f-4eae-8763-d2f165e10d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:14.991637 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6c34c-680f-4eae-8763-d2f165e10d14 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:15.009689 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1396/2812] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:07:15.014674 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb2ab2-6b53-41af-adf7-f0bbdb7efd87 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:15.042564 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb2ab2-6b53-41af-adf7-f0bbdb7efd87 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:15.059782 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d503db8-dff1-4659-86eb-0d27a5ed6cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:15.061768 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d503db8-dff1-4659-86eb-0d27a5ed6cba admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:15.062430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d503db8-dff1-4659-86eb-0d27a5ed6cba admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:15.062914 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d503db8-dff1-4659-86eb-0d27a5ed6cba admin admin] PATH_INFO: `/v3/projects/eeccc19d948944baa489c382449d4624/users/f31b943564c14834833432af6c61a015/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:15.110615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d503db8-dff1-4659-86eb-0d27a5ed6cba admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeccc19d948944baa489c382449d4624, user_id=f31b943564c14834833432af6c61a015, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:15.114124 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d503db8-dff1-4659-86eb-0d27a5ed6cba admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:15.189082 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1417/2813] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:07:15 2022] PUT /identity/v3/projects/eeccc19d948944baa489c382449d4624/users/f31b943564c14834833432af6c61a015/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:07:15.199701 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeadd5b-1b3f-4ecc-a23a-6c3d1bc28c13 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:15.200374 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeadd5b-1b3f-4ecc-a23a-6c3d1bc28c13 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:15.201073 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeadd5b-1b3f-4ecc-a23a-6c3d1bc28c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:15.265494 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-cfeadd5b-1b3f-4ecc-a23a-6c3d1bc28c13 None None] MFA Rules not processed for user `f31b943564c14834833432af6c61a015`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:15.267247 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-cfeadd5b-1b3f-4ecc-a23a-6c3d1bc28c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:15.277648 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:15.389708 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1397/2814] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:07:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:07:15.390979 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d503db8-dff1-4659-86eb-0d27a5ed6cba admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:15.503009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d503db8-dff1-4659-86eb-0d27a5ed6cba admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:15.509857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66abd58-c19f-4abd-a186-97f0985a32ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:15.514430 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66abd58-c19f-4abd-a186-97f0985a32ff admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:15.515479 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66abd58-c19f-4abd-a186-97f0985a32ff admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:15.516226 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66abd58-c19f-4abd-a186-97f0985a32ff admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:15.517646 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66abd58-c19f-4abd-a186-97f0985a32ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:15.519864 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66abd58-c19f-4abd-a186-97f0985a32ff admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:15.612431 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeadd5b-1b3f-4ecc-a23a-6c3d1bc28c13 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:15.618562 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1418/2815] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:07:15 2022] POST /identity/v3/projects => generated 387 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:07:15.626375 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeadd5b-1b3f-4ecc-a23a-6c3d1bc28c13 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:15.759624 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cb266-275f-4cfc-913f-3c52d9938714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:15.761326 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cb266-275f-4cfc-913f-3c52d9938714 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:15.761975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cb266-275f-4cfc-913f-3c52d9938714 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:15.763391 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cb266-275f-4cfc-913f-3c52d9938714 admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:15.764730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29cb266-275f-4cfc-913f-3c52d9938714 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:15.767889 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29cb266-275f-4cfc-913f-3c52d9938714 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:15.850148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1398/2816] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:07:15 2022] POST /identity/v3/users => generated 294 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:07:15.855529 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66abd58-c19f-4abd-a186-97f0985a32ff admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:15.874609 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66abd58-c19f-4abd-a186-97f0985a32ff admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:15.885964 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77aa1e8-7964-444f-a5ef-e3e7da76d363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:15.886645 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aa1e8-7964-444f-a5ef-e3e7da76d363 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:15.886935 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aa1e8-7964-444f-a5ef-e3e7da76d363 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:15.887762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aa1e8-7964-444f-a5ef-e3e7da76d363 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:15.888438 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77aa1e8-7964-444f-a5ef-e3e7da76d363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:15.890050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77aa1e8-7964-444f-a5ef-e3e7da76d363 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:15.911521 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1419/2817] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:07:15.915474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cb266-275f-4cfc-913f-3c52d9938714 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:15.928093 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cb266-275f-4cfc-913f-3c52d9938714 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:15.933884 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf249fb1-ccae-417d-92d5-a2223bab01ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:15.935074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf249fb1-ccae-417d-92d5-a2223bab01ce admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:15.936105 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf249fb1-ccae-417d-92d5-a2223bab01ce admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:15.936420 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf249fb1-ccae-417d-92d5-a2223bab01ce admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:15.937105 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf249fb1-ccae-417d-92d5-a2223bab01ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:15.938786 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf249fb1-ccae-417d-92d5-a2223bab01ce admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:15.950934 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1399/2818] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:07:15.955263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77aa1e8-7964-444f-a5ef-e3e7da76d363 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:15.968994 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77aa1e8-7964-444f-a5ef-e3e7da76d363 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:15.975761 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca0be2-3703-4070-a31d-8a85c7384851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:15.976559 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca0be2-3703-4070-a31d-8a85c7384851 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:15.977202 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca0be2-3703-4070-a31d-8a85c7384851 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:15.977473 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca0be2-3703-4070-a31d-8a85c7384851 admin admin] PATH_INFO: `/v3/projects/02260afcb37047e38a3658e954688975/users/4900073ddf1d4a2aa8b1ac10a0430835/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:15.990538 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:16.000933 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca0be2-3703-4070-a31d-8a85c7384851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02260afcb37047e38a3658e954688975, user_id=4900073ddf1d4a2aa8b1ac10a0430835, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:16.004368 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca0be2-3703-4070-a31d-8a85c7384851 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:16.185698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1420/2819] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:07:15 2022] PUT /identity/v3/projects/02260afcb37047e38a3658e954688975/users/4900073ddf1d4a2aa8b1ac10a0430835/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:16.190544 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f851885-88c1-4987-90ca-b32ad9887d67 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:16.191156 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f851885-88c1-4987-90ca-b32ad9887d67 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:16.191156 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f851885-88c1-4987-90ca-b32ad9887d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:16.223850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-8f851885-88c1-4987-90ca-b32ad9887d67 None None] MFA Rules not processed for user `4900073ddf1d4a2aa8b1ac10a0430835`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:16.225090 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-8f851885-88c1-4987-90ca-b32ad9887d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:16.336640 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca0be2-3703-4070-a31d-8a85c7384851 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:16.337079 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1400/2820] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:07:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:07:16.497865 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca0be2-3703-4070-a31d-8a85c7384851 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:16.504625 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535d7eb-89a0-40b3-9833-2c23bbfa4595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:16.505344 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535d7eb-89a0-40b3-9833-2c23bbfa4595 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:16.505774 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535d7eb-89a0-40b3-9833-2c23bbfa4595 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:16.506167 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535d7eb-89a0-40b3-9833-2c23bbfa4595 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:16.507089 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535d7eb-89a0-40b3-9833-2c23bbfa4595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:16.510968 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535d7eb-89a0-40b3-9833-2c23bbfa4595 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:16.617149 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1421/2821] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:07:16 2022] POST /identity/v3/projects => generated 387 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:07:16.621604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f851885-88c1-4987-90ca-b32ad9887d67 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:16.645305 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f851885-88c1-4987-90ca-b32ad9887d67 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:16.673042 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:16.761119 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6dda52-6312-4098-b0ee-b3ac00655b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:16.761734 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dda52-6312-4098-b0ee-b3ac00655b4b admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:16.762025 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dda52-6312-4098-b0ee-b3ac00655b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:16.762368 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dda52-6312-4098-b0ee-b3ac00655b4b admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:16.762980 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6dda52-6312-4098-b0ee-b3ac00655b4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:16.764961 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6dda52-6312-4098-b0ee-b3ac00655b4b admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:16.860079 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1401/2822] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:07:16 2022] POST /identity/v3/users => generated 300 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:07:16.864229 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535d7eb-89a0-40b3-9833-2c23bbfa4595 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:16.881229 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535d7eb-89a0-40b3-9833-2c23bbfa4595 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:16.890132 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5a372-cb73-4c3a-9994-ac77c0a5912e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:16.890132 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5a372-cb73-4c3a-9994-ac77c0a5912e admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:16.890132 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5a372-cb73-4c3a-9994-ac77c0a5912e admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:16.890132 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5a372-cb73-4c3a-9994-ac77c0a5912e admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:16.890843 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5a372-cb73-4c3a-9994-ac77c0a5912e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:16.891986 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5a372-cb73-4c3a-9994-ac77c0a5912e admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:16.907536 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1422/2823] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:07:16.908688 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6dda52-6312-4098-b0ee-b3ac00655b4b admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:16.920939 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6dda52-6312-4098-b0ee-b3ac00655b4b admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:16.930121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a262ea-cd20-4967-be04-523a9e9a4225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:16.930121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a262ea-cd20-4967-be04-523a9e9a4225 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:16.930121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a262ea-cd20-4967-be04-523a9e9a4225 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:16.930121 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a262ea-cd20-4967-be04-523a9e9a4225 admin admin] PATH_INFO: `/v3/projects/b34c0470db69419f891dbff95341cb10/users/597cfbbffc0142209d3ff877f43e86a6/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:16.943769 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a262ea-cd20-4967-be04-523a9e9a4225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b34c0470db69419f891dbff95341cb10, user_id=597cfbbffc0142209d3ff877f43e86a6, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:16.953407 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a262ea-cd20-4967-be04-523a9e9a4225 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:17.083208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1402/2824] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:07:16 2022] PUT /identity/v3/projects/b34c0470db69419f891dbff95341cb10/users/597cfbbffc0142209d3ff877f43e86a6/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:17.084722 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5a372-cb73-4c3a-9994-ac77c0a5912e admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:17.097822 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5a372-cb73-4c3a-9994-ac77c0a5912e admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:17.198904 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe276d4-190c-4b4c-ae66-7799dee97853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:17.199962 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe276d4-190c-4b4c-ae66-7799dee97853 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:17.200461 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe276d4-190c-4b4c-ae66-7799dee97853 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:17.200971 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe276d4-190c-4b4c-ae66-7799dee97853 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:17.201971 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe276d4-190c-4b4c-ae66-7799dee97853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:17.203926 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe276d4-190c-4b4c-ae66-7799dee97853 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:17.217150 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1423/2825] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:07:17.221216 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a262ea-cd20-4967-be04-523a9e9a4225 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:17.248547 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a262ea-cd20-4967-be04-523a9e9a4225 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:17.255955 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa8e8c-ec30-40ac-a860-c7dadd34ff50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:17.256649 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa8e8c-ec30-40ac-a860-c7dadd34ff50 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:17.256943 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa8e8c-ec30-40ac-a860-c7dadd34ff50 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:17.257277 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa8e8c-ec30-40ac-a860-c7dadd34ff50 admin admin] PATH_INFO: `/v3/projects/b34c0470db69419f891dbff95341cb10/users/597cfbbffc0142209d3ff877f43e86a6/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:17.259393 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa8e8c-ec30-40ac-a860-c7dadd34ff50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b34c0470db69419f891dbff95341cb10, user_id=597cfbbffc0142209d3ff877f43e86a6, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:17.262257 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa8e8c-ec30-40ac-a860-c7dadd34ff50 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:17.274667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1403/2826] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:07:17 2022] PUT /identity/v3/projects/b34c0470db69419f891dbff95341cb10/users/597cfbbffc0142209d3ff877f43e86a6/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:17.343053 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb18c5-af1b-4f2d-b69e-6155d1639981 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:17.343349 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb18c5-af1b-4f2d-b69e-6155d1639981 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:17.343760 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb18c5-af1b-4f2d-b69e-6155d1639981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:17.381113 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-2ceb18c5-af1b-4f2d-b69e-6155d1639981 None None] MFA Rules not processed for user `597cfbbffc0142209d3ff877f43e86a6`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:17.382498 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-2ceb18c5-af1b-4f2d-b69e-6155d1639981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:17.443004 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:17.471702 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1424/2827] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:07:17 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:07:17.484405 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa8e8c-ec30-40ac-a860-c7dadd34ff50 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:17.487014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-49aa8e8c-ec30-40ac-a860-c7dadd34ff50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:17.570193 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa8e8c-ec30-40ac-a860-c7dadd34ff50 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:17.575019 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ddf73-bf6f-4e9f-b338-243c04c4da14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:17.575960 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ddf73-bf6f-4e9f-b338-243c04c4da14 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:17.576406 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ddf73-bf6f-4e9f-b338-243c04c4da14 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:17.576808 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ddf73-bf6f-4e9f-b338-243c04c4da14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:17.589539 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ddf73-bf6f-4e9f-b338-243c04c4da14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:17.591670 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ddf73-bf6f-4e9f-b338-243c04c4da14 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:17.605895 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1404/2828] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:07:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:07:18.991366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb18c5-af1b-4f2d-b69e-6155d1639981 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:18.992985 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-2ceb18c5-af1b-4f2d-b69e-6155d1639981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:19.010281 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb18c5-af1b-4f2d-b69e-6155d1639981 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:19.015477 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2764367-218a-48e0-85d6-7ef14b495e11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:19.016335 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2764367-218a-48e0-85d6-7ef14b495e11 service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:19.016690 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2764367-218a-48e0-85d6-7ef14b495e11 service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:19.017036 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2764367-218a-48e0-85d6-7ef14b495e11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:19.086303 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2764367-218a-48e0-85d6-7ef14b495e11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:19.087834 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2764367-218a-48e0-85d6-7ef14b495e11 service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:19.099539 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1425/2829] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:07:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:07:24.238612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ddf73-bf6f-4e9f-b338-243c04c4da14 service cinder] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:24.248896 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ddf73-bf6f-4e9f-b338-243c04c4da14 service cinder] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:24.252621 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf142c-7d2b-4f9d-8231-128b9303c709 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:24.253319 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf142c-7d2b-4f9d-8231-128b9303c709 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:24.253666 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf142c-7d2b-4f9d-8231-128b9303c709 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:24.254021 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf142c-7d2b-4f9d-8231-128b9303c709 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:24.295587 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e041df-21ae-4afb-9655-99f4b4ca8265 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:24.296096 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e041df-21ae-4afb-9655-99f4b4ca8265 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:24.296210 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e041df-21ae-4afb-9655-99f4b4ca8265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:24.320359 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf142c-7d2b-4f9d-8231-128b9303c709 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:24.321806 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf142c-7d2b-4f9d-8231-128b9303c709 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:24.328094 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-17e041df-21ae-4afb-9655-99f4b4ca8265 None None] MFA Rules not processed for user `d392c30328a3491bb186bd7b55f4d99c`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:24.329878 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-17e041df-21ae-4afb-9655-99f4b4ca8265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:24.331982 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1405/2830] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:07:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:07:24.402904 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1426/2831] 10.222.0.13 () {58 vars in 967 bytes} [Thu Aug 11 10:07:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:07:24.417751 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf142c-7d2b-4f9d-8231-128b9303c709 service cinder] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:24.420093 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-27bf142c-7d2b-4f9d-8231-128b9303c709 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:24.430414 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:24.500922 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf142c-7d2b-4f9d-8231-128b9303c709 service cinder] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:24.506235 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4990f88-1efb-4f71-be78-76f69b20ad7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e3b1c5aec94673b391210ae51d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:24.506861 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4990f88-1efb-4f71-be78-76f69b20ad7b service swift] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:24.507137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4990f88-1efb-4f71-be78-76f69b20ad7b service swift] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:24.507872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4990f88-1efb-4f71-be78-76f69b20ad7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:24.523863 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4990f88-1efb-4f71-be78-76f69b20ad7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:24.523863 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4990f88-1efb-4f71-be78-76f69b20ad7b service swift] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:24.530845 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1406/2832] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Aug 11 10:07:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 10:07:27.919365 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e041df-21ae-4afb-9655-99f4b4ca8265 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:27.920875 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-17e041df-21ae-4afb-9655-99f4b4ca8265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:28.003712 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e041df-21ae-4afb-9655-99f4b4ca8265 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:28.008424 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e85293-3d0b-47d0-936a-1e3843b0821d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:28.009054 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e85293-3d0b-47d0-936a-1e3843b0821d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:28.009316 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e85293-3d0b-47d0-936a-1e3843b0821d admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:28.009582 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e85293-3d0b-47d0-936a-1e3843b0821d admin admin] PATH_INFO: `/v3/users/b42f3ffc158f47f69dda4c012e4d365c` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:28.010874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e85293-3d0b-47d0-936a-1e3843b0821d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b42f3ffc158f47f69dda4c012e4d365c)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:28.013366 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e85293-3d0b-47d0-936a-1e3843b0821d admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:28.035404 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:28.201367 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-86e85293-3d0b-47d0-936a-1e3843b0821d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b42f3ffc158f47f69dda4c012e4d365c'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:28.215416 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-86e85293-3d0b-47d0-936a-1e3843b0821d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b42f3ffc158f47f69dda4c012e4d365c'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:28.216936 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-86e85293-3d0b-47d0-936a-1e3843b0821d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b42f3ffc158f47f69dda4c012e4d365c'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:28.217765 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-86e85293-3d0b-47d0-936a-1e3843b0821d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b42f3ffc158f47f69dda4c012e4d365c'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:28.224837 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-86e85293-3d0b-47d0-936a-1e3843b0821d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b42f3ffc158f47f69dda4c012e4d365c'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:28.324211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1427/2833] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:07:27 2022] DELETE /identity/v3/users/b42f3ffc158f47f69dda4c012e4d365c => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:28.606708 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4990f88-1efb-4f71-be78-76f69b20ad7b service swift] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:28.628922 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4990f88-1efb-4f71-be78-76f69b20ad7b service swift] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:28.688729 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e85293-3d0b-47d0-936a-1e3843b0821d admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:28.690395 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-86e85293-3d0b-47d0-936a-1e3843b0821d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:28.695436 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d22de-c200-429a-b32d-ef914db54a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:28.696064 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d22de-c200-429a-b32d-ef914db54a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:28.696342 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d22de-c200-429a-b32d-ef914db54a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:28.696611 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d22de-c200-429a-b32d-ef914db54a25 admin admin] PATH_INFO: `/v3/projects/ccf49b2264dc4371b650cde686966826` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:28.697751 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d22de-c200-429a-b32d-ef914db54a25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf49b2264dc4371b650cde686966826)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:28.700396 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d22de-c200-429a-b32d-ef914db54a25 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:28.704376 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e85293-3d0b-47d0-936a-1e3843b0821d admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:28.711276 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb788e-8ffa-4a5b-a478-4b38526f3d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:28.711276 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb788e-8ffa-4a5b-a478-4b38526f3d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:28.711276 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb788e-8ffa-4a5b-a478-4b38526f3d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:28.711276 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb788e-8ffa-4a5b-a478-4b38526f3d0e admin admin] PATH_INFO: `/v3/users/f31b943564c14834833432af6c61a015` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:28.712384 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb788e-8ffa-4a5b-a478-4b38526f3d0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f31b943564c14834833432af6c61a015)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:28.714373 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb788e-8ffa-4a5b-a478-4b38526f3d0e admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:28.792858 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-f28d22de-c200-429a-b32d-ef914db54a25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf49b2264dc4371b650cde686966826', 'request_id': 'req-f28d22de-c200-429a-b32d-ef914db54a25'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:28.798307 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-f28d22de-c200-429a-b32d-ef914db54a25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf49b2264dc4371b650cde686966826', 'request_id': 'req-f28d22de-c200-429a-b32d-ef914db54a25'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:28.804275 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-f28d22de-c200-429a-b32d-ef914db54a25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf49b2264dc4371b650cde686966826', 'request_id': 'req-f28d22de-c200-429a-b32d-ef914db54a25'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:28.895137 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-a8bb788e-8ffa-4a5b-a478-4b38526f3d0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f31b943564c14834833432af6c61a015'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:28.897369 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-f28d22de-c200-429a-b32d-ef914db54a25 admin admin] The token cache is being invalidate because project ccf49b2264dc4371b650cde686966826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:07:28.897658 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-f28d22de-c200-429a-b32d-ef914db54a25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:28.898310 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-f28d22de-c200-429a-b32d-ef914db54a25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:28.899788 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1407/2834] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:07:28 2022] DELETE /identity/v3/projects/ccf49b2264dc4371b650cde686966826 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:28.909097 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-a8bb788e-8ffa-4a5b-a478-4b38526f3d0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f31b943564c14834833432af6c61a015'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:28.915050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-a8bb788e-8ffa-4a5b-a478-4b38526f3d0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f31b943564c14834833432af6c61a015'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:28.915050 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-a8bb788e-8ffa-4a5b-a478-4b38526f3d0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f31b943564c14834833432af6c61a015'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:28.918740 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-a8bb788e-8ffa-4a5b-a478-4b38526f3d0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f31b943564c14834833432af6c61a015'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:28.995313 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1428/2835] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:07:28 2022] DELETE /identity/v3/users/f31b943564c14834833432af6c61a015 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:28.999871 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fda140-7889-43f5-a7ef-6633f58c9e19 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:29.000148 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fda140-7889-43f5-a7ef-6633f58c9e19 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:29.000419 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fda140-7889-43f5-a7ef-6633f58c9e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:29.022431 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-14fda140-7889-43f5-a7ef-6633f58c9e19 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:29.023667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-14fda140-7889-43f5-a7ef-6633f58c9e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:29.048537 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:29.093010 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1408/2836] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:07:29.107460 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb788e-8ffa-4a5b-a478-4b38526f3d0e admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:29.108973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-a8bb788e-8ffa-4a5b-a478-4b38526f3d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:29.189365 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:29.192299 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb788e-8ffa-4a5b-a478-4b38526f3d0e admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:29.196256 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6420f1-8e46-47f9-b7af-cf58fda9d841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:29.196866 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6420f1-8e46-47f9-b7af-cf58fda9d841 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:29.202896 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6420f1-8e46-47f9-b7af-cf58fda9d841 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:29.202896 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6420f1-8e46-47f9-b7af-cf58fda9d841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:29.207615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6420f1-8e46-47f9-b7af-cf58fda9d841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:29.209041 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6420f1-8e46-47f9-b7af-cf58fda9d841 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:29.218793 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1429/2837] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:07:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:07:29.614229 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fda140-7889-43f5-a7ef-6633f58c9e19 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:29.618448 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-14fda140-7889-43f5-a7ef-6633f58c9e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:29.627872 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fda140-7889-43f5-a7ef-6633f58c9e19 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:29.632524 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e41ab-a43b-45ac-86e2-be38e5cf4168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:29.633183 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e41ab-a43b-45ac-86e2-be38e5cf4168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:29.637654 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e41ab-a43b-45ac-86e2-be38e5cf4168 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:29.638034 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e41ab-a43b-45ac-86e2-be38e5cf4168 admin admin] PATH_INFO: `/v3/projects/eeccc19d948944baa489c382449d4624` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:29.639512 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e41ab-a43b-45ac-86e2-be38e5cf4168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeccc19d948944baa489c382449d4624)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:29.641431 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e41ab-a43b-45ac-86e2-be38e5cf4168 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:29.759173 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-2a4e41ab-a43b-45ac-86e2-be38e5cf4168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeccc19d948944baa489c382449d4624', 'request_id': 'req-2a4e41ab-a43b-45ac-86e2-be38e5cf4168'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:29.764509 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-2a4e41ab-a43b-45ac-86e2-be38e5cf4168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeccc19d948944baa489c382449d4624', 'request_id': 'req-2a4e41ab-a43b-45ac-86e2-be38e5cf4168'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:29.770633 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-2a4e41ab-a43b-45ac-86e2-be38e5cf4168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeccc19d948944baa489c382449d4624', 'request_id': 'req-2a4e41ab-a43b-45ac-86e2-be38e5cf4168'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:29.860611 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-2a4e41ab-a43b-45ac-86e2-be38e5cf4168 admin admin] The token cache is being invalidate because project eeccc19d948944baa489c382449d4624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:07:29.860893 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-2a4e41ab-a43b-45ac-86e2-be38e5cf4168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:29.861497 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-2a4e41ab-a43b-45ac-86e2-be38e5cf4168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:29.863200 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1409/2838] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:07:29 2022] DELETE /identity/v3/projects/eeccc19d948944baa489c382449d4624 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:29.867179 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6420f1-8e46-47f9-b7af-cf58fda9d841 service neutron] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:29.877419 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6420f1-8e46-47f9-b7af-cf58fda9d841 service neutron] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:29.935678 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537711f2-8b6c-4bd4-9359-07b1d3322c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:29.936315 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537711f2-8b6c-4bd4-9359-07b1d3322c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:29.936592 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537711f2-8b6c-4bd4-9359-07b1d3322c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:29.936885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537711f2-8b6c-4bd4-9359-07b1d3322c32 admin admin] PATH_INFO: `/v3/users/4900073ddf1d4a2aa8b1ac10a0430835` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:29.938744 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537711f2-8b6c-4bd4-9359-07b1d3322c32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4900073ddf1d4a2aa8b1ac10a0430835)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:29.940754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537711f2-8b6c-4bd4-9359-07b1d3322c32 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:30.163068 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-537711f2-8b6c-4bd4-9359-07b1d3322c32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4900073ddf1d4a2aa8b1ac10a0430835'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:30.175006 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-537711f2-8b6c-4bd4-9359-07b1d3322c32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4900073ddf1d4a2aa8b1ac10a0430835'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:30.175788 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-537711f2-8b6c-4bd4-9359-07b1d3322c32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4900073ddf1d4a2aa8b1ac10a0430835'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:30.176378 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-537711f2-8b6c-4bd4-9359-07b1d3322c32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4900073ddf1d4a2aa8b1ac10a0430835'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:30.183299 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-537711f2-8b6c-4bd4-9359-07b1d3322c32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4900073ddf1d4a2aa8b1ac10a0430835'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:30.268583 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1430/2839] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:07:29 2022] DELETE /identity/v3/users/4900073ddf1d4a2aa8b1ac10a0430835 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:30.419094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e41ab-a43b-45ac-86e2-be38e5cf4168 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:30.420481 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-2a4e41ab-a43b-45ac-86e2-be38e5cf4168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:30.503392 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e41ab-a43b-45ac-86e2-be38e5cf4168 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:30.556953 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5f2a8-a9ed-4634-8a4f-a78ffd33344b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:30.557554 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5f2a8-a9ed-4634-8a4f-a78ffd33344b service neutron] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:30.557825 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5f2a8-a9ed-4634-8a4f-a78ffd33344b service neutron] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:30.558108 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5f2a8-a9ed-4634-8a4f-a78ffd33344b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:30.560421 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-6fe5f2a8-a9ed-4634-8a4f-a78ffd33344b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:30.579660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:30.622854 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5f2a8-a9ed-4634-8a4f-a78ffd33344b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:30.624206 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5f2a8-a9ed-4634-8a4f-a78ffd33344b service neutron] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:30.637102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1410/2840] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:07:30 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:07:30.678762 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537711f2-8b6c-4bd4-9359-07b1d3322c32 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:30.682111 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-537711f2-8b6c-4bd4-9359-07b1d3322c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:30.754047 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537711f2-8b6c-4bd4-9359-07b1d3322c32 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:30.760151 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8becdd-0d5c-4c67-bf53-8eee7c075a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:30.760795 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8becdd-0d5c-4c67-bf53-8eee7c075a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:30.761074 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8becdd-0d5c-4c67-bf53-8eee7c075a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:30.761374 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8becdd-0d5c-4c67-bf53-8eee7c075a71 admin admin] PATH_INFO: `/v3/projects/02260afcb37047e38a3658e954688975` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:30.763180 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8becdd-0d5c-4c67-bf53-8eee7c075a71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02260afcb37047e38a3658e954688975)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:30.765137 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8becdd-0d5c-4c67-bf53-8eee7c075a71 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:30.776972 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:30.896232 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-9b8becdd-0d5c-4c67-bf53-8eee7c075a71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02260afcb37047e38a3658e954688975', 'request_id': 'req-9b8becdd-0d5c-4c67-bf53-8eee7c075a71'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:30.905236 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-9b8becdd-0d5c-4c67-bf53-8eee7c075a71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02260afcb37047e38a3658e954688975', 'request_id': 'req-9b8becdd-0d5c-4c67-bf53-8eee7c075a71'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:30.992763 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-9b8becdd-0d5c-4c67-bf53-8eee7c075a71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02260afcb37047e38a3658e954688975', 'request_id': 'req-9b8becdd-0d5c-4c67-bf53-8eee7c075a71'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:31.004957 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-9b8becdd-0d5c-4c67-bf53-8eee7c075a71 admin admin] The token cache is being invalidate because project 02260afcb37047e38a3658e954688975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:07:31.005245 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-9b8becdd-0d5c-4c67-bf53-8eee7c075a71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:31.005879 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-9b8becdd-0d5c-4c67-bf53-8eee7c075a71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:31.007536 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1431/2841] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:07:30 2022] DELETE /identity/v3/projects/02260afcb37047e38a3658e954688975 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:31.011694 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5f2a8-a9ed-4634-8a4f-a78ffd33344b service neutron] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:31.023082 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5f2a8-a9ed-4634-8a4f-a78ffd33344b service neutron] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:31.089108 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029e589-eba6-410f-99bb-d08865043323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:31.089859 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029e589-eba6-410f-99bb-d08865043323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:31.090363 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029e589-eba6-410f-99bb-d08865043323 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:31.091764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029e589-eba6-410f-99bb-d08865043323 admin admin] PATH_INFO: `/v3/users/597cfbbffc0142209d3ff877f43e86a6` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:31.092796 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029e589-eba6-410f-99bb-d08865043323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=597cfbbffc0142209d3ff877f43e86a6)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:31.094849 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029e589-eba6-410f-99bb-d08865043323 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:31.301538 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a029e589-eba6-410f-99bb-d08865043323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '597cfbbffc0142209d3ff877f43e86a6'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:31.317918 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a029e589-eba6-410f-99bb-d08865043323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '597cfbbffc0142209d3ff877f43e86a6'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:31.318803 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a029e589-eba6-410f-99bb-d08865043323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '597cfbbffc0142209d3ff877f43e86a6'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:31.327067 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a029e589-eba6-410f-99bb-d08865043323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '597cfbbffc0142209d3ff877f43e86a6'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:31.452101 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-a029e589-eba6-410f-99bb-d08865043323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '597cfbbffc0142209d3ff877f43e86a6'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:31.458830 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1411/2842] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:07:31 2022] DELETE /identity/v3/users/597cfbbffc0142209d3ff877f43e86a6 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:31.914259 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8becdd-0d5c-4c67-bf53-8eee7c075a71 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:31.915825 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-9b8becdd-0d5c-4c67-bf53-8eee7c075a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:31.931715 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8becdd-0d5c-4c67-bf53-8eee7c075a71 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:31.992075 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47193248-faef-4db6-953a-0e13003d40f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:31.992710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47193248-faef-4db6-953a-0e13003d40f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:31.992989 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47193248-faef-4db6-953a-0e13003d40f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:31.993255 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47193248-faef-4db6-953a-0e13003d40f6 admin admin] PATH_INFO: `/v3/projects/b34c0470db69419f891dbff95341cb10` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:31.994406 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47193248-faef-4db6-953a-0e13003d40f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b34c0470db69419f891dbff95341cb10)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:31.996317 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47193248-faef-4db6-953a-0e13003d40f6 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:32.116825 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-47193248-faef-4db6-953a-0e13003d40f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b34c0470db69419f891dbff95341cb10', 'request_id': 'req-47193248-faef-4db6-953a-0e13003d40f6'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:32.122941 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-47193248-faef-4db6-953a-0e13003d40f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b34c0470db69419f891dbff95341cb10', 'request_id': 'req-47193248-faef-4db6-953a-0e13003d40f6'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:32.183228 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-47193248-faef-4db6-953a-0e13003d40f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b34c0470db69419f891dbff95341cb10', 'request_id': 'req-47193248-faef-4db6-953a-0e13003d40f6'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:32.195710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-47193248-faef-4db6-953a-0e13003d40f6 admin admin] The token cache is being invalidate because project b34c0470db69419f891dbff95341cb10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:07:32.199384 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-47193248-faef-4db6-953a-0e13003d40f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:32.199384 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-47193248-faef-4db6-953a-0e13003d40f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:32.199384 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1432/2843] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:07:31 2022] DELETE /identity/v3/projects/b34c0470db69419f891dbff95341cb10 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:32.204975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896d363-7149-4fef-a3da-20c3999615af None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:32.205457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896d363-7149-4fef-a3da-20c3999615af None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:32.205641 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896d363-7149-4fef-a3da-20c3999615af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:32.225550 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-9896d363-7149-4fef-a3da-20c3999615af None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:32.226841 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-9896d363-7149-4fef-a3da-20c3999615af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:32.256828 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:32.285147 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1412/2844] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:07:32.293402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397270a9-dbbd-4521-b461-622e5bae2faa None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:32.293752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397270a9-dbbd-4521-b461-622e5bae2faa None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:32.294034 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397270a9-dbbd-4521-b461-622e5bae2faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:32.314127 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-397270a9-dbbd-4521-b461-622e5bae2faa None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:32.315328 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-397270a9-dbbd-4521-b461-622e5bae2faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:32.323334 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1433/2845] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:07:32.328253 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896d363-7149-4fef-a3da-20c3999615af None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:32.338124 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896d363-7149-4fef-a3da-20c3999615af None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:32.342593 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aea933-c50c-4182-82d7-5c33412da695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:32.343180 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aea933-c50c-4182-82d7-5c33412da695 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:32.343453 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aea933-c50c-4182-82d7-5c33412da695 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:32.343724 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aea933-c50c-4182-82d7-5c33412da695 admin admin] PATH_INFO: `/v3/domains` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:32.344411 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aea933-c50c-4182-82d7-5c33412da695 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98479) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:07:32.344714 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aea933-c50c-4182-82d7-5c33412da695 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:32.346439 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aea933-c50c-4182-82d7-5c33412da695 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:32.359119 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1413/2846] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:07:32.364402 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397270a9-dbbd-4521-b461-622e5bae2faa None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:32.374226 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397270a9-dbbd-4521-b461-622e5bae2faa None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:32.378897 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2dbf0-c8f2-4e96-ac1a-29bddffb5b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:32.379482 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2dbf0-c8f2-4e96-ac1a-29bddffb5b55 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:32.379754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2dbf0-c8f2-4e96-ac1a-29bddffb5b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:32.380115 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2dbf0-c8f2-4e96-ac1a-29bddffb5b55 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:32.380730 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2dbf0-c8f2-4e96-ac1a-29bddffb5b55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:32.382710 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2dbf0-c8f2-4e96-ac1a-29bddffb5b55 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:32.456878 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1434/2847] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:07:32 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:07:32.461211 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aea933-c50c-4182-82d7-5c33412da695 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:32.483850 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aea933-c50c-4182-82d7-5c33412da695 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:32.553967 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccc337-e4d1-4b1b-8e8d-552227e5cb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:32.554738 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccc337-e4d1-4b1b-8e8d-552227e5cb4d admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:32.555107 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccc337-e4d1-4b1b-8e8d-552227e5cb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:32.555474 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccc337-e4d1-4b1b-8e8d-552227e5cb4d admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:32.556186 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccc337-e4d1-4b1b-8e8d-552227e5cb4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:32.558220 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccc337-e4d1-4b1b-8e8d-552227e5cb4d admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:32.644973 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1414/2848] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:07:32 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:07:32.649142 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2dbf0-c8f2-4e96-ac1a-29bddffb5b55 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:32.655605 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:32.661637 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2dbf0-c8f2-4e96-ac1a-29bddffb5b55 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:32.670879 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4b9e1-b11b-427e-b4ef-a5ecf7b5d866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:32.671500 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4b9e1-b11b-427e-b4ef-a5ecf7b5d866 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:32.671774 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4b9e1-b11b-427e-b4ef-a5ecf7b5d866 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:32.678387 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4b9e1-b11b-427e-b4ef-a5ecf7b5d866 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:32.678387 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4b9e1-b11b-427e-b4ef-a5ecf7b5d866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:32.678387 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4b9e1-b11b-427e-b4ef-a5ecf7b5d866 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:32.686531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1435/2849] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:07:32.690778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccc337-e4d1-4b1b-8e8d-552227e5cb4d admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:32.704675 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccc337-e4d1-4b1b-8e8d-552227e5cb4d admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:32.716498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3256d4-fcde-426f-b03f-6c228e648247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:32.717489 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3256d4-fcde-426f-b03f-6c228e648247 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:32.718073 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3256d4-fcde-426f-b03f-6c228e648247 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:32.718667 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3256d4-fcde-426f-b03f-6c228e648247 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:32.720197 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3256d4-fcde-426f-b03f-6c228e648247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:32.727258 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3256d4-fcde-426f-b03f-6c228e648247 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:32.747441 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1415/2850] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:07:32.748979 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4b9e1-b11b-427e-b4ef-a5ecf7b5d866 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:32.760028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4b9e1-b11b-427e-b4ef-a5ecf7b5d866 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:32.766035 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ba87d-64b0-4715-9bcb-e7973b819c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:32.766858 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ba87d-64b0-4715-9bcb-e7973b819c9e admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:32.767241 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ba87d-64b0-4715-9bcb-e7973b819c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:32.767615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ba87d-64b0-4715-9bcb-e7973b819c9e admin admin] PATH_INFO: `/v3/projects/e571d9c60efc48eb80cc33447cfab350/users/2b0f82344657498b8ec62d5a2a47a411/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:32.784537 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ba87d-64b0-4715-9bcb-e7973b819c9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e571d9c60efc48eb80cc33447cfab350, user_id=2b0f82344657498b8ec62d5a2a47a411, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:32.787717 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ba87d-64b0-4715-9bcb-e7973b819c9e admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:32.888527 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1436/2851] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:07:32 2022] PUT /identity/v3/projects/e571d9c60efc48eb80cc33447cfab350/users/2b0f82344657498b8ec62d5a2a47a411/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:32.901659 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574fea3-d1eb-4b93-a872-8227ba23feab None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:32.902328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574fea3-d1eb-4b93-a872-8227ba23feab None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:32.902328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574fea3-d1eb-4b93-a872-8227ba23feab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:32.936498 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-8574fea3-d1eb-4b93-a872-8227ba23feab None None] MFA Rules not processed for user `2b0f82344657498b8ec62d5a2a47a411`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:32.938109 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-8574fea3-d1eb-4b93-a872-8227ba23feab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:33.022235 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1416/2852] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:07:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:07:33.023522 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ba87d-64b0-4715-9bcb-e7973b819c9e admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:33.105306 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ba87d-64b0-4715-9bcb-e7973b819c9e admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:33.112624 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff04d3-81d7-4d63-a476-a071da5b12df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:33.113682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff04d3-81d7-4d63-a476-a071da5b12df admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:33.114538 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff04d3-81d7-4d63-a476-a071da5b12df admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:33.114973 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff04d3-81d7-4d63-a476-a071da5b12df admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:33.115769 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff04d3-81d7-4d63-a476-a071da5b12df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:33.117910 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff04d3-81d7-4d63-a476-a071da5b12df admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:33.246288 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1437/2853] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:07:33 2022] POST /identity/v3/projects => generated 377 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:07:33.248166 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574fea3-d1eb-4b93-a872-8227ba23feab None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:33.262167 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574fea3-d1eb-4b93-a872-8227ba23feab None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:33.289989 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:33.319587 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d36c6-97c4-499a-92f6-ecb154e2735f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:33.320207 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d36c6-97c4-499a-92f6-ecb154e2735f admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:33.320485 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d36c6-97c4-499a-92f6-ecb154e2735f admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:33.320756 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d36c6-97c4-499a-92f6-ecb154e2735f admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:33.321386 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d36c6-97c4-499a-92f6-ecb154e2735f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:33.323338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d36c6-97c4-499a-92f6-ecb154e2735f admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:33.429617 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1417/2854] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:07:33 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:07:33.429747 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff04d3-81d7-4d63-a476-a071da5b12df admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:33.441516 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff04d3-81d7-4d63-a476-a071da5b12df admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:33.449447 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab5dbe-5ea9-4557-87d7-43cb4b8789ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:33.450107 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab5dbe-5ea9-4557-87d7-43cb4b8789ee admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:33.450394 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab5dbe-5ea9-4557-87d7-43cb4b8789ee admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:33.450673 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab5dbe-5ea9-4557-87d7-43cb4b8789ee admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:33.451436 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab5dbe-5ea9-4557-87d7-43cb4b8789ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:33.452918 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab5dbe-5ea9-4557-87d7-43cb4b8789ee admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:33.472852 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1438/2855] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:07:33.474891 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d36c6-97c4-499a-92f6-ecb154e2735f admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:33.485635 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d36c6-97c4-499a-92f6-ecb154e2735f admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:33.490776 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6a685-6f57-4506-8b03-96596ba5aaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:33.491416 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6a685-6f57-4506-8b03-96596ba5aaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:33.491677 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6a685-6f57-4506-8b03-96596ba5aaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:33.491977 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6a685-6f57-4506-8b03-96596ba5aaf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:33.492617 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6a685-6f57-4506-8b03-96596ba5aaf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:33.494262 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6a685-6f57-4506-8b03-96596ba5aaf1 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:33.506271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1418/2856] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:07:33.510677 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab5dbe-5ea9-4557-87d7-43cb4b8789ee admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:33.521790 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab5dbe-5ea9-4557-87d7-43cb4b8789ee admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:33.528021 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822c5a5-21f8-48a8-bd0c-97155499f393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:33.528770 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822c5a5-21f8-48a8-bd0c-97155499f393 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:33.529055 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822c5a5-21f8-48a8-bd0c-97155499f393 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:33.529328 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822c5a5-21f8-48a8-bd0c-97155499f393 admin admin] PATH_INFO: `/v3/projects/7ec6078605e64132906c5218cf35e8d7/users/05c836ed52c94ba391c45605bbc1c2d9/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:33.544682 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822c5a5-21f8-48a8-bd0c-97155499f393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec6078605e64132906c5218cf35e8d7, user_id=05c836ed52c94ba391c45605bbc1c2d9, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:33.547375 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822c5a5-21f8-48a8-bd0c-97155499f393 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:33.658702 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1439/2857] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:07:33 2022] PUT /identity/v3/projects/7ec6078605e64132906c5218cf35e8d7/users/05c836ed52c94ba391c45605bbc1c2d9/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:07:33.669051 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a93f4-7fb9-4cf6-8712-a6c9ebd90cfe None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:33.669337 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a93f4-7fb9-4cf6-8712-a6c9ebd90cfe None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:33.669612 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a93f4-7fb9-4cf6-8712-a6c9ebd90cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:33.697021 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-f44a93f4-7fb9-4cf6-8712-a6c9ebd90cfe None None] MFA Rules not processed for user `05c836ed52c94ba391c45605bbc1c2d9`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:33.698301 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-f44a93f4-7fb9-4cf6-8712-a6c9ebd90cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:33.768946 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1419/2858] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:07:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:07:33.770226 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822c5a5-21f8-48a8-bd0c-97155499f393 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:33.838742 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822c5a5-21f8-48a8-bd0c-97155499f393 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:33.843836 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c6571-fe40-4543-bedb-eb9e8d1a5d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:33.851804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c6571-fe40-4543-bedb-eb9e8d1a5d28 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:33.851804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c6571-fe40-4543-bedb-eb9e8d1a5d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:33.851804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c6571-fe40-4543-bedb-eb9e8d1a5d28 admin admin] PATH_INFO: `/v3/projects` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:33.851804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c6571-fe40-4543-bedb-eb9e8d1a5d28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:33.851804 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c6571-fe40-4543-bedb-eb9e8d1a5d28 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:33.925553 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1440/2859] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:07:33 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:07:33.929483 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a93f4-7fb9-4cf6-8712-a6c9ebd90cfe None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:33.940584 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a93f4-7fb9-4cf6-8712-a6c9ebd90cfe None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:33.999717 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92575f32-f53c-4113-9d6c-8c157bf4ff8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:34.000320 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92575f32-f53c-4113-9d6c-8c157bf4ff8c admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:34.000590 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92575f32-f53c-4113-9d6c-8c157bf4ff8c admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:34.000853 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92575f32-f53c-4113-9d6c-8c157bf4ff8c admin admin] PATH_INFO: `/v3/users` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:34.001505 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92575f32-f53c-4113-9d6c-8c157bf4ff8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:34.003513 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92575f32-f53c-4113-9d6c-8c157bf4ff8c admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:34.092340 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1420/2860] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:07:33 2022] POST /identity/v3/users => generated 295 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:07:34.096309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c6571-fe40-4543-bedb-eb9e8d1a5d28 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:34.101858 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:34.107627 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c6571-fe40-4543-bedb-eb9e8d1a5d28 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:34.112348 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e0773-0acd-4947-958b-1cff5524d1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:34.112931 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e0773-0acd-4947-958b-1cff5524d1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:34.113283 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e0773-0acd-4947-958b-1cff5524d1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:34.113557 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e0773-0acd-4947-958b-1cff5524d1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:34.114783 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e0773-0acd-4947-958b-1cff5524d1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:34.115864 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e0773-0acd-4947-958b-1cff5524d1c1 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:34.126674 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1441/2861] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:07:34.130846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92575f32-f53c-4113-9d6c-8c157bf4ff8c admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:34.141662 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92575f32-f53c-4113-9d6c-8c157bf4ff8c admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:34.146384 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e9fb4-8987-471d-80a2-582544ed6578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:34.147178 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e9fb4-8987-471d-80a2-582544ed6578 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:34.147457 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e9fb4-8987-471d-80a2-582544ed6578 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:34.147731 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e9fb4-8987-471d-80a2-582544ed6578 admin admin] PATH_INFO: `/v3/projects/f94150c6e31842969aae640a379e43b7/users/2814c80177a1459a9c0c1ecd124e44ff/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:34.162991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e9fb4-8987-471d-80a2-582544ed6578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f94150c6e31842969aae640a379e43b7, user_id=2814c80177a1459a9c0c1ecd124e44ff, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:34.165746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e9fb4-8987-471d-80a2-582544ed6578 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:34.257991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1421/2862] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:07:34 2022] PUT /identity/v3/projects/f94150c6e31842969aae640a379e43b7/users/2814c80177a1459a9c0c1ecd124e44ff/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:34.261934 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e0773-0acd-4947-958b-1cff5524d1c1 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:34.272068 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e0773-0acd-4947-958b-1cff5524d1c1 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:34.328489 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c3c2d-55a5-452e-8162-f2261b5a5c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:34.329103 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c3c2d-55a5-452e-8162-f2261b5a5c83 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:34.329380 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c3c2d-55a5-452e-8162-f2261b5a5c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:34.329648 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c3c2d-55a5-452e-8162-f2261b5a5c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:34.330328 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c3c2d-55a5-452e-8162-f2261b5a5c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:34.331915 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c3c2d-55a5-452e-8162-f2261b5a5c83 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:34.342019 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1442/2863] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:07:34.346380 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e9fb4-8987-471d-80a2-582544ed6578 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:34.352957 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:34.357415 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e9fb4-8987-471d-80a2-582544ed6578 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:34.362367 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5e2f6-410c-4f55-8cfc-b29965948ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:34.363249 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5e2f6-410c-4f55-8cfc-b29965948ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:34.363373 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5e2f6-410c-4f55-8cfc-b29965948ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:34.363566 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5e2f6-410c-4f55-8cfc-b29965948ea2 admin admin] PATH_INFO: `/v3/projects/f94150c6e31842969aae640a379e43b7/users/2814c80177a1459a9c0c1ecd124e44ff/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:34.365503 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5e2f6-410c-4f55-8cfc-b29965948ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f94150c6e31842969aae640a379e43b7, user_id=2814c80177a1459a9c0c1ecd124e44ff, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:34.368191 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5e2f6-410c-4f55-8cfc-b29965948ea2 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:34.379999 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1422/2864] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:07:34 2022] PUT /identity/v3/projects/f94150c6e31842969aae640a379e43b7/users/2814c80177a1459a9c0c1ecd124e44ff/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:34.391183 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59761b-052b-42b6-9fda-5402bd553595 None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:34.391469 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59761b-052b-42b6-9fda-5402bd553595 None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:34.391745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59761b-052b-42b6-9fda-5402bd553595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:34.420468 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-fb59761b-052b-42b6-9fda-5402bd553595 None None] MFA Rules not processed for user `2814c80177a1459a9c0c1ecd124e44ff`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:34.421672 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-fb59761b-052b-42b6-9fda-5402bd553595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:34.491844 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1443/2865] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:07:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:07:34.503888 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5e2f6-410c-4f55-8cfc-b29965948ea2 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:34.506932 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-a6e5e2f6-410c-4f55-8cfc-b29965948ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:34.589852 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5e2f6-410c-4f55-8cfc-b29965948ea2 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:34.594018 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d54be-c9ff-454d-89b0-d260164527f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:34.594639 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d54be-c9ff-454d-89b0-d260164527f8 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:34.594922 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d54be-c9ff-454d-89b0-d260164527f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:34.595193 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d54be-c9ff-454d-89b0-d260164527f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:34.604045 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d54be-c9ff-454d-89b0-d260164527f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:34.605469 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d54be-c9ff-454d-89b0-d260164527f8 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:34.616648 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1423/2866] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:07:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:07:34.724426 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59761b-052b-42b6-9fda-5402bd553595 None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:34.725874 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-fb59761b-052b-42b6-9fda-5402bd553595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:34.738921 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59761b-052b-42b6-9fda-5402bd553595 None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:34.742536 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca1b44-683a-49e2-acf6-6ac0e56049d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:34.746295 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca1b44-683a-49e2-acf6-6ac0e56049d9 service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:34.746295 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca1b44-683a-49e2-acf6-6ac0e56049d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:34.746295 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca1b44-683a-49e2-acf6-6ac0e56049d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:34.799599 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca1b44-683a-49e2-acf6-6ac0e56049d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:34.800940 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca1b44-683a-49e2-acf6-6ac0e56049d9 service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:34.809525 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1444/2867] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:07:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:07:35.791694 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d54be-c9ff-454d-89b0-d260164527f8 service cinder] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:35.794363 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-c16d54be-c9ff-454d-89b0-d260164527f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:35.911127 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d54be-c9ff-454d-89b0-d260164527f8 service cinder] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:35.916896 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d21c9-5c18-4b58-8c2c-c041e4fa81eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1dc8e0d9454ad98894ed1e8d31f931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:35.917502 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d21c9-5c18-4b58-8c2c-c041e4fa81eb service nova] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:35.917779 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d21c9-5c18-4b58-8c2c-c041e4fa81eb service nova] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:35.918049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d21c9-5c18-4b58-8c2c-c041e4fa81eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:35.921058 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-015d21c9-5c18-4b58-8c2c-c041e4fa81eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:35.934893 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d21c9-5c18-4b58-8c2c-c041e4fa81eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:35.936650 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d21c9-5c18-4b58-8c2c-c041e4fa81eb service nova] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:35.949558 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1424/2868] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:07:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:07:38.738091 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca1b44-683a-49e2-acf6-6ac0e56049d9 service cinder] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:38.750774 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=100 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:38.800055 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca1b44-683a-49e2-acf6-6ac0e56049d9 service cinder] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:38.804750 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0281a-1638-4b0f-9227-941096b0874a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:38.805373 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0281a-1638-4b0f-9227-941096b0874a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:38.805653 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0281a-1638-4b0f-9227-941096b0874a admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:38.805925 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0281a-1638-4b0f-9227-941096b0874a admin admin] PATH_INFO: `/v3/users/2b0f82344657498b8ec62d5a2a47a411` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:38.807070 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0281a-1638-4b0f-9227-941096b0874a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b0f82344657498b8ec62d5a2a47a411)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:38.809011 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0281a-1638-4b0f-9227-941096b0874a admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:38.968899 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f0f0281a-1638-4b0f-9227-941096b0874a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b0f82344657498b8ec62d5a2a47a411'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:38.980698 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f0f0281a-1638-4b0f-9227-941096b0874a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b0f82344657498b8ec62d5a2a47a411'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:38.981981 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f0f0281a-1638-4b0f-9227-941096b0874a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b0f82344657498b8ec62d5a2a47a411'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:38.982636 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f0f0281a-1638-4b0f-9227-941096b0874a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b0f82344657498b8ec62d5a2a47a411'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:38.989341 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-f0f0281a-1638-4b0f-9227-941096b0874a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b0f82344657498b8ec62d5a2a47a411'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:39.054279 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1445/2869] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:07:38 2022] DELETE /identity/v3/users/2b0f82344657498b8ec62d5a2a47a411 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:39.059141 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed4acf-3214-4860-8470-a80144b4bf04 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:39.059670 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed4acf-3214-4860-8470-a80144b4bf04 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:39.059670 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed4acf-3214-4860-8470-a80144b4bf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:39.078763 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-b4ed4acf-3214-4860-8470-a80144b4bf04 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:39.079991 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-b4ed4acf-3214-4860-8470-a80144b4bf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:39.113338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:39.137049 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1425/2870] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:07:39.146745 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0281a-1638-4b0f-9227-941096b0874a admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:39.148129 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-f0f0281a-1638-4b0f-9227-941096b0874a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:39.204635 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0281a-1638-4b0f-9227-941096b0874a admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:39.208286 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11816d-d4f2-4c4d-ab94-b8f85da98786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:39.208883 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11816d-d4f2-4c4d-ab94-b8f85da98786 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:39.209170 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11816d-d4f2-4c4d-ab94-b8f85da98786 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:39.209439 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11816d-d4f2-4c4d-ab94-b8f85da98786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:39.219179 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f11816d-d4f2-4c4d-ab94-b8f85da98786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:39.220536 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f11816d-d4f2-4c4d-ab94-b8f85da98786 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:39.229857 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1446/2871] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:07:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:07:39.670874 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed4acf-3214-4860-8470-a80144b4bf04 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:39.672304 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-b4ed4acf-3214-4860-8470-a80144b4bf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:39.686413 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed4acf-3214-4860-8470-a80144b4bf04 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:39.691324 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23b419-c798-4892-a409-f798d17a8a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:39.691976 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23b419-c798-4892-a409-f798d17a8a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:39.692244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23b419-c798-4892-a409-f798d17a8a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:39.692579 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23b419-c798-4892-a409-f798d17a8a8f admin admin] PATH_INFO: `/v3/projects/e571d9c60efc48eb80cc33447cfab350` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:39.693637 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23b419-c798-4892-a409-f798d17a8a8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e571d9c60efc48eb80cc33447cfab350)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:39.695564 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23b419-c798-4892-a409-f798d17a8a8f admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:39.797161 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-3e23b419-c798-4892-a409-f798d17a8a8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e571d9c60efc48eb80cc33447cfab350', 'request_id': 'req-3e23b419-c798-4892-a409-f798d17a8a8f'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:39.802638 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-3e23b419-c798-4892-a409-f798d17a8a8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e571d9c60efc48eb80cc33447cfab350', 'request_id': 'req-3e23b419-c798-4892-a409-f798d17a8a8f'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:39.808660 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-3e23b419-c798-4892-a409-f798d17a8a8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e571d9c60efc48eb80cc33447cfab350', 'request_id': 'req-3e23b419-c798-4892-a409-f798d17a8a8f'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:39.880196 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-3e23b419-c798-4892-a409-f798d17a8a8f admin admin] The token cache is being invalidate because project e571d9c60efc48eb80cc33447cfab350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:07:39.880482 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-3e23b419-c798-4892-a409-f798d17a8a8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:39.881098 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-3e23b419-c798-4892-a409-f798d17a8a8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:39.882665 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1426/2872] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:07:39 2022] DELETE /identity/v3/projects/e571d9c60efc48eb80cc33447cfab350 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:39.886663 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11816d-d4f2-4c4d-ab94-b8f85da98786 service neutron] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:39.897063 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11816d-d4f2-4c4d-ab94-b8f85da98786 service neutron] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:39.928121 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:39.953642 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08cb9c-80b7-463b-be9b-17fd6841307b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:39.954300 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08cb9c-80b7-463b-be9b-17fd6841307b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:39.954578 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08cb9c-80b7-463b-be9b-17fd6841307b admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:39.954848 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08cb9c-80b7-463b-be9b-17fd6841307b admin admin] PATH_INFO: `/v3/users/05c836ed52c94ba391c45605bbc1c2d9` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:39.955949 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08cb9c-80b7-463b-be9b-17fd6841307b admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c836ed52c94ba391c45605bbc1c2d9)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:39.957981 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08cb9c-80b7-463b-be9b-17fd6841307b admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:40.150979 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ab08cb9c-80b7-463b-be9b-17fd6841307b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c836ed52c94ba391c45605bbc1c2d9'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:40.163172 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ab08cb9c-80b7-463b-be9b-17fd6841307b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c836ed52c94ba391c45605bbc1c2d9'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:40.163823 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ab08cb9c-80b7-463b-be9b-17fd6841307b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c836ed52c94ba391c45605bbc1c2d9'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:40.164419 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ab08cb9c-80b7-463b-be9b-17fd6841307b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c836ed52c94ba391c45605bbc1c2d9'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:40.171170 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-ab08cb9c-80b7-463b-be9b-17fd6841307b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c836ed52c94ba391c45605bbc1c2d9'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:40.263247 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1447/2873] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:07:39 2022] DELETE /identity/v3/users/05c836ed52c94ba391c45605bbc1c2d9 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:40.687857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23b419-c798-4892-a409-f798d17a8a8f admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:40.687857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-3e23b419-c798-4892-a409-f798d17a8a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:40.694491 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23b419-c798-4892-a409-f798d17a8a8f admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:40.754984 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85989700-c7f7-4a04-b754-82bf43b64d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:40.755631 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85989700-c7f7-4a04-b754-82bf43b64d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:40.755908 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85989700-c7f7-4a04-b754-82bf43b64d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:40.756182 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85989700-c7f7-4a04-b754-82bf43b64d34 admin admin] PATH_INFO: `/v3/projects/7ec6078605e64132906c5218cf35e8d7` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:40.757441 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85989700-c7f7-4a04-b754-82bf43b64d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ec6078605e64132906c5218cf35e8d7)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:40.759564 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85989700-c7f7-4a04-b754-82bf43b64d34 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:40.864403 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-85989700-c7f7-4a04-b754-82bf43b64d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ec6078605e64132906c5218cf35e8d7', 'request_id': 'req-85989700-c7f7-4a04-b754-82bf43b64d34'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:40.869863 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-85989700-c7f7-4a04-b754-82bf43b64d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ec6078605e64132906c5218cf35e8d7', 'request_id': 'req-85989700-c7f7-4a04-b754-82bf43b64d34'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:40.876646 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-85989700-c7f7-4a04-b754-82bf43b64d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ec6078605e64132906c5218cf35e8d7', 'request_id': 'req-85989700-c7f7-4a04-b754-82bf43b64d34'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:40.879230 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:40.980521 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-85989700-c7f7-4a04-b754-82bf43b64d34 admin admin] The token cache is being invalidate because project 7ec6078605e64132906c5218cf35e8d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:07:40.980730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-85989700-c7f7-4a04-b754-82bf43b64d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:40.981885 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-85989700-c7f7-4a04-b754-82bf43b64d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:40.983408 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1427/2874] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:07:40 2022] DELETE /identity/v3/projects/7ec6078605e64132906c5218cf35e8d7 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:40.987555 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08cb9c-80b7-463b-be9b-17fd6841307b admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:40.988977 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-ab08cb9c-80b7-463b-be9b-17fd6841307b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:41.002267 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08cb9c-80b7-463b-be9b-17fd6841307b admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:41.056758 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00ca67-a527-46d8-8683-25ff9e32ea13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:41.057373 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00ca67-a527-46d8-8683-25ff9e32ea13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:41.057653 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00ca67-a527-46d8-8683-25ff9e32ea13 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:41.057922 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00ca67-a527-46d8-8683-25ff9e32ea13 admin admin] PATH_INFO: `/v3/users/2814c80177a1459a9c0c1ecd124e44ff` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:41.059120 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00ca67-a527-46d8-8683-25ff9e32ea13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2814c80177a1459a9c0c1ecd124e44ff)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:41.061663 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00ca67-a527-46d8-8683-25ff9e32ea13 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:41.248566 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-9f00ca67-a527-46d8-8683-25ff9e32ea13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2814c80177a1459a9c0c1ecd124e44ff'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:41.253637 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:41.260275 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-9f00ca67-a527-46d8-8683-25ff9e32ea13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2814c80177a1459a9c0c1ecd124e44ff'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:41.260928 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-9f00ca67-a527-46d8-8683-25ff9e32ea13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2814c80177a1459a9c0c1ecd124e44ff'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:41.261523 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-9f00ca67-a527-46d8-8683-25ff9e32ea13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2814c80177a1459a9c0c1ecd124e44ff'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:41.268808 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-9f00ca67-a527-46d8-8683-25ff9e32ea13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2814c80177a1459a9c0c1ecd124e44ff'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:41.346723 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1448/2875] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:07:40 2022] DELETE /identity/v3/users/2814c80177a1459a9c0c1ecd124e44ff => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:41.744557 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85989700-c7f7-4a04-b754-82bf43b64d34 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:41.746014 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-85989700-c7f7-4a04-b754-82bf43b64d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:41.759791 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85989700-c7f7-4a04-b754-82bf43b64d34 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:41.821531 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99e8bb-109e-4a5c-83b1-ea06af3ec351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:41.822182 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99e8bb-109e-4a5c-83b1-ea06af3ec351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:41.822461 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99e8bb-109e-4a5c-83b1-ea06af3ec351 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:41.822764 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99e8bb-109e-4a5c-83b1-ea06af3ec351 admin admin] PATH_INFO: `/v3/projects/f94150c6e31842969aae640a379e43b7` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:41.823845 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99e8bb-109e-4a5c-83b1-ea06af3ec351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f94150c6e31842969aae640a379e43b7)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:41.825778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99e8bb-109e-4a5c-83b1-ea06af3ec351 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:41.924102 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-6c99e8bb-109e-4a5c-83b1-ea06af3ec351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f94150c6e31842969aae640a379e43b7', 'request_id': 'req-6c99e8bb-109e-4a5c-83b1-ea06af3ec351'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:41.929617 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-6c99e8bb-109e-4a5c-83b1-ea06af3ec351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f94150c6e31842969aae640a379e43b7', 'request_id': 'req-6c99e8bb-109e-4a5c-83b1-ea06af3ec351'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:41.935791 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-6c99e8bb-109e-4a5c-83b1-ea06af3ec351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f94150c6e31842969aae640a379e43b7', 'request_id': 'req-6c99e8bb-109e-4a5c-83b1-ea06af3ec351'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:42.010920 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-6c99e8bb-109e-4a5c-83b1-ea06af3ec351 admin admin] The token cache is being invalidate because project f94150c6e31842969aae640a379e43b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:07:42.011208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-6c99e8bb-109e-4a5c-83b1-ea06af3ec351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:42.011821 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-6c99e8bb-109e-4a5c-83b1-ea06af3ec351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:42.013330 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1428/2876] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:07:41 2022] DELETE /identity/v3/projects/f94150c6e31842969aae640a379e43b7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:42.019544 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e015716-0b43-404b-b5d3-043c8f9cdb6f None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:42.020017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e015716-0b43-404b-b5d3-043c8f9cdb6f None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:42.020017 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e015716-0b43-404b-b5d3-043c8f9cdb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:42.039534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-3e015716-0b43-404b-b5d3-043c8f9cdb6f None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:42.040736 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-3e015716-0b43-404b-b5d3-043c8f9cdb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:42.102155 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1449/2877] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:07:42.113257 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62386b67-f311-4665-9c2a-4e382c9ab189 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:42.113537 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62386b67-f311-4665-9c2a-4e382c9ab189 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:42.113807 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62386b67-f311-4665-9c2a-4e382c9ab189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:42.132852 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-62386b67-f311-4665-9c2a-4e382c9ab189 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:42.134040 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-62386b67-f311-4665-9c2a-4e382c9ab189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:42.141846 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1429/2878] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:07:42.146037 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e015716-0b43-404b-b5d3-043c8f9cdb6f None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:42.156159 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e015716-0b43-404b-b5d3-043c8f9cdb6f None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:42.160755 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb880e-e687-4156-b0c6-a9ca4fea3045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:42.161396 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb880e-e687-4156-b0c6-a9ca4fea3045 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:42.161725 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb880e-e687-4156-b0c6-a9ca4fea3045 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:42.162029 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb880e-e687-4156-b0c6-a9ca4fea3045 admin admin] PATH_INFO: `/v3/domains` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:42.162721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb880e-e687-4156-b0c6-a9ca4fea3045 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:07:42.163024 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb880e-e687-4156-b0c6-a9ca4fea3045 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:42.164606 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb880e-e687-4156-b0c6-a9ca4fea3045 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:42.176727 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1450/2879] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Aug 11 10:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:07:42.180704 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62386b67-f311-4665-9c2a-4e382c9ab189 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:42.189747 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62386b67-f311-4665-9c2a-4e382c9ab189 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:42.194370 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedde50-4568-4b1f-8b0f-5adf237250f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:42.194951 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedde50-4568-4b1f-8b0f-5adf237250f2 admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:42.195223 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedde50-4568-4b1f-8b0f-5adf237250f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:42.195487 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedde50-4568-4b1f-8b0f-5adf237250f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:42.196096 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaedde50-4568-4b1f-8b0f-5adf237250f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:42.197956 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaedde50-4568-4b1f-8b0f-5adf237250f2 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:42.282295 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1430/2880] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:07:42 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:07:42.286454 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb880e-e687-4156-b0c6-a9ca4fea3045 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:42.296582 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb880e-e687-4156-b0c6-a9ca4fea3045 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:42.352625 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a522361-96c7-4736-a4ec-99eb4a4fa121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:42.353226 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a522361-96c7-4736-a4ec-99eb4a4fa121 admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:42.353527 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a522361-96c7-4736-a4ec-99eb4a4fa121 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:42.353801 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a522361-96c7-4736-a4ec-99eb4a4fa121 admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:42.354492 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a522361-96c7-4736-a4ec-99eb4a4fa121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:42.356428 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a522361-96c7-4736-a4ec-99eb4a4fa121 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:42.430133 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1451/2881] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:07:42 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:07:42.433975 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedde50-4568-4b1f-8b0f-5adf237250f2 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:42.444519 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedde50-4568-4b1f-8b0f-5adf237250f2 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:42.449108 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d11397-6e38-4c1e-bf87-a86ae6650893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:42.449694 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d11397-6e38-4c1e-bf87-a86ae6650893 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:42.449966 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d11397-6e38-4c1e-bf87-a86ae6650893 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:42.450794 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d11397-6e38-4c1e-bf87-a86ae6650893 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:42.451425 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d11397-6e38-4c1e-bf87-a86ae6650893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:42.453001 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d11397-6e38-4c1e-bf87-a86ae6650893 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:42.462906 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1431/2882] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:07:42.467801 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a522361-96c7-4736-a4ec-99eb4a4fa121 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:42.477731 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a522361-96c7-4736-a4ec-99eb4a4fa121 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:42.482978 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0d9f8-d62f-444d-aa7f-783f2748cdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:42.483568 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0d9f8-d62f-444d-aa7f-783f2748cdb6 admin admin] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:42.483847 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0d9f8-d62f-444d-aa7f-783f2748cdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:42.484119 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0d9f8-d62f-444d-aa7f-783f2748cdb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:42.484754 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0d9f8-d62f-444d-aa7f-783f2748cdb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:42.486405 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0d9f8-d62f-444d-aa7f-783f2748cdb6 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:42.499006 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1452/2883] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:07:42.503233 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d11397-6e38-4c1e-bf87-a86ae6650893 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:42.513157 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d11397-6e38-4c1e-bf87-a86ae6650893 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:42.517769 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e6866-424b-4c9b-8868-256854cc1f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:42.518442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e6866-424b-4c9b-8868-256854cc1f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:42.518724 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e6866-424b-4c9b-8868-256854cc1f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:42.518995 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e6866-424b-4c9b-8868-256854cc1f42 admin admin] PATH_INFO: `/v3/projects/798f6ee45c774fb297bced67209d73a0/users/fe1def1477c74d808dd79ee1bbde17e4/roles/9b9c9f22f65c459bacd757d5de4d5b8e` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:42.533178 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e6866-424b-4c9b-8868-256854cc1f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=798f6ee45c774fb297bced67209d73a0, user_id=fe1def1477c74d808dd79ee1bbde17e4, role_id=9b9c9f22f65c459bacd757d5de4d5b8e)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:42.535812 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e6866-424b-4c9b-8868-256854cc1f42 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:42.610682 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1432/2884] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:07:42 2022] PUT /identity/v3/projects/798f6ee45c774fb297bced67209d73a0/users/fe1def1477c74d808dd79ee1bbde17e4/roles/9b9c9f22f65c459bacd757d5de4d5b8e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:42.622753 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bbd9a-e59a-4279-8913-800592cfd39a None None] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:42.623039 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bbd9a-e59a-4279-8913-800592cfd39a None None] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:42.623338 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bbd9a-e59a-4279-8913-800592cfd39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:42.650805 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.auth.core [None req-237bbd9a-e59a-4279-8913-800592cfd39a None None] MFA Rules not processed for user `fe1def1477c74d808dd79ee1bbde17e4`. Rule list: `[]` (Enabled: `True`). {{(pid=98478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:42.652130 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-237bbd9a-e59a-4279-8913-800592cfd39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:42.680752 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:42.718845 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1453/2885] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:07:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:07:42.723403 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e6866-424b-4c9b-8868-256854cc1f42 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:42.746516 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:42.792134 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e6866-424b-4c9b-8868-256854cc1f42 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:42.796728 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1121013-5cf9-4b97-aa1d-c4ce151674de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:42.797338 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1121013-5cf9-4b97-aa1d-c4ce151674de admin admin] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:42.797616 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1121013-5cf9-4b97-aa1d-c4ce151674de admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:42.797887 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1121013-5cf9-4b97-aa1d-c4ce151674de admin admin] PATH_INFO: `/v3/projects` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:42.798540 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1121013-5cf9-4b97-aa1d-c4ce151674de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:42.800437 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1121013-5cf9-4b97-aa1d-c4ce151674de admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:42.925037 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1433/2886] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Aug 11 10:07:42 2022] POST /identity/v3/projects => generated 383 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:07:42.929131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bbd9a-e59a-4279-8913-800592cfd39a None None] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:42.940246 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bbd9a-e59a-4279-8913-800592cfd39a None None] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:42.996178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139efb1-30a2-40b3-a03a-44e21cf8702d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:42.996780 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139efb1-30a2-40b3-a03a-44e21cf8702d admin admin] REQUEST_METHOD: `POST` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:42.997663 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139efb1-30a2-40b3-a03a-44e21cf8702d admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:42.997934 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139efb1-30a2-40b3-a03a-44e21cf8702d admin admin] PATH_INFO: `/v3/users` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:42.998609 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139efb1-30a2-40b3-a03a-44e21cf8702d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:43.000521 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139efb1-30a2-40b3-a03a-44e21cf8702d admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:43.114545 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1454/2887] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Aug 11 10:07:42 2022] POST /identity/v3/users => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:07:43.118420 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1121013-5cf9-4b97-aa1d-c4ce151674de admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:43.129137 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1121013-5cf9-4b97-aa1d-c4ce151674de admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:43.133623 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac29bf8-7bee-4d5e-a2b5-a39e2a4fb31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:43.134247 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac29bf8-7bee-4d5e-a2b5-a39e2a4fb31f admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:43.134525 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac29bf8-7bee-4d5e-a2b5-a39e2a4fb31f admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:43.134794 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac29bf8-7bee-4d5e-a2b5-a39e2a4fb31f admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:43.135424 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac29bf8-7bee-4d5e-a2b5-a39e2a4fb31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:43.137051 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac29bf8-7bee-4d5e-a2b5-a39e2a4fb31f admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:43.147267 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1434/2888] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:07:43.151377 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139efb1-30a2-40b3-a03a-44e21cf8702d admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:43.161156 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139efb1-30a2-40b3-a03a-44e21cf8702d admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:43.165721 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797a3df-a58c-45f1-a302-96863fd2d40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:43.166385 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797a3df-a58c-45f1-a302-96863fd2d40a admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:43.166676 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797a3df-a58c-45f1-a302-96863fd2d40a admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:43.166930 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797a3df-a58c-45f1-a302-96863fd2d40a admin admin] PATH_INFO: `/v3/projects/646b6554697f40aaa3e8ff703a6d9af4/users/80a069349a704a7fa039d8ab5558e74e/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:43.181777 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797a3df-a58c-45f1-a302-96863fd2d40a admin admin] RBAC: Authorizing `identity:create_grant(project_id=646b6554697f40aaa3e8ff703a6d9af4, user_id=80a069349a704a7fa039d8ab5558e74e, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:43.185177 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797a3df-a58c-45f1-a302-96863fd2d40a admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:43.257051 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1455/2889] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:07:43 2022] PUT /identity/v3/projects/646b6554697f40aaa3e8ff703a6d9af4/users/80a069349a704a7fa039d8ab5558e74e/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:43.260899 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac29bf8-7bee-4d5e-a2b5-a39e2a4fb31f admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:43.270934 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac29bf8-7bee-4d5e-a2b5-a39e2a4fb31f admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:43.324782 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca3ac5-42b2-4190-988c-3f6d47677199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:43.325471 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca3ac5-42b2-4190-988c-3f6d47677199 admin admin] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:43.325746 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca3ac5-42b2-4190-988c-3f6d47677199 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:43.326013 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca3ac5-42b2-4190-988c-3f6d47677199 admin admin] PATH_INFO: `/v3/roles` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:43.326666 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca3ac5-42b2-4190-988c-3f6d47677199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:43.328231 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca3ac5-42b2-4190-988c-3f6d47677199 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:43.337783 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1435/2890] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Aug 11 10:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:07:43.341841 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797a3df-a58c-45f1-a302-96863fd2d40a admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:43.351909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797a3df-a58c-45f1-a302-96863fd2d40a admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:43.356955 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0727e0-b127-408a-99a6-3c70bea933f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:43.357612 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0727e0-b127-408a-99a6-3c70bea933f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:43.357884 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0727e0-b127-408a-99a6-3c70bea933f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:43.358178 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0727e0-b127-408a-99a6-3c70bea933f3 admin admin] PATH_INFO: `/v3/projects/646b6554697f40aaa3e8ff703a6d9af4/users/80a069349a704a7fa039d8ab5558e74e/roles/6aae1c66f3f04cec80ed72c20d7e033b` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:43.360047 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0727e0-b127-408a-99a6-3c70bea933f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=646b6554697f40aaa3e8ff703a6d9af4, user_id=80a069349a704a7fa039d8ab5558e74e, role_id=6aae1c66f3f04cec80ed72c20d7e033b)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:43.362692 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0727e0-b127-408a-99a6-3c70bea933f3 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:43.373131 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1456/2891] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Aug 11 10:07:43 2022] PUT /identity/v3/projects/646b6554697f40aaa3e8ff703a6d9af4/users/80a069349a704a7fa039d8ab5558e74e/roles/6aae1c66f3f04cec80ed72c20d7e033b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:43.383726 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0dd8f4-3fb6-4ccb-9695-f1ce47ad605b None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:43.384094 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0dd8f4-3fb6-4ccb-9695-f1ce47ad605b None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:43.384431 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0dd8f4-3fb6-4ccb-9695-f1ce47ad605b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:43.411730 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-da0dd8f4-3fb6-4ccb-9695-f1ce47ad605b None None] MFA Rules not processed for user `80a069349a704a7fa039d8ab5558e74e`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:43.412930 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-da0dd8f4-3fb6-4ccb-9695-f1ce47ad605b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:43.479613 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1436/2892] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:07:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:07:43.491228 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0727e0-b127-408a-99a6-3c70bea933f3 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:43.492917 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-7d0727e0-b127-408a-99a6-3c70bea933f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:43.549057 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0727e0-b127-408a-99a6-3c70bea933f3 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:43.552678 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df222272-acff-4f8e-b82e-76ad5ecd7dbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:43.553268 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df222272-acff-4f8e-b82e-76ad5ecd7dbd service cinder] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:43.553545 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df222272-acff-4f8e-b82e-76ad5ecd7dbd service cinder] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:43.553810 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df222272-acff-4f8e-b82e-76ad5ecd7dbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:43.584623 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:43.608363 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df222272-acff-4f8e-b82e-76ad5ecd7dbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:43.609772 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df222272-acff-4f8e-b82e-76ad5ecd7dbd service cinder] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:43.618531 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1457/2893] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:07:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:07:48.697231 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0dd8f4-3fb6-4ccb-9695-f1ce47ad605b None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:48.698644 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-da0dd8f4-3fb6-4ccb-9695-f1ce47ad605b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:48.711074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0dd8f4-3fb6-4ccb-9695-f1ce47ad605b None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:48.714585 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132167a2-6a06-4556-af24-08ffba6abab8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '740fc24dc2134f5ca2fba8caa9abb3cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:48.715169 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132167a2-6a06-4556-af24-08ffba6abab8 service cinder] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:48.715442 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132167a2-6a06-4556-af24-08ffba6abab8 service cinder] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:48.715708 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132167a2-6a06-4556-af24-08ffba6abab8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:48.724291 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132167a2-6a06-4556-af24-08ffba6abab8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:48.725671 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132167a2-6a06-4556-af24-08ffba6abab8 service cinder] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:48.734894 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1437/2894] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:07:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:07:53.649129 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=12 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:54.798287 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df222272-acff-4f8e-b82e-76ad5ecd7dbd service cinder] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:54.860020 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df222272-acff-4f8e-b82e-76ad5ecd7dbd service cinder] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:54.864527 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb85f1-506d-4505-a007-b989a1aef673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:54.865147 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb85f1-506d-4505-a007-b989a1aef673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:54.865440 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb85f1-506d-4505-a007-b989a1aef673 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:54.865692 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb85f1-506d-4505-a007-b989a1aef673 admin admin] PATH_INFO: `/v3/users/fe1def1477c74d808dd79ee1bbde17e4` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:54.866825 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb85f1-506d-4505-a007-b989a1aef673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe1def1477c74d808dd79ee1bbde17e4)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:54.873297 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb85f1-506d-4505-a007-b989a1aef673 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:55.068701 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-6bbb85f1-506d-4505-a007-b989a1aef673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe1def1477c74d808dd79ee1bbde17e4'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:55.081267 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-6bbb85f1-506d-4505-a007-b989a1aef673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe1def1477c74d808dd79ee1bbde17e4'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:55.081963 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-6bbb85f1-506d-4505-a007-b989a1aef673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe1def1477c74d808dd79ee1bbde17e4'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:55.082743 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-6bbb85f1-506d-4505-a007-b989a1aef673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe1def1477c74d808dd79ee1bbde17e4'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:55.090029 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-6bbb85f1-506d-4505-a007-b989a1aef673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe1def1477c74d808dd79ee1bbde17e4'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:55.166041 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1458/2895] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:07:54 2022] DELETE /identity/v3/users/fe1def1477c74d808dd79ee1bbde17e4 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:55.170629 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56501d42-f742-44a7-bf25-74c7001f6e75 None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:55.171153 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56501d42-f742-44a7-bf25-74c7001f6e75 None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:55.171153 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56501d42-f742-44a7-bf25-74c7001f6e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:55.178230 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:55.190508 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-56501d42-f742-44a7-bf25-74c7001f6e75 None None] MFA Rules not processed for user `07db6516e8ce4759bb6e5167b3fb5367`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:07:55.191703 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-56501d42-f742-44a7-bf25-74c7001f6e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:55.248814 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1438/2896] 10.222.0.13 () {58 vars in 958 bytes} [Thu Aug 11 10:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:07:55.259084 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb85f1-506d-4505-a007-b989a1aef673 admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:55.260538 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-6bbb85f1-506d-4505-a007-b989a1aef673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:55.316478 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb85f1-506d-4505-a007-b989a1aef673 admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:55.320085 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c110d-082b-4c68-878c-9191495ceb36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac6ca32b5144c59b2bb5086fbd53ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:55.320614 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c110d-082b-4c68-878c-9191495ceb36 service neutron] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:55.320885 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c110d-082b-4c68-878c-9191495ceb36 service neutron] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:55.321152 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c110d-082b-4c68-878c-9191495ceb36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:55.330441 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c110d-082b-4c68-878c-9191495ceb36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:55.331839 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c110d-082b-4c68-878c-9191495ceb36 service neutron] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:55.341386 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1459/2897] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:07:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:07:55.720154 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56501d42-f742-44a7-bf25-74c7001f6e75 None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:55.721601 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-56501d42-f742-44a7-bf25-74c7001f6e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:55.734043 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56501d42-f742-44a7-bf25-74c7001f6e75 None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:55.738941 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c517aca-faf9-415c-8bb6-115e6fdfe514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:55.739577 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c517aca-faf9-415c-8bb6-115e6fdfe514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:55.739857 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c517aca-faf9-415c-8bb6-115e6fdfe514 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:55.740122 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c517aca-faf9-415c-8bb6-115e6fdfe514 admin admin] PATH_INFO: `/v3/projects/798f6ee45c774fb297bced67209d73a0` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:55.741235 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c517aca-faf9-415c-8bb6-115e6fdfe514 admin admin] RBAC: Authorizing `identity:delete_project(project_id=798f6ee45c774fb297bced67209d73a0)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:55.743394 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c517aca-faf9-415c-8bb6-115e6fdfe514 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:55.852750 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-8c517aca-faf9-415c-8bb6-115e6fdfe514 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '798f6ee45c774fb297bced67209d73a0', 'request_id': 'req-8c517aca-faf9-415c-8bb6-115e6fdfe514'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:55.858074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-8c517aca-faf9-415c-8bb6-115e6fdfe514 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '798f6ee45c774fb297bced67209d73a0', 'request_id': 'req-8c517aca-faf9-415c-8bb6-115e6fdfe514'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:55.864822 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-8c517aca-faf9-415c-8bb6-115e6fdfe514 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '798f6ee45c774fb297bced67209d73a0', 'request_id': 'req-8c517aca-faf9-415c-8bb6-115e6fdfe514'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:55.948372 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-8c517aca-faf9-415c-8bb6-115e6fdfe514 admin admin] The token cache is being invalidate because project 798f6ee45c774fb297bced67209d73a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:07:55.948762 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-8c517aca-faf9-415c-8bb6-115e6fdfe514 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:55.949396 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-8c517aca-faf9-415c-8bb6-115e6fdfe514 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:55.950920 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1439/2898] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:07:55 2022] DELETE /identity/v3/projects/798f6ee45c774fb297bced67209d73a0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:07:55.954998 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c110d-082b-4c68-878c-9191495ceb36 service neutron] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:55.964866 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c110d-082b-4c68-878c-9191495ceb36 service neutron] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:55.982909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:56.020534 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23cade-31a9-42db-ae54-108f724945cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:56.021150 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23cade-31a9-42db-ae54-108f724945cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:56.021428 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23cade-31a9-42db-ae54-108f724945cb admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:56.021700 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23cade-31a9-42db-ae54-108f724945cb admin admin] PATH_INFO: `/v3/users/80a069349a704a7fa039d8ab5558e74e` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:56.022835 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23cade-31a9-42db-ae54-108f724945cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=80a069349a704a7fa039d8ab5558e74e)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:56.024743 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23cade-31a9-42db-ae54-108f724945cb admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:56.188079 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-7e23cade-31a9-42db-ae54-108f724945cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80a069349a704a7fa039d8ab5558e74e'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:56.199555 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-7e23cade-31a9-42db-ae54-108f724945cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80a069349a704a7fa039d8ab5558e74e'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:56.200221 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-7e23cade-31a9-42db-ae54-108f724945cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80a069349a704a7fa039d8ab5558e74e'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:56.200821 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-7e23cade-31a9-42db-ae54-108f724945cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80a069349a704a7fa039d8ab5558e74e'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:56.208109 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-7e23cade-31a9-42db-ae54-108f724945cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80a069349a704a7fa039d8ab5558e74e'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:56.272405 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1460/2899] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:07:55 2022] DELETE /identity/v3/users/80a069349a704a7fa039d8ab5558e74e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:07:56.694352 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c517aca-faf9-415c-8bb6-115e6fdfe514 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:07:56.695765 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-8c517aca-faf9-415c-8bb6-115e6fdfe514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:07:56.709979 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c517aca-faf9-415c-8bb6-115e6fdfe514 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:07:56.767582 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900f877-a8ae-4c31-abf4-97108fc83828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:07:56.768207 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900f877-a8ae-4c31-abf4-97108fc83828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:07:56.768507 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900f877-a8ae-4c31-abf4-97108fc83828 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:07:56.768778 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900f877-a8ae-4c31-abf4-97108fc83828 admin admin] PATH_INFO: `/v3/projects/646b6554697f40aaa3e8ff703a6d9af4` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:07:56.769879 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900f877-a8ae-4c31-abf4-97108fc83828 admin admin] RBAC: Authorizing `identity:delete_project(project_id=646b6554697f40aaa3e8ff703a6d9af4)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:07:56.772055 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900f877-a8ae-4c31-abf4-97108fc83828 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:07:56.886985 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:07:56.902275 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c900f877-a8ae-4c31-abf4-97108fc83828 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '646b6554697f40aaa3e8ff703a6d9af4', 'request_id': 'req-c900f877-a8ae-4c31-abf4-97108fc83828'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:56.908271 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c900f877-a8ae-4c31-abf4-97108fc83828 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '646b6554697f40aaa3e8ff703a6d9af4', 'request_id': 'req-c900f877-a8ae-4c31-abf4-97108fc83828'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:56.914394 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c900f877-a8ae-4c31-abf4-97108fc83828 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '646b6554697f40aaa3e8ff703a6d9af4', 'request_id': 'req-c900f877-a8ae-4c31-abf4-97108fc83828'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:56.977684 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c900f877-a8ae-4c31-abf4-97108fc83828 admin admin] The token cache is being invalidate because project 646b6554697f40aaa3e8ff703a6d9af4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98479) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:07:56.977877 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c900f877-a8ae-4c31-abf4-97108fc83828 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:56.978560 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-c900f877-a8ae-4c31-abf4-97108fc83828 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:07:56.980048 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1440/2900] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:07:56 2022] DELETE /identity/v3/projects/646b6554697f40aaa3e8ff703a6d9af4 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:08:06.268543 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=43,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:08:07.046879 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=14,keystone:DELETE=5,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:08:15.198694 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23cade-31a9-42db-ae54-108f724945cb admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:08:15.200102 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-7e23cade-31a9-42db-ae54-108f724945cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:08:15.288067 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23cade-31a9-42db-ae54-108f724945cb admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:08:15.345724 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41052100-e2b4-4108-85a0-d516401a4191 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0061ce46df224f4491599ed10548b2ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:08:15.346349 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41052100-e2b4-4108-85a0-d516401a4191 service placement] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:08:15.346623 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41052100-e2b4-4108-85a0-d516401a4191 service placement] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:08:15.346890 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41052100-e2b4-4108-85a0-d516401a4191 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:08:15.348620 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-41052100-e2b4-4108-85a0-d516401a4191 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:08:15.359486 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41052100-e2b4-4108-85a0-d516401a4191 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:08:15.362115 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41052100-e2b4-4108-85a0-d516401a4191 service placement] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:08:15.370775 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1461/2901] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:08:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:08:25.366501 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=67 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:09:02.173090 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82796c9-699f-41c9-bd4c-e04d1f36fb6a None None] REQUEST_METHOD: `POST` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:09:02.173604 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82796c9-699f-41c9-bd4c-e04d1f36fb6a None None] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:09:02.173715 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82796c9-699f-41c9-bd4c-e04d1f36fb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:09:02.193430 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.auth.core [None req-a82796c9-699f-41c9-bd4c-e04d1f36fb6a None None] MFA Rules not processed for user `d392c30328a3491bb186bd7b55f4d99c`. Rule list: `[]` (Enabled: `True`). {{(pid=98479) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:09:02.194658 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-a82796c9-699f-41c9-bd4c-e04d1f36fb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:09:02.247511 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1441/2902] 10.222.0.13 () {58 vars in 967 bytes} [Thu Aug 11 10:09:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:09:02.407909 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41052100-e2b4-4108-85a0-d516401a4191 service placement] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:09:02.409350 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-41052100-e2b4-4108-85a0-d516401a4191 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:09:02.489838 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41052100-e2b4-4108-85a0-d516401a4191 service placement] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:09:02.494992 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3171f62-c7f9-4b8c-84c4-68e1935760f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e3b1c5aec94673b391210ae51d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:09:02.495591 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3171f62-c7f9-4b8c-84c4-68e1935760f2 service swift] REQUEST_METHOD: `GET` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:09:02.495867 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3171f62-c7f9-4b8c-84c4-68e1935760f2 service swift] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:09:02.496136 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3171f62-c7f9-4b8c-84c4-68e1935760f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:09:02.507464 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3171f62-c7f9-4b8c-84c4-68e1935760f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:09:02.509028 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3171f62-c7f9-4b8c-84c4-68e1935760f2 service swift] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:09:02.517358 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1462/2903] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Aug 11 10:09:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 11 10:09:10.279958 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82796c9-699f-41c9-bd4c-e04d1f36fb6a None None] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:09:10.281411 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-a82796c9-699f-41c9-bd4c-e04d1f36fb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:09:10.345779 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82796c9-699f-41c9-bd4c-e04d1f36fb6a None None] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:09:10.350823 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f4823-1d6f-45d9-91f1-9e5d0f4bdd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:09:10.351438 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f4823-1d6f-45d9-91f1-9e5d0f4bdd14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:09:10.351710 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f4823-1d6f-45d9-91f1-9e5d0f4bdd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:09:10.351986 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f4823-1d6f-45d9-91f1-9e5d0f4bdd14 admin admin] PATH_INFO: `/v3/users/56a3d8f90c8b4957b774d2d06b76d47c` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:09:10.353087 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f4823-1d6f-45d9-91f1-9e5d0f4bdd14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56a3d8f90c8b4957b774d2d06b76d47c)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:09:10.355095 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f4823-1d6f-45d9-91f1-9e5d0f4bdd14 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:09:10.561053 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-4c8f4823-1d6f-45d9-91f1-9e5d0f4bdd14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56a3d8f90c8b4957b774d2d06b76d47c'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:09:10.572819 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-4c8f4823-1d6f-45d9-91f1-9e5d0f4bdd14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56a3d8f90c8b4957b774d2d06b76d47c'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:09:10.573633 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-4c8f4823-1d6f-45d9-91f1-9e5d0f4bdd14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56a3d8f90c8b4957b774d2d06b76d47c'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:09:10.580396 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-4c8f4823-1d6f-45d9-91f1-9e5d0f4bdd14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56a3d8f90c8b4957b774d2d06b76d47c'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:09:10.696079 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-4c8f4823-1d6f-45d9-91f1-9e5d0f4bdd14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56a3d8f90c8b4957b774d2d06b76d47c'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:09:10.702632 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1442/2904] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:09:10 2022] DELETE /identity/v3/users/56a3d8f90c8b4957b774d2d06b76d47c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:09:10.943426 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3171f62-c7f9-4b8c-84c4-68e1935760f2 service swift] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:09:10.956510 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3171f62-c7f9-4b8c-84c4-68e1935760f2 service swift] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:09:11.014978 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6cfe8-f1f4-4bab-82f3-219f71409f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:09:11.015601 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6cfe8-f1f4-4bab-82f3-219f71409f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:09:11.015878 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6cfe8-f1f4-4bab-82f3-219f71409f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:09:11.016151 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6cfe8-f1f4-4bab-82f3-219f71409f1b admin admin] PATH_INFO: `/v3/projects/bba7887b39ca4dfebd870443d5d53286` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:09:11.017263 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6cfe8-f1f4-4bab-82f3-219f71409f1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba7887b39ca4dfebd870443d5d53286)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:09:11.019212 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6cfe8-f1f4-4bab-82f3-219f71409f1b admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:09:11.112211 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-91a6cfe8-f1f4-4bab-82f3-219f71409f1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba7887b39ca4dfebd870443d5d53286', 'request_id': 'req-91a6cfe8-f1f4-4bab-82f3-219f71409f1b'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:09:11.118217 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-91a6cfe8-f1f4-4bab-82f3-219f71409f1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba7887b39ca4dfebd870443d5d53286', 'request_id': 'req-91a6cfe8-f1f4-4bab-82f3-219f71409f1b'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:09:11.196473 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-91a6cfe8-f1f4-4bab-82f3-219f71409f1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba7887b39ca4dfebd870443d5d53286', 'request_id': 'req-91a6cfe8-f1f4-4bab-82f3-219f71409f1b'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:09:11.208070 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-91a6cfe8-f1f4-4bab-82f3-219f71409f1b admin admin] The token cache is being invalidate because project bba7887b39ca4dfebd870443d5d53286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:09:11.208757 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-91a6cfe8-f1f4-4bab-82f3-219f71409f1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:09:11.208958 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-91a6cfe8-f1f4-4bab-82f3-219f71409f1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:09:11.210453 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1463/2905] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:09:10 2022] DELETE /identity/v3/projects/bba7887b39ca4dfebd870443d5d53286 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:09:11.214827 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f4823-1d6f-45d9-91f1-9e5d0f4bdd14 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:09:11.216269 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-4c8f4823-1d6f-45d9-91f1-9e5d0f4bdd14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:09:11.229398 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f4823-1d6f-45d9-91f1-9e5d0f4bdd14 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:09:11.249110 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:09:11.284845 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b980d-ccd8-4fca-874b-139d67fb14e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:09:11.285529 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b980d-ccd8-4fca-874b-139d67fb14e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:09:11.285803 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b980d-ccd8-4fca-874b-139d67fb14e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:09:11.286074 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b980d-ccd8-4fca-874b-139d67fb14e1 admin admin] PATH_INFO: `/v3/users/80f6c99a2b5444a0a67c5708c3e46178` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:09:11.287289 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b980d-ccd8-4fca-874b-139d67fb14e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80f6c99a2b5444a0a67c5708c3e46178)` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:09:11.289360 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b980d-ccd8-4fca-874b-139d67fb14e1 admin admin] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:09:11.487119 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-5c7b980d-ccd8-4fca-874b-139d67fb14e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80f6c99a2b5444a0a67c5708c3e46178'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:09:11.499380 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-5c7b980d-ccd8-4fca-874b-139d67fb14e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80f6c99a2b5444a0a67c5708c3e46178'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:09:11.500067 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-5c7b980d-ccd8-4fca-874b-139d67fb14e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80f6c99a2b5444a0a67c5708c3e46178'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:09:11.507244 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-5c7b980d-ccd8-4fca-874b-139d67fb14e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80f6c99a2b5444a0a67c5708c3e46178'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:09:11.573112 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.notifications [None req-5c7b980d-ccd8-4fca-874b-139d67fb14e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80f6c99a2b5444a0a67c5708c3e46178'} {{(pid=98479) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:09:11.579211 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1443/2906] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Aug 11 10:09:11 2022] DELETE /identity/v3/users/80f6c99a2b5444a0a67c5708c3e46178 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:09:11.820764 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6cfe8-f1f4-4bab-82f3-219f71409f1b admin admin] Authenticating user token {{(pid=98478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:09:11.822233 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.fernet_utils [None req-91a6cfe8-f1f4-4bab-82f3-219f71409f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:09:11.836081 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6cfe8-f1f4-4bab-82f3-219f71409f1b admin admin] Validating token access rules against request {{(pid=98478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:09:11.854520 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:09:11.893088 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f757e17-55c7-4c5c-855a-4942ecb5a1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07db6516e8ce4759bb6e5167b3fb5367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba0bc4e750d24ff2b5db7519dfabe004', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:09:11.893707 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f757e17-55c7-4c5c-855a-4942ecb5a1c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:09:11.893981 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f757e17-55c7-4c5c-855a-4942ecb5a1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:09:11.894274 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f757e17-55c7-4c5c-855a-4942ecb5a1c1 admin admin] PATH_INFO: `/v3/projects/95006e05552d4ffdb53dd47a045fc2e2` {{(pid=98478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:09:11.895361 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f757e17-55c7-4c5c-855a-4942ecb5a1c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95006e05552d4ffdb53dd47a045fc2e2)` {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:09:11.897775 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f757e17-55c7-4c5c-855a-4942ecb5a1c1 admin admin] RBAC: Authorization granted {{(pid=98478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:09:12.007084 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-8f757e17-55c7-4c5c-855a-4942ecb5a1c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95006e05552d4ffdb53dd47a045fc2e2', 'request_id': 'req-8f757e17-55c7-4c5c-855a-4942ecb5a1c1'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:09:12.012814 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-8f757e17-55c7-4c5c-855a-4942ecb5a1c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95006e05552d4ffdb53dd47a045fc2e2', 'request_id': 'req-8f757e17-55c7-4c5c-855a-4942ecb5a1c1'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:09:12.113009 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-8f757e17-55c7-4c5c-855a-4942ecb5a1c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95006e05552d4ffdb53dd47a045fc2e2', 'request_id': 'req-8f757e17-55c7-4c5c-855a-4942ecb5a1c1'} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:09:12.125027 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-8f757e17-55c7-4c5c-855a-4942ecb5a1c1 admin admin] The token cache is being invalidate because project 95006e05552d4ffdb53dd47a045fc2e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 10:09:12.125309 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-8f757e17-55c7-4c5c-855a-4942ecb5a1c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:09:12.125924 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG keystone.notifications [None req-8f757e17-55c7-4c5c-855a-4942ecb5a1c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 10:09:12.127399 dv-cinder-815660-9-smb devstack@keystone.service[98478]: [pid: 98478|app: 0|req: 1464/2907] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Aug 11 10:09:11 2022] DELETE /identity/v3/projects/95006e05552d4ffdb53dd47a045fc2e2 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:09:21.575637 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:09:22.142615 dv-cinder-815660-9-smb devstack@keystone.service[98478]: DEBUG dbcounter [-] [98478] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:13:15.293500 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b980d-ccd8-4fca-874b-139d67fb14e1 admin admin] Authenticating user token {{(pid=98479) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:13:15.294949 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-5c7b980d-ccd8-4fca-874b-139d67fb14e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:13:15.363298 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b980d-ccd8-4fca-874b-139d67fb14e1 admin admin] Validating token access rules against request {{(pid=98479) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:13:15.420328 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eab359-0aa7-4b78-b313-1bdcff61acf3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0061ce46df224f4491599ed10548b2ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0211f5c0b174c8c998e3ad29f96baab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98479) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:13:15.420930 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eab359-0aa7-4b78-b313-1bdcff61acf3 service placement] REQUEST_METHOD: `GET` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:13:15.421208 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eab359-0aa7-4b78-b313-1bdcff61acf3 service placement] SCRIPT_NAME: `/identity` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:13:15.421481 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eab359-0aa7-4b78-b313-1bdcff61acf3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98479) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:13:15.423236 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.fernet_utils [None req-39eab359-0aa7-4b78-b313-1bdcff61acf3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98479) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:13:15.434265 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eab359-0aa7-4b78-b313-1bdcff61acf3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:13:15.435819 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eab359-0aa7-4b78-b313-1bdcff61acf3 service placement] RBAC: Authorization granted {{(pid=98479) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:13:15.445456 dv-cinder-815660-9-smb devstack@keystone.service[98479]: [pid: 98479|app: 0|req: 1444/2908] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Aug 11 10:13:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:13:25.441272 dv-cinder-815660-9-smb devstack@keystone.service[98479]: DEBUG dbcounter [-] [98479] Writing DB stats keystone:SELECT=58 {{(pid=98479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}